| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
28 (0.145s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: How do I load JSON in Pig? - Pig - [mail # user]
|
|
...No sure if this helps, but in 0.11 I've been using this on EMR for some of our JSON data.... raw = load 'hdfs:///cleaned_logs/clicks2/$year_id/$month_id/part-*' USING JsonLoader('a:cha...
|
|
|
Author: Dan Young,
2012-11-18, 01:23
|
|
|
Re: STREAM in foreach block - Pig - [mail # user]
|
|
...I believe these are the ops supported in a nested foreach: CROSS, DISTINCT, FILTER, FOREACH, LIMIT, and ORDER BY. See: http://pig.apache.org/docs/r0.10.0/basic.html#foreach...
|
|
|
Author: Dan Young,
2012-09-18, 03:27
|
|
|
Hadoop version question... - Pig - [mail # user]
|
|
...I noticed that Amazon EMR now supports Hadoop 1.0.3, does pig 0.10.x work/certified with Hadoop 1.0.3? Regards, Dano...
|
|
|
Author: Dan Young,
2012-08-07, 17:44
|
|
|
MaxMapTaskFailuresPercent setting? - Pig - [mail # user]
|
|
...Can I set the MaxMapTaskFailurePercent in my pig jobs? If so how? what would be the set command? Regards, Dano...
|
|
|
Author: Dan Young,
2012-08-01, 14:46
|
|
|
Re: How to CONCAT multiple expressions - Pig - [mail # user]
|
|
...Try org.apache.pig.builtin.StringConcat Dano On Tuesday, July 10, 2012, Cdy Chen wrote: ...
|
|
|
Author: Dan Young,
2012-07-12, 02:14
|
|
|
Re: Copying files to Amazon S3 using Pig is slow - Pig - [mail # user]
|
|
...Definitely go down the s3distcp route. I use it to copy large number of smaller files from s3 into fewer larger ones in HDFS and it's been working great. This also helps out with the Pig job...
|
|
|
Author: Dan Young,
2012-06-09, 15:13
|
|
|
Re: STRSPLIT problems (or UDF shortcoming?) - Pig - [mail # user]
|
|
...A quick test would be to scp the 0.10 pig.jar over to your master node, and then run: hadoop -jar pig.jar . Run your script in grunt... Dano On May 17, 2012 5:26 PM, "Nerius Land...
|
|
|
Author: Dan Young,
2012-05-17, 23:37
|
|
|
Re: STRSPLIT problems (or UDF shortcoming?) - Pig - [mail # user]
|
|
...We ended up using 0.10 on EMR and its been working fine so far... Dano On May 17, 2012 5:26 PM, "Nerius Landys" wrote: ...
|
|
|
Author: Dan Young,
2012-05-17, 23:30
|
|
|
Re: STRSPLIT problems (or UDF shortcoming?) - Pig - [mail # user]
|
|
...Have you tried 0.10? On May 17, 2012 5:13 PM, "Nerius Landys" wrote: ...
|
|
|
Author: Dan Young,
2012-05-17, 23:24
|
|
|
Re: STRSPLIT problems (or UDF shortcoming?) - Pig - [mail # user]
|
|
...What version of pig are you using on EMR? On May 17, 2012 5:02 PM, "Nerius Landys" wrote: ...
|
|
|
Author: Dan Young,
2012-05-17, 23:06
|
|
|
|
