| clear query|facets|time |
Search criteria: .
Results from 51 to 60 from
76 (0.065s).
|
|
|
Loading phrases to help you
refine your search...
|
|
easiest way to get loops in PIG? - Pig - [mail # user]
|
|
...I agree that pig does not have loop probably for a good reason. but currently I need to write a code to find the transitive closures of many edges in a graph. so I need to iterate a co...
|
|
|
Author: Yang,
2012-06-21, 02:11
|
|
|
Re: error to generate a map? - Pig - [mail # user]
|
|
...a related issue is grunt> a = load 'a' as (x:chararray, y:chararray); grunt> b = foreach a generate { (x,x),(y,y) } as ff:bag{ tt:tuple(hh:chararray, yy:chararray)}; 2012-...
|
|
|
Author: Yang,
2012-06-20, 23:28
|
|
|
Re: error to generate a map? - Pig - [mail # user]
|
|
...actually I found that the git_hub version of pig works fine for these examples likely some bug that was fixed On Wed, Jun 20, 2012 at 3:56 PM, Yang wrote: ...
|
|
|
Author: Yang,
2012-06-20, 23:00
|
|
|
Re: error to generate a map? - Pig - [mail # user]
|
|
...thanks Alan the problem does not seem to be string if I have a = load 'a' as x:chararray; b = foreach a generate (['mykey'#x]); it would fail while if u change ...
|
|
|
Author: Yang,
2012-06-20, 22:56
|
|
|
Re: pig generated 2 map-only jobs ? - Pig - [mail # user]
|
|
...Thanks, Alan, here it is SET mapred.max.jobs.per.node 1; SET mapred.max.maps.per.node 8; SET mapred.tasktracker.map.tasks.maximum 8; SET mapred.map.tasks 48; SET m...
|
|
|
Author: Yang,
2012-06-17, 16:39
|
|
|
Re: pig generated 2 map-only jobs ? - Pig - [mail # user]
|
|
...Thanks Alan. I attached the trimmed version of my script . basically the similars var generates a bag, explodes it, after that, each of the output record is filtered through a ...
|
|
|
Author: Yang,
2012-06-17, 04:06
|
|
|
pig.jar packages hadoop classes? - Pig - [mail # user]
|
|
...I noticed that in 0.8.x and earlier pig.jar , hadoop classes such as FileInputFormat are also packaged, then there is a potential problem that the behavior specified in the pig jar cou...
|
|
|
Author: Yang,
2012-06-17, 02:55
|
|
|
Re: different mapred.min.split.size within one pig script? - Pig - [mail # user]
|
|
...thanks, I tried, but it does not seem to work, even after I put the second set split.size= at the very end of the script, it is the second SET that takes effect for both places i...
|
|
|
Author: Yang,
2012-06-14, 06:08
|
|
|
pig generated 2 map-only jobs ? - Pig - [mail # user]
|
|
...this is what happened with my pig script. why would it generate 2 map-only jobs? wouldn't the optimization process chain together both mappers and keep only 1 mapper stage? thanks Yan...
|
|
|
Author: Yang,
2012-06-12, 06:21
|
|
|
different mapred.min.split.size within one pig script? - Pig - [mail # user]
|
|
...I need to set mapred.min.split.size for one part of my pig script because the mapper job corresponding to the first part of the script takes much longer time per input record than other part...
|
|
|
Author: Yang,
2012-06-11, 02:06
|
|
|
|
