| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
26 (0.383s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: simple script generating 'too many counters' error - Pig - [mail # user]
|
|
...now that I've turned off noSplitCombination we have 640 mappers. the relation being ranked is likely in the billions or 1+ trillion records. On Fri, Apr 5, 2013 at 10:47 AM, Bil...
|
|
|
Author: Lauren Blau,
2013-04-05, 15:40
|
|
|
Re: simple script generating 'too many counters' error - Pig - [mail # user]
|
|
...this is defintely caused by the RANK operator. Is there some way to reduce the number of counters generated by this operator when working with large data? thanks On Thu, Apr 4, 2013 at...
|
|
|
Author: Lauren Blau,
2013-04-05, 14:13
|
|
|
Re: simple script generating 'too many counters' error - Pig - [mail # user]
|
|
...I can think of only 2 things that have changed since this script last ran successfully. Switched to using the range specification of the schema for a2, and the input data has grown considera...
|
|
|
Author: Lauren Blau,
2013-04-04, 23:01
|
|
|
Re: simple script generating 'too many counters' error - Pig - [mail # user]
|
|
...no On Thu, Apr 4, 2013 at 4:54 PM, Dmitriy Ryaboy wrote: ...
|
|
|
Author: Lauren Blau,
2013-04-04, 23:00
|
|
|
simple script generating 'too many counters' error - Pig - [mail # user]
|
|
...I'm running a simple script to add a sequence_number to a relation, sort the result and store to a file: a0 = load '' using PigStorage('\t','-schema'); a1 = rank a0; a2 = foreach a1 ge...
|
|
|
Author: Lauren Blau,
2013-04-04, 13:25
|
|
|
Re: Simplifying schema? - Pig - [mail # user]
|
|
...yeah, this is really annoying. I'd love to see an option to automatically strip these 'parentage' values for unique names. On Sat, Dec 8, 2012 at 1:48 PM, Chan, Tim wrote:...
|
|
|
Author: Lauren Blau,
2012-12-10, 13:47
|
|
|
Re: file system closed? - Pig - [mail # user]
|
|
...I was not creating the filesystem myself. The script was like: split into a and b join a and b filter join result. that's where it fails there is more after but I tried storeing after the fi...
|
|
|
Author: Lauren Blau,
2012-10-22, 01:15
|
|
|
file system closed? - Pig - [mail # user]
|
|
...I have a pig job that keeps failing at near completion. After 3 runs (long ones), I've finally found something out of the ordinary in a log: Anyone have any ideas what could be causing this?...
|
|
|
Author: Lauren Blau,
2012-10-21, 13:34
|
|
|
Another schema mixup, was: Re: group schema getting wrong fields? - Pig - [mail # user]
|
|
...This problem went away in 0.10, but has re-appeared in a slightly different context in the current trunk. In this script, I have something like split a into b,c d = join b, x; pd = project d...
|
|
|
Author: Lauren Blau,
2012-10-14, 01:44
|
|
|
imports and macro expansions - Pig - [mail # user]
|
|
...maybe I'm misunderstanding the scope and ordering of the imports and macro substitutions. I have 3 actual scripts. macros.pig has a single macro which takes 4 params and generates a load ins...
|
|
|
Author: Lauren Blau,
2012-10-10, 10:14
|
|
|
|
