| clear query|facets|time |
Search criteria: .
Results from 21 to 30 from
195 (0.097s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Some proposals for Pig performance optimization - Pig - [mail # dev]
|
|
...bcc'ing the user list. 1. Order-by The comparison against hive order-by is misleading. Hive does not do total ordering, unless you use a single reducer. But yes, in case of pig, ...
|
|
|
Author: Thejas Nair,
2012-06-21, 20:27
|
|
|
Re: Job setup for a pig run takes ages - Pig - [mail # user]
|
|
...Yes, pig should cache the results of getschema(). that is someting to be fixed. Julien is working on some patches to fix the issues related to udfcontext, including reducing the ...
|
|
|
Author: Thejas Nair,
2012-06-19, 16:35
|
|
|
Re: Job setup for a pig run takes ages - Pig - [mail # user]
|
|
...Hi Markus, Thanks for reporting the results of the change, and the jstack. The jstack information is useful, as I suspected the time is being spent finding the schema of from the load ...
|
|
|
Author: Thejas Nair,
2012-06-05, 22:35
|
|
|
Re: Job setup for a pig run takes ages - Pig - [mail # user]
|
|
...Can you do a jstack on the pig client process id a few times and see what it is doing when it is taking so long and send the results ? With that we should be able to easily ident...
|
|
|
Author: Thejas Nair,
2012-06-01, 16:45
|
|
|
Re: Issue with PigServer: java.lang.NoSuchFieldError: name - Pig - [mail # user]
|
|
...Do you have another version of antlr jar in your classpath (different from version used in pig)? I have seen this problem earlier, and it seemed to go away when I removed unneces...
|
|
|
Author: Thejas Nair,
2012-06-01, 02:42
|
|
|
Re: Job setup for a pig run takes ages - Pig - [mail # user]
|
|
...Markus, Can you try running jstack a few times on the pig client process to see what it is doing and let us know ? Also, is this part a typo ? Did it actually take 30 mins for co...
|
|
|
Author: Thejas Nair,
2012-06-01, 02:39
|
|
|
Re: Create rdbms like sequence in Pig on Pig Relation - Pig - [mail # user]
|
|
...What do you mean by 'rdbms like sequence' ? Thanks, Thejas On 5/16/12 10:41 AM, DIPESH KUMAR SINGH wrote:...
|
|
|
Author: Thejas Nair,
2012-05-18, 01:20
|
|
|
Re: Load Pig metadata from file? - Pig - [mail # user]
|
|
...you can also use 'pig -dryrun ..' to see what the pig query after parameter substitution looks like. Thanks, Thejas On 5/15/12 4:56 PM, Saurabh S wrote:...
|
|
|
Author: Thejas Nair,
2012-05-16, 20:25
|
|
|
Re: Pig UDF question - Pig - [mail # user]
|
|
...On 5/15/12 4:18 PM, Mohit Anchlia wrote: Yes, every mapper task uses single jvm , so you would see one instance of the static member in each mapper task. Yes, a storefunc is the...
|
|
|
Author: Thejas Nair,
2012-05-16, 18:43
|
|
|
Re: replicated join amd map tasks - Pig - [mail # user]
|
|
...in replicated join , the number of maps spawned should be same as the number of splits for the first join input. In case of default join, there would be additional map tasks for the 2n...
|
|
|
Author: Thejas Nair,
2012-05-02, 21:30
|
|
|
|
