| clear query|facets|time |
Search criteria: .
Results from 111 to 120 from
367 (0.089s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Reducer estimation - Pig - [mail # dev]
|
|
...Awesome! It would be good to have a flat-file based impl as there will probably a lot of pig users not having an hbase instance setup for stats persistence. Let me know if I can help in anyw...
|
|
|
Author: Prashant Kommireddi,
2012-12-04, 07:10
|
|
|
Reducer estimation - Pig - [mail # dev]
|
|
...I have been thinking about using Pig statistics for # reducers estimation. Though the current heuristic approach works fine, it requires an admin or the programmer to understand what the bes...
|
|
|
Author: Prashant Kommireddi,
2012-12-04, 06:32
|
|
|
Re: Running pig script as different user - Pig - [mail # user]
|
|
...Hi Miki, What version of hadoop are you on? I can confirm this works on 0.20.2 but never tried this on the newer versions. Try hadoop.job.ugi= where the group must be the name of...
|
|
|
Author: Prashant Kommireddi,
2012-12-01, 01:52
|
|
|
Re: Running pig script as different user - Pig - [mail # user]
|
|
...Try using "hadoop.job.ugi" to run the jobs as a different user on the cluster. I'm not sure if that works on the more recent versions of Hadoop though. Sent from my iPhone On Nov...
|
|
|
Author: Prashant Kommireddi,
2012-11-29, 01:02
|
|
|
Re: Error while running pig scripts in Hadoop - Pig - [mail # user]
|
|
...The error says your input path does not exist - /user/root/excite.log.bz2 Sent from my iPhone On Nov 24, 2012, at 11:13 AM, Satya Sundeep Kambhampati wrote: ...
|
|
|
Author: Prashant Kommireddi,
2012-11-24, 19:15
|
|
|
Re: distributed cache - Pig - [mail # user]
|
|
...If it's for purposes other than a Join, you could write a UDF to use distributed cache. Look at the section "Loading the Distributed Cache" http://ofps.oreilly.com/titles/9781449302641/writi...
|
|
|
Author: Prashant Kommireddi,
2012-11-14, 19:51
|
|
|
Re: The essence from hundreds of posts from Apache Pig user mailing list - Pig - [mail # user]
|
|
...Hi Adam, Thanks for putting together the blog post, it's great and has a lot of useful information that sometimes gets lost after being discussed on the mailing lists! I am sure it wil...
|
|
|
Author: Prashant Kommireddi,
2012-11-14, 16:09
|
|
|
Re: PigLatin : How to find size of the input file - Pig - [mail # user]
|
|
...Hi Pooja, You can do a "fs -dus /path/to/dir" to get the size in bytes. If you need to compare size with something it's easier to use a scripting language (python etc) to do that, and ...
|
|
|
Author: Prashant Kommireddi,
2012-11-14, 15:36
|
|
|
Re: Join implementations - Pig - [mail # dev]
|
|
...Thanks Jon, Ashutosh. On Tue, Nov 13, 2012 at 7:01 PM, Ashutosh Chauhan wrote: ...
|
|
|
Author: Prashant Kommireddi,
2012-11-14, 07:28
|
|
|
Re: Dynamically generating load/store path - Pig - [mail # user]
|
|
...You could write a custom load/storefunc and override setLocation(String location, Job job). The logic you want the UDF for could go in there. On Tue, Nov 13, 2012 at 4:45 PM, Jo...
|
|
|
Author: Prashant Kommireddi,
2012-11-14, 00:55
|
|
|
|
