| clear query|facets|time |
Search criteria: .
Results from 51 to 60 from
1351 (0.119s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: PigStorage - Pig - [mail # user]
|
|
...That sounds reasonable, I've run into the same problem. Do you mind submitting a patch? On Fri, Nov 16, 2012 at 12:48 PM, pablomar wrote:...
|
|
|
Author: Dmitriy Ryaboy,
2012-11-16, 22:15
|
|
|
Re: About SpillableMemoryManager - Pig - [mail # user]
|
|
...mapred.child.java.opts should be in the gigabytes, 200M is way too low. Check this stack overflow thread for comments on how to ensure your setting actually takes effect -- it's possible you...
|
|
|
Author: Dmitriy Ryaboy,
2012-11-02, 16:07
|
|
|
Re: [DISCUSS] Remove Penny from contrib - Pig - [mail # dev]
|
|
...How would this work -- would we dump it on github somewhere in case someone wants to use it? On Thu, Nov 1, 2012 at 10:59 AM, Julien Le Dem wrote: ...
|
|
|
Author: Dmitriy Ryaboy,
2012-11-02, 00:05
|
|
|
Re: About SpillableMemoryManager - Pig - [mail # user]
|
|
...Rather than increase memory, rewrite the script so it does not need so much ram to begin with. You can split on $2, group and generate what you need, then join things back. Hard to tell what...
|
|
|
Author: Dmitriy Ryaboy,
2012-11-02, 00:00
|
|
|
Re: JOIN comparasion PIG V/S HIVE - Pig - [mail # user]
|
|
...Could you provide sample data and script that would allow us to reproduce this? Hive is faster at some things. Pig is faster at others. Both produce correct results. D On Mon, Oc...
|
|
|
Author: Dmitriy Ryaboy,
2012-10-23, 04:19
|
|
|
Re: Help on running pig in local mode - Pig - [mail # user]
|
|
...What are you running this on? This is really odd: /proc//status does not have information about swap space used(VmSwap). D On Fri, Oct 19, 2012 at 11:11 AM, lei tang ...
|
|
|
Author: Dmitriy Ryaboy,
2012-10-23, 00:39
|
|
|
Re: debug feature?? - Pig - [mail # user]
|
|
...Some testing tips: 1) parametrize your load/store statements so that if you have to run in hadoop mode, it's easy to switch to debug inputs / outputs (and debug input/output loaders an...
|
|
|
Author: Dmitriy Ryaboy,
2012-10-23, 00:32
|
|
|
Re: _SUCCESS file -> _FAILURE file? - Pig - [mail # user]
|
|
...That's a Hadoop mapreduce feature, not a Pig feature, so that request should go there. Can't really do the _failure thing though, if you think about it -- programs can fail by crashing...
|
|
|
Author: Dmitriy Ryaboy,
2012-10-18, 21:03
|
|
|
Re: How can I read Hive text files on S3 from Pig? - Pig - [mail # user]
|
|
...The same underlying class is used by PigStorage in 11, so we should clean this up to make S3 users happy. D On Thu, Oct 18, 2012 at 5:22 AM, Martin Goodson wrote:...
|
|
|
Author: Dmitriy Ryaboy,
2012-10-18, 20:59
|
|
|
Re: How can I read Hive text files on S3 from Pig? - Pig - [mail # user]
|
|
...Yeah that's a bug in FileLocalizer, apparently it assumes local or hdfs, only. Could you file a jira? D On Sat, Oct 13, 2012 at 2:53 AM, Martin Goodson wrote:...
|
|
|
Author: Dmitriy Ryaboy,
2012-10-18, 04:15
|
|
|
|
