| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
65 (0.126s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: save several 64MB files in Pig Latin - Pig - [mail # user]
|
|
...Hi, Pedro: Basically how many splits of files depends on how many reducer you have in your Pig job. So if total result data size is 100MB, and you have 10 reducers, you will get 10 files and...
|
|
|
Author: Johnny Zhang,
2013-06-10, 06:58
|
|
|
[PIG-3250] Pig dryrun generates wrong output in .expanded file for 'SPLIT....OTHERWISE...' command - Pig - [issue]
|
|
...step to reproduce it:1. input files 'users'123452. pig script split.pigdefine group_and_count (A,key) returns B { SPLIT $A INTO $B IF $key<7, Y IF $key==5, Z OTHERWISE;}...
|
|
|
http://issues.apache.org/jira/browse/PIG-3250
Author: Johnny Zhang,
2013-06-10, 01:31
|
|
|
Re: save several 64MB files in Pig Latin - Pig - [mail # user]
|
|
...Pedro, you can try Piggybank MultiStorage, which split results into different dir/files by specific index attribute. But not sure how it can make sure the file size is 64MB. Why 64MB specifi...
|
|
|
Author: Johnny Zhang,
2013-06-07, 08:14
|
|
|
Re: Processing TSV files using Pig - Pig - [mail # user]
|
|
...Hi, Jerry: This seems what you need. http://mail-archives.apache.org/mod_mbox/pig-user/201301.mbox/%3CCAB-acjMoZNyeTkL+[EMAIL PROTECTED]%3E Johnny On Thu, Jun 6, 2013 at 2:47 PM...
|
|
|
Author: Johnny Zhang,
2013-06-06, 21:58
|
|
|
Re: Tracking parts of a job taking the most time - Pig - [mail # user]
|
|
...How about disable multi-query execution and use UDF CurrentTime to print time between each script block? Johnny On Tue, Jun 4, 2013 at 7:11 PM, John Meek wrote: ...
|
|
|
Author: Johnny Zhang,
2013-06-05, 06:15
|
|
|
[PIG-2569] Fix org.apache.pig.test.TestInvoker.testSpeed - Pig - [issue]
|
|
...the Pig unit test org.apache.pig.test.TestInvoker.testSpeed pass sometimes and fail sometimes. I think this test need further polish, look at the code:@Test public void tes...
|
|
|
http://issues.apache.org/jira/browse/PIG-2569
Author: Johnny Zhang,
2013-05-30, 01:17
|
|
|
[PIG-3314] make better symbol resolving order in Pig - Pig - [issue]
|
|
...this idea comes when we trying to resolve PIG-2248, please take a look the comments starts from https://issues.apache.org/jira/browse/PIG-2248?focusedCommentId=13648831&page=com.atlassia...
|
|
|
http://issues.apache.org/jira/browse/PIG-3314
Author: Johnny Zhang,
2013-05-17, 09:27
|
|
|
Re: Unit test classpath trouble - Pig - [mail # dev]
|
|
...Thanks, Rohini, the tests all pass. As Cheolsoo suggested, trunk is fine with Hadoop 2.0.4-alpha. Johnny On Mon, May 13, 2013 at 11:55 AM, Rohini Palaniswamy wrote: ...
|
|
|
Author: Johnny Zhang,
2013-05-14, 17:12
|
|
|
Re: Unit test classpath trouble - Pig - [mail # dev]
|
|
...I run unit test against 2.0.4-alpha in the trunk. The tests hit "OutOfMemoryError: PermGen space" in the middle, but so far no failures or errors. I re-kicked off the test. Johnny &nbs...
|
|
|
Author: Johnny Zhang,
2013-05-13, 17:22
|
|
|
Re: Unit test classpath trouble - Pig - [mail # dev]
|
|
...Hi, Andrew: I just set up a job to run unit test against 2.0.4-alpha. I will investigate failure and reply to thread. Thanks, Johnny Zhang On Fri, May 10, 2013 at 6:19 PM, Andre...
|
|
|
Author: Johnny Zhang,
2013-05-11, 01:49
|
|
|
|
