| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
13 (0.149s).
|
|
|
Loading phrases to help you refine your search...
|
|
RE: Making Pig run faster in local mode - Pig - [mail # user]
|
|
...Hi Dmitriy, It's not that it hangs at any point I think. It just seems to be slow in general. I tried jstacking the process, but the output didn't seem to change, so I think it's ju...
|
|
|
Author: Malcolm Tye,
2013-01-21, 14:01
|
|
|
RE: Making Pig run faster in local mode - Pig - [mail # user]
|
|
...Hi, It's Pig 0.10.0. Here's some timings I took. I have more than 3 files to process, but I just started out with 3 files to get some numbers. # Files Time(s) 1 28 2 48 3 ...
|
|
|
Author: Malcolm Tye,
2013-01-07, 11:16
|
|
|
Making Pig run faster in local mode - Pig - [mail # user]
|
|
...Hi, Any ideas on how to make Pig run quicker when running it in local mode ? I'm processing 3 files of about 13MB ...
|
|
|
Author: Malcolm Tye,
2013-01-04, 17:35
|
|
|
RE: Intermittent NullPointerException - Pig - [mail # user]
|
|
...Hi Cheolsoo, When we encounter the problem, we can reprocess the file with no problems in a later run. If you want a sample file I can pick one up for you if you want ? OK, we'...
|
|
|
Author: Malcolm Tye,
2012-11-21, 11:58
|
|
|
RE: Intermittent NullPointerException - Pig - [mail # user]
|
|
...Hi Cheolsoo, The patch works as expected. We've not seen one error in the test system since we installed the new jar file. We're only processing ~200 rows at the most when we run the...
|
|
|
Author: Malcolm Tye,
2012-11-19, 20:30
|
|
|
RE: Intermittent NullPointerException - Pig - [mail # user]
|
|
...Hi, Looks like zip files get rejected. Here's the log file unzipped Malc From: Malcolm Tye [mailto:[EMAIL PROTECTED]] Sent: 14 November 2012 12:01 To: '[EMAIL PROTECTED]...
|
|
|
Author: Malcolm Tye,
2012-11-14, 12:32
|
|
|
RE: Intermittent NullPointerException - Pig - [mail # user]
|
|
...Hi Cheolsoo, Even with the recompiled Pig, we still see the error. He's a debug log from Pig. It doesn't seem to give any more information. Any ideas ? Thanks Malc  ...
|
|
|
Author: Malcolm Tye,
2012-11-14, 12:01
|
|
|
RE: Intermittent NullPointerException - Pig - [mail # user]
|
|
...Hi Cheolsoo, I tried setting default_parallel to 1 to rule out parallel processing, but the problem still happened. I've recompiled Pig and have put that into the test environment wi...
|
|
|
Author: Malcolm Tye,
2012-11-13, 12:57
|
|
|
RE: Intermittent NullPointerException - Pig - [mail # user]
|
|
...Hi Cheolsoo, I'm not specifically setting default_parallel in my script anywhere and I see this in the log file :- org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCon...
|
|
|
Author: Malcolm Tye,
2012-11-12, 22:46
|
|
|
Intermittent NullPointerException - Pig - [mail # user]
|
|
...Hi, I'm running Pig 0.10.0 in local mode on some small text files. There is no intention to run it on Hadoop at all. We have a job that runs every 5 minutes and about 3% ...
|
|
|
Author: Malcolm Tye,
2012-11-12, 15:14
|
|
|
|