Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Making Pig run faster in local mode


Copy link to this message
-
Making Pig run faster in local mode
Hi,

                Any ideas on how to make Pig run quicker when running it in
local mode ?

 

I'm processing 3 files of about 13MB each with 3 group by statements in my
script which seem to suck up the time. There's no joins

 

Increasing the heap size has made no difference and it doesn't use all that
anyway.

 

I'm on default settings apart from that.

 

 

Thanks

 

Malc

+
Jonathan Coveney 2013-01-04, 19:07
+
Russell Jurney 2013-01-04, 22:04
+
Malcolm Tye 2013-01-07, 11:16
+
Cheolsoo Park 2013-01-07, 19:55
+
Cheolsoo Park 2013-01-07, 19:56
+
Dmitriy Ryaboy 2013-01-08, 07:36
+
Malcolm Tye 2013-01-21, 14:01
+
Cheolsoo Park 2013-01-04, 19:07