Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Making Pig run faster in local mode


Copy link to this message
-
Re: Making Pig run faster in local mode
+1 wasn't there a slowdown bug a little while ago?

What version of Pig?
On Jan 4, 2013 11:07 AM, "Jonathan Coveney" <[EMAIL PROTECTED]> wrote:

> How long is it taking?
>
>
> 2013/1/4 Malcolm Tye <[EMAIL PROTECTED]>
>
> > Hi,
> >
> >                 Any ideas on how to make Pig run quicker when running it
> in
> > local mode ?
> >
> >
> >
> > I'm processing 3 files of about 13MB each with 3 group by statements in
> my
> > script which seem to suck up the time. There's no joins
> >
> >
> >
> > Increasing the heap size has made no difference and it doesn't use all
> that
> > anyway.
> >
> >
> >
> > I'm on default settings apart from that.
> >
> >
> >
> >
> >
> > Thanks
> >
> >
> >
> > Malc
> >
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB