Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Making Pig run faster in local mode


Copy link to this message
-
RE: Making Pig run faster in local mode
Hi Dmitriy,
  It's not that it hangs at any point I think. It just seems to be
slow in general. I tried jstacking the process, but the output didn't seem
to change, so I think it's just a general slowness

Thanks for all the input, we've managed to workaround it by rescheduling and
if we need to scale any further, we'll install a 1-node Hadoop cluster.
Thanks
Malc

-----Original Message-----
From: Dmitriy Ryaboy [mailto:[EMAIL PROTECTED]]
Sent: 08 January 2013 07:36
To: [EMAIL PROTECTED]
Subject: Re: Making Pig run faster in local mode

Try jstacking it a few times while it's running. Is it just sitting idly in
a sleep() ?
On Mon, Jan 7, 2013 at 11:56 AM, Cheolsoo Park <[EMAIL PROTECTED]>wrote:

> Typo: it makes much sense to run them in cluster => it doesn't make
> much sense to run them in cluster.
>
> On Mon, Jan 7, 2013 at 11:55 AM, Cheolsoo Park <[EMAIL PROTECTED]
> >wrote:
>
> > it makes much sense to run them in cluster.
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB