|
|
Nitin Pawar 2012-07-23, 07:18
you may try this
set hive.mapred.partitionerorg.apache.hadoop.mapred.lib.TotalOrderPartitioner; set total.order.partitioner.natural.order=[false|true]; set total.order.partitioner.path=[path];
On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal <[EMAIL PROTECTED]> wrote: > > hi all, > > How to use total order partitioner hive? > > Regards > Abhishek -- Nitin Pawar
Abhishek 2012-07-24, 12:56
Hi nitin,
Thanks for the reply.By setting this in hive does it improve the performance ?
Regards Abhi
Sent from my iPhone
On Jul 23, 2012, at 3:18 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:
> you may try this > > set hive.mapred.partitioner> org.apache.hadoop.mapred.lib.TotalOrderPartitioner; > set total.order.partitioner.natural.order=[false|true]; > set total.order.partitioner.path=[path]; > > On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal > <[EMAIL PROTECTED]> wrote: >> >> hi all, >> >> How to use total order partitioner hive? >> >> Regards >> Abhishek > > > > > -- > Nitin Pawar
Nitin Pawar 2012-07-24, 13:50
Tried rarely.
It also depends on the data :)
On Tue, Jul 24, 2012 at 6:26 PM, Abhishek <[EMAIL PROTECTED]> wrote: > Hi nitin, > > Thanks for the reply.By setting this in hive does it improve the performance ? > > Regards > Abhi > > Sent from my iPhone > > On Jul 23, 2012, at 3:18 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote: > >> you may try this >> >> set hive.mapred.partitioner>> org.apache.hadoop.mapred.lib.TotalOrderPartitioner; >> set total.order.partitioner.natural.order=[false|true]; >> set total.order.partitioner.path=[path]; >> >> On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal >> <[EMAIL PROTECTED]> wrote: >>> >>> hi all, >>> >>> How to use total order partitioner hive? >>> >>> Regards >>> Abhishek >> >> >> >> >> -- >> Nitin Pawar
-- Nitin Pawar
Abhishek 2012-07-24, 14:08
Data is skewed here so does it help?
Thanks Abhi Sent from my iPhone
On Jul 24, 2012, at 9:50 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:
> Tried rarely. > > It also depends on the data :) > > On Tue, Jul 24, 2012 at 6:26 PM, Abhishek <[EMAIL PROTECTED]> wrote: >> Hi nitin, >> >> Thanks for the reply.By setting this in hive does it improve the performance ? >> >> Regards >> Abhi >> >> Sent from my iPhone >> >> On Jul 23, 2012, at 3:18 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote: >> >>> you may try this >>> >>> set hive.mapred.partitioner>>> org.apache.hadoop.mapred.lib.TotalOrderPartitioner; >>> set total.order.partitioner.natural.order=[false|true]; >>> set total.order.partitioner.path=[path]; >>> >>> On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal >>> <[EMAIL PROTECTED]> wrote: >>>> >>>> hi all, >>>> >>>> How to use total order partitioner hive? >>>> >>>> Regards >>>> Abhishek >>> >>> >>> >>> >>> -- >>> Nitin Pawar > > > > -- > Nitin Pawar
|
|