Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # dev - Re: Hive partitioner


Copy link to this message
-
Re: Hive partitioner
Abhishek 2012-07-24, 14:08
Data is skewed here so does it help?

Thanks
Abhi
Sent from my iPhone

On Jul 24, 2012, at 9:50 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:

> Tried rarely.
>
> It also depends on the data :)
>
> On Tue, Jul 24, 2012 at 6:26 PM, Abhishek <[EMAIL PROTECTED]> wrote:
>> Hi nitin,
>>
>> Thanks for the reply.By setting this in hive does it improve the performance ?
>>
>> Regards
>> Abhi
>>
>> Sent from my iPhone
>>
>> On Jul 23, 2012, at 3:18 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:
>>
>>> you may try this
>>>
>>> set hive.mapred.partitioner>>> org.apache.hadoop.mapred.lib.TotalOrderPartitioner;
>>> set total.order.partitioner.natural.order=[false|true];
>>> set total.order.partitioner.path=[path];
>>>
>>> On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal
>>> <[EMAIL PROTECTED]> wrote:
>>>>
>>>> hi all,
>>>>
>>>> How to use total order partitioner hive?
>>>>
>>>> Regards
>>>> Abhishek
>>>
>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>
>
>
> --
> Nitin Pawar