Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> Re: Hive partitioner


Copy link to this message
-
Re: Hive partitioner
Data is skewed here so does it help?

Thanks
Abhi
Sent from my iPhone

On Jul 24, 2012, at 9:50 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:

> Tried rarely.
>
> It also depends on the data :)
>
> On Tue, Jul 24, 2012 at 6:26 PM, Abhishek <[EMAIL PROTECTED]> wrote:
>> Hi nitin,
>>
>> Thanks for the reply.By setting this in hive does it improve the performance ?
>>
>> Regards
>> Abhi
>>
>> Sent from my iPhone
>>
>> On Jul 23, 2012, at 3:18 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:
>>
>>> you may try this
>>>
>>> set hive.mapred.partitioner>>> org.apache.hadoop.mapred.lib.TotalOrderPartitioner;
>>> set total.order.partitioner.natural.order=[false|true];
>>> set total.order.partitioner.path=[path];
>>>
>>> On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal
>>> <[EMAIL PROTECTED]> wrote:
>>>>
>>>> hi all,
>>>>
>>>> How to use total order partitioner hive?
>>>>
>>>> Regards
>>>> Abhishek
>>>
>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>
>
>
> --
> Nitin Pawar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB