Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Map Reduce Local Task

Copy link to this message
Re: Map Reduce Local Task
That setting will make Hive more aggressive about trying to convert a join
to a local task, where it bypasses the job tracker. When you're
experimenting with queries on a small data set, it can make things much
faster, but won't be useful for large data sets where you need the cluster.


On Tue, Jan 8, 2013 at 9:11 AM, Santosh Achhra <[EMAIL PROTECTED]>wrote:

> Is setting hive.auto.convert.join to true will help setting mapreduce
> local task and conditional task ?
> Good wishes,always !
> Santosh
> On Tue, Jan 8, 2013 at 4:04 PM, Santosh Achhra <[EMAIL PROTECTED]>wrote:
>> Hello,
>> I was reading an article on web which tells about MapReduce local Task
>> and use of hash table files and conditional tasks to improve performance of
>> hive queries.
>> Any idea how to implement this ? I am aware of Map joins but I am sure
>> how to implement Map reduce local tasks with hash tables.
>> Good wishes,always !
>> Santosh
*Dean Wampler, Ph.D.*