-Re: Map Reduce Local Task
Dean Wampler 2013-01-08, 15:59
That setting will make Hive more aggressive about trying to convert a join
to a local task, where it bypasses the job tracker. When you're
experimenting with queries on a small data set, it can make things much
faster, but won't be useful for large data sets where you need the cluster.
On Tue, Jan 8, 2013 at 9:11 AM, Santosh Achhra <[EMAIL PROTECTED]>wrote:
> Is setting hive.auto.convert.join to true will help setting mapreduce
> local task and conditional task ?
> Good wishes,always !
> On Tue, Jan 8, 2013 at 4:04 PM, Santosh Achhra <[EMAIL PROTECTED]>wrote:
>> I was reading an article on web which tells about MapReduce local Task
>> and use of hash table files and conditional tasks to improve performance of
>> hive queries.
>> Any idea how to implement this ? I am aware of Map joins but I am sure
>> how to implement Map reduce local tasks with hash tables.
>> Good wishes,always !
*Dean Wampler, Ph.D.*