Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Map Reduce Local Task

Santosh Achhra 2013-01-08, 08:04
Santosh Achhra 2013-01-08, 15:11
Dean Wampler 2013-01-08, 15:59
Santosh Achhra 2013-01-08, 16:11
Copy link to this message
Re: Map Reduce Local Task
Hi Santhosh

As long as the smaller table size is in the range of a few MBs. It is a good candidate for map join.

If the smaller table size is still more then you can take a look at bucketed map joins.

Bejoy KS

Sent from remote device, Please excuse typos

-----Original Message-----
From: Santosh Achhra <[EMAIL PROTECTED]>
Date: Wed, 9 Jan 2013 00:11:37
Subject: Re: Map Reduce Local Task

Thank you Dean,

One of our table is very small, it has only 16,000 rows and other big table
has 45 million plus records. Wont doing a loacl task help in this case ?

Good wishes,always !
On Tue, Jan 8, 2013 at 11:59 PM, Dean Wampler <

> more aggressive about trying to convert a join to a local task, where it
> bypasses the job tracker. When you're experimenting with queries on a small
> data set, it can make things much faster, but won't be useful for large
> data sets where you need the cluster.