Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Re: Map join optimization issue


+
Aniket Mokashi 2013-02-14, 08:11
+
Mayuresh Kunjir 2013-02-14, 15:25
Copy link to this message
-
Re: Map join optimization issue
I think hive.mapjoin.smalltable.filesize parameter will be disregarded in
that case.
On Thu, Feb 14, 2013 at 7:25 AM, Mayuresh Kunjir
<[EMAIL PROTECTED]>wrote:

> Yes, the hint was specified.
> On Feb 14, 2013 3:11 AM, "Aniket Mokashi" <[EMAIL PROTECTED]> wrote:
>
>> have you specified map-join hint in your query?
>>
>>
>> On Thu, Feb 7, 2013 at 11:39 AM, Mayuresh Kunjir <
>> [EMAIL PROTECTED]> wrote:
>>
>>>
>>> Hello all,
>>>
>>>
>>> I am trying to join two tables, the smaller being of size 4GB. When I
>>> set hive.mapjoin.smalltable.filesize parameter above 500MB, Hive tries to
>>> perform a local task to read the smaller file. This of-course fails since
>>> the file size is greater and the backup common join is then run. What I do
>>> not understand is why did Hive attempt a map join when small file size was
>>> greater than the smalltable.filesize parameter.
>>>
>>>
>>> ~Mayuresh
>>>
>>>
>>
>>
>> --
>> "...:::Aniket:::... Quetzalco@tl"
>>
>
--
"...:::Aniket:::... Quetzalco@tl"
+
Mayuresh Kunjir 2013-02-15, 15:37
+
bejoy_ks@... 2013-02-15, 16:57
+
Aniket Mokashi 2013-02-15, 21:05
+
Mayuresh Kunjir 2013-02-15, 21:57
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB