Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Wrong input split locations after enabling reverse DNS


+
Robert Dyer 2012-12-16, 09:16
Copy link to this message
-
Re: Wrong input split locations after enabling reverse DNS
On Sun, Dec 16, 2012 at 1:16 AM, Robert Dyer <[EMAIL PROTECTED]> wrote:

> I recently enabled reverse DNS on my test cluster.  Now when I run a MR
> job, the HBase input split locations are all adding a period to the end.
>  For example:
>
> /default-rack/foo-1.
> /default-rack/foo-2.
>
> Yet the machine locations are still correct:
>
> /default-rack/foo-1
> /default-rack/foo-2
>
> Since those strings don't match, it isn't assigning the tasks locally.  It
> actually thinks 100% of the map tasks are rack-local and 0% data-local
> (although in reality, some still wind up being data-local due to sheer
> luck).
>
> What is the issue here?  Note that I don't have this problem with the MR
> tasks using SequenceFile as input, only with HBase's TableMapper.
>
Looks like https://issues.apache.org/jira/browse/HBASE-4109 ?
St.Ack
+
Robert Dyer 2012-12-18, 01:26
+
Jean-Daniel Cryans 2012-12-18, 02:21
+
Robert Dyer 2012-12-18, 02:39
+
Jean-Daniel Cryans 2012-12-18, 02:45
+
Robert Dyer 2013-01-28, 09:37