Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Mapreduce log question


Copy link to this message
-
Re: Mapreduce log question
Dave Latham 2011-05-25, 13:18
Are you using TableInputFormat?  If so, if you turn on DEBUG level logging
for hbase (or just org.apache.hadoop.hbase.mapreduce.TableInputFormatBase)
you should see lines like this, giving the map task number, region location,
start row, and end row:

getSplits: split -> 0 ->
hslave107:,@G\xA0\xFB\xBC\x94\x8C\x00~\xFF\xE3\xD3\xEA#\xBC\xE1\xDD\xE0|6\x01\x81\xC6\x1C
getSplits: split -> 1 -> hslave117:@G
\xA0\xFB\xBC\x94\x8C\x00~\xFF\xE3\xD3\xEA#\xBC\xE1\xDD\xE0|6\x01\x81\xC6\x1C,\x80F\xB8\xD2$\xAA\xCD(\x09\xB1\xB4\xA1\xB0A\x937tY\x99r\x01\x83\xB3\x18
getSplits: split -> 2 ->
hslave94:\x80F\xB8\xD2$\xAA\xCD(\x09\xB1\xB4\xA1\xB0A\x937tY\x99r\x01\x83\xB3\x18,\xC03\xBE\xF9K\xEB\xD4\xDDR5\x8C\xECa\x98}`\x1E,\xA9\xA0\x01\x83\xB3\x18
getSplits: split -> 3 ->
hslave1:\xC03\xBE\xF9K\xEB\xD4\xDDR5\x8C\xECa\x98}`\x1E,\xA9\xA0\x01\x83\xB3\x18,
: job_201105191622_1815

Dave

On Wed, May 25, 2011 at 2:18 AM, Kleegrewe, Christian <
[EMAIL PROTECTED]> wrote:

> Hi all,
>
> I would like to figure out on which table region is used by a specific map
> task. Is there a possibility to find such informaiton in the hbase logs?
>
> Thanks in advance
>
> Christian
>
> ------------------8<--------------------------
>
> Siemens AG
> Corporate Technology
> Corporate Research and Technologies
> CT T DE IT3
> Otto-Hahn-Ring 6
> 81739 München, Deutschland
> Tel.: +49 (89) 636-42722
> Fax: +49 (89) 636-41423
> mailto:[EMAIL PROTECTED]
>
> Siemens Aktiengesellschaft: Vorsitzender des Aufsichtsrats: Gerhard Cromme;
> Vorstand: Peter Löscher, Vorsitzender; Roland Busch, Brigitte Ederer, Klaus
> Helmrich, Joe Kaeser, Barbara Kux, Hermann Requardt, Siegfried Russwurm,
> Peter Y. Solmssen, Michael Süß; Sitz der Gesellschaft: Berlin und München,
> Deutschland; Registergericht: Berlin Charlottenburg, HRB 12300, München, HRB
> 6684; WEEE-Reg.-Nr. DE 23691322
>
>
>
>