Hive, mail # dev - writing your own custom map-reduce to scan a table

writing your own custom map-reduce to scan a table

Mahsa Mofidpoor 2012-08-17, 19:35

Hi all,

Does anybody know how you can write your own custom mapReduce to scan a
table?

Thank you in advance for your response.
Mahsa

Re: writing your own custom map-reduce to scan a table

Navis류승우 2012-08-20, 06:52

How about using HCatalogue? I heard it's made for that kind of works.

2012/8/18 Mahsa Mofidpoor <[EMAIL PROTECTED]>

> Hi all,
>
> Does anybody know how you can write your own custom mapReduce to scan a
> table?
>
> Thank you in advance for your response.
> Mahsa
>

Re: writing your own custom map-reduce to scan a table

Bertrand Dechoux 2012-08-20, 07:22

Hi,

I am not sure to understand why this question is asked in the dev mailing
list of hive. You will have more answer using common hadoop or hbase
mailing lists.

The answer is that you have to use a custom InputFormat for HBase like
TableInputFormat
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/TableInputFormat.html

Regards

Bertrand

On Mon, Aug 20, 2012 at 8:52 AM, Navis류승우 <[EMAIL PROTECTED]> wrote:

> How about using HCatalogue? I heard it's made for that kind of works.
>
> 2012/8/18 Mahsa Mofidpoor <[EMAIL PROTECTED]>
>
> > Hi all,
> >
> > Does anybody know how you can write your own custom mapReduce to scan a
> > table?
> >
> > Thank you in advance for your response.
> > Mahsa
> >
>

--
Bertrand Dechoux