HBase, mail # user - Re: Reading a Hdfs file using HBase

Reading a Hdfs file using HBase

Karthik Kumar 2011-06-06, 10:04

Hi,

Is it possible to read a file inside HDFS using HBase. If yes please help me
with way. What are all the class required to do it? Do i need to use
MapReduce?

--
With Regards,
Karthik

Re: Reading a Hdfs file using HBase

Joey Echeverria 2011-06-06, 15:22

I'm sorry, but I don't understand your question. Why do you need or
want an extra layer of indirection (HBase) in order to read your files
from HDFS?

-Joey

On Mon, Jun 6, 2011 at 6:04 AM, Karthik Kumar <[EMAIL PROTECTED]> wrote:
> Hi,
>
> Is it possible to read a file inside HDFS using HBase. If yes please help me
> with way. What are all the class required to do it? Do i need to use
> MapReduce?
>
> --
> With Regards,
> Karthik
>

--
Joseph Echeverria
Cloudera, Inc.
443.305.9434

Re: Reading a Hdfs file using HBase

James Ram 2011-06-07, 04:38

Hi,

I too have the same situation. The data in HDFS should be mapped to columns
in hbase. We will be putting data in bulk to HDFS and we want HBase to read
from HDFS and put the values in the respective columns. Is that possible.
How can I map the data from HDFS to HBase columns. Is there any class
available?

With Regards,
Jr.

On Mon, Jun 6, 2011 at 8:52 PM, Joey Echeverria <[EMAIL PROTECTED]> wrote:

> I'm sorry, but I don't understand your question. Why do you need or
> want an extra layer of indirection (HBase) in order to read your files
> from HDFS?
>
> -Joey
>
> On Mon, Jun 6, 2011 at 6:04 AM, Karthik Kumar <[EMAIL PROTECTED]>
> wrote:
> > Hi,
> >
> > Is it possible to read a file inside HDFS using HBase. If yes please help
> me
> > with way. What are all the class required to do it? Do i need to use
> > MapReduce?
> >
> > --
> > With Regards,
> > Karthik
> >
>
>
>
> --
> Joseph Echeverria
> Cloudera, Inc.
> 443.305.9434
>

--
With Regards,
Jr.

Re: Reading a Hdfs file using HBase

Bill Graham 2011-06-07, 05:23

You can load the HDFS files into HBase. Check out importtsv to generate
HFiles and completebulkload to load them into a table:

http://hbase.apache.org/bulk-loads.html
On Mon, Jun 6, 2011 at 9:38 PM, James Ram <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I too have the same situation. The data in HDFS should be mapped to columns
> in hbase. We will be putting data in bulk to HDFS and we want HBase to read
> from HDFS and put the values in the respective columns. Is that possible.
> How can I map the data from HDFS to HBase columns. Is there any class
> available?
>
> With Regards,
> Jr.
>
> On Mon, Jun 6, 2011 at 8:52 PM, Joey Echeverria <[EMAIL PROTECTED]> wrote:
>
> > I'm sorry, but I don't understand your question. Why do you need or
> > want an extra layer of indirection (HBase) in order to read your files
> > from HDFS?
> >
> > -Joey
> >
> > On Mon, Jun 6, 2011 at 6:04 AM, Karthik Kumar <[EMAIL PROTECTED]>
> > wrote:
> > > Hi,
> > >
> > > Is it possible to read a file inside HDFS using HBase. If yes please
> help
> > me
> > > with way. What are all the class required to do it? Do i need to use
> > > MapReduce?
> > >
> > > --
> > > With Regards,
> > > Karthik
> > >
> >
> >
> >
> > --
> > Joseph Echeverria
> > Cloudera, Inc.
> > 443.305.9434
> >
>
>
>
> --
> With Regards,
> Jr.
>

Re: Reading a Hdfs file using HBase

James Ram 2011-06-07, 10:32

Hi,

Thanks for your help. Is it possible for HBase to read the values directly
from an XML file in HDFS

On Tue, Jun 7, 2011 at 10:53 AM, Bill Graham <[EMAIL PROTECTED]> wrote:

> You can load the HDFS files into HBase. Check out importtsv to generate
> HFiles and completebulkload to load them into a table:
>
> http://hbase.apache.org/bulk-loads.html
>
>
> On Mon, Jun 6, 2011 at 9:38 PM, James Ram <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > I too have the same situation. The data in HDFS should be mapped to
> columns
> > in hbase. We will be putting data in bulk to HDFS and we want HBase to
> read
> > from HDFS and put the values in the respective columns. Is that possible.
> > How can I map the data from HDFS to HBase columns. Is there any class
> > available?
> >
> > With Regards,
> > Jr.
> >
> > On Mon, Jun 6, 2011 at 8:52 PM, Joey Echeverria <[EMAIL PROTECTED]>
> wrote:
> >
> > > I'm sorry, but I don't understand your question. Why do you need or
> > > want an extra layer of indirection (HBase) in order to read your files
> > > from HDFS?
> > >
> > > -Joey
> > >
> > > On Mon, Jun 6, 2011 at 6:04 AM, Karthik Kumar <
> [EMAIL PROTECTED]>
> > > wrote:
> > > > Hi,
> > > >
> > > > Is it possible to read a file inside HDFS using HBase. If yes please
> > help
> > > me
> > > > with way. What are all the class required to do it? Do i need to use
> > > > MapReduce?
> > > >
> > > > --
> > > > With Regards,
> > > > Karthik
> > > >
> > >
> > >
> > >
> > > --
> > > Joseph Echeverria
> > > Cloudera, Inc.
> > > 443.305.9434
> > >
> >
> >
> >
> > --
> > With Regards,
> > Jr.
> >
>

--
With Regards,
Jr.

Re: Reading a Hdfs file using HBase

Joey Echeverria 2011-06-07, 11:49

Unfortunately not. HBase uses a custom file format which is how the data needs to be stored in HDFS in order for HBase to serve it. You'll have to use map reduce to convert your XML into Hfiles and then do the bulk import that Bill suggested.

-Joey

On Jun 7, 2011, at 6:32, James Ram <[EMAIL PROTECTED]> wrote:

> Hi,
>
> Thanks for your help. Is it possible for HBase to read the values directly
> from an XML file in HDFS
>
> On Tue, Jun 7, 2011 at 10:53 AM, Bill Graham <[EMAIL PROTECTED]> wrote:
>
>> You can load the HDFS files into HBase. Check out importtsv to generate
>> HFiles and completebulkload to load them into a table:
>>
>> http://hbase.apache.org/bulk-loads.html
>>
>>
>> On Mon, Jun 6, 2011 at 9:38 PM, James Ram <[EMAIL PROTECTED]> wrote:
>>
>>> Hi,
>>>
>>> I too have the same situation. The data in HDFS should be mapped to
>> columns
>>> in hbase. We will be putting data in bulk to HDFS and we want HBase to
>> read
>>> from HDFS and put the values in the respective columns. Is that possible.
>>> How can I map the data from HDFS to HBase columns. Is there any class
>>> available?
>>>
>>> With Regards,
>>> Jr.
>>>
>>> On Mon, Jun 6, 2011 at 8:52 PM, Joey Echeverria <[EMAIL PROTECTED]>
>> wrote:
>>>
>>>> I'm sorry, but I don't understand your question. Why do you need or
>>>> want an extra layer of indirection (HBase) in order to read your files
>>>> from HDFS?
>>>>
>>>> -Joey
>>>>
>>>> On Mon, Jun 6, 2011 at 6:04 AM, Karthik Kumar <
>> [EMAIL PROTECTED]>
>>>> wrote:
>>>>> Hi,
>>>>>
>>>>> Is it possible to read a file inside HDFS using HBase. If yes please
>>> help
>>>> me
>>>>> with way. What are all the class required to do it? Do i need to use
>>>>> MapReduce?
>>>>>
>>>>> --
>>>>> With Regards,
>>>>> Karthik
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Joseph Echeverria
>>>> Cloudera, Inc.
>>>> 443.305.9434
>>>>
>>>
>>>
>>>
>>> --
>>> With Regards,
>>> Jr.
>>>
>>
>
>
>
> --
> With Regards,
> Jr.

Re: Reading a Hdfs file using HBase

James Ram 2011-06-08, 04:27

Hi,

Thanks a lot.

On Tue, Jun 7, 2011 at 5:19 PM, Joey Echeverria <[EMAIL PROTECTED]> wrote:

> Unfortunately not. HBase uses a custom file format which is how the data
> needs to be stored in HDFS in order for HBase to serve it. You'll have to
> use map reduce to convert your XML into Hfiles and then do the bulk import
> that Bill suggested.
>
> -Joey
>
> On Jun 7, 2011, at 6:32, James Ram <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > Thanks for your help. Is it possible for HBase to read the values
> directly
> > from an XML file in HDFS
> >
> > On Tue, Jun 7, 2011 at 10:53 AM, Bill Graham <[EMAIL PROTECTED]>
> wrote:
> >
> >> You can load the HDFS files into HBase. Check out importtsv to generate
> >> HFiles and completebulkload to load them into a table:
> >>
> >> http://hbase.apache.org/bulk-loads.html
> >>
> >>
> >> On Mon, Jun 6, 2011 at 9:38 PM, James Ram <[EMAIL PROTECTED]> wrote:
> >>
> >>> Hi,
> >>>
> >>> I too have the same situation. The data in HDFS should be mapped to
> >> columns
> >>> in hbase. We will be putting data in bulk to HDFS and we want HBase to
> >> read
> >>> from HDFS and put the values in the respective columns. Is that
> possible.
> >>> How can I map the data from HDFS to HBase columns. Is there any class
> >>> available?
> >>>
> >>> With Regards,
> >>> Jr.
> >>>
> >>> On Mon, Jun 6, 2011 at 8:52 PM, Joey Echeverria <[EMAIL PROTECTED]>
> >> wrote:
> >>>
> >>>> I'm sorry, but I don't understand your question. Why do you need or
> >>>> want an extra layer of indirection (HBase) in order to read your files
> >>>> from HDFS?
> >>>>
> >>>> -Joey
> >>>>
> >>>> On Mon, Jun 6, 2011 at 6:04 AM, Karthik Kumar <
> >> [EMAIL PROTECTED]>
> >>>> wrote:
> >>>>> Hi,
> >>>>>
> >>>>> Is it possible to read a file inside HDFS using HBase. If yes please
> >>> help
> >>>> me
> >>>>> with way. What are all the class required to do it? Do i need to use
> >>>>> MapReduce?
> >>>>>
> >>>>> --
> >>>>> With Regards,
> >>>>> Karthik
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> Joseph Echeverria
> >>>> Cloudera, Inc.
> >>>> 443.305.9434
> >>>>
> >>>
> >>>
> >>>
> >>> --
> >>> With Regards,
> >>> Jr.
> >>>
> >>
> >
> >
> >
> > --
> > With Regards,
> > Jr.
>

--
With Regards,
Jr.