Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Processing data from HDFS


Copy link to this message
-
Re: Processing data from HDFS
Use PIG, a well written example you can find here:
http://blog.whitepages.com/2011/10/27/hbase-storage-and-pig/

Regards

On Jan 24, 2013, at 8:29 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:

> how are the files coming to hdfs?
>
> there is a direct hbase sink available for wrting data into hbase
>
> also from hdfs to hbase, you will need to write your own mapreduce job to
> put data in hbase
>
>
> On Thu, Jan 24, 2013 at 12:50 PM, Abhijeet Pathak <
> [EMAIL PROTECTED]> wrote:
>
>> Hi,
>>
>> I've a folder in HDFS where a bunch of files gets created periodically.
>> I know that currently Flume does not support reading from HDFS folder.
>>
>> What is the best way to transfer this data from HDFS to Hbase (with or
>> without using Flume)?
>>
>>
>> Regards,
>> Abhijeet Pathak
>>
>>
>>
>
>
> --
> Nitin Pawar

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB