Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Hbase Sink


+
Mohit Anchlia 2012-07-12, 18:05
+
Jarek Jarcec Cecho 2012-07-12, 18:10
+
alo alt 2012-07-12, 18:11
+
George Forman 2012-07-17, 14:53
+
Mohammad Tariq 2012-07-17, 15:02
+
prabhu k 2012-07-19, 13:04
+
Mohammad Tariq 2012-07-19, 13:11
+
prabhu k 2012-07-19, 13:20
+
Mohammad Tariq 2012-07-19, 13:35
+
prabhu k 2012-07-19, 14:47
+
Mohammad Tariq 2012-07-19, 19:56
+
prabhu k 2012-09-12, 05:54
+
prabhu k 2012-09-12, 06:06
+
Mohit Anchlia 2012-07-29, 16:15
+
Brock Noland 2012-07-29, 16:32
Copy link to this message
-
Re: HBase sink
On Sun, Jul 29, 2012 at 9:32 AM, Brock Noland <[EMAIL PROTECTED]> wrote:

> Hi,
>
> You might want to write a class which implements HbaseEventSerializer. To
> test, SimpleHbaseEventSerializer might fit your needs. Using timestamps as
> keys will create hotspots. As such it's recommended you "bucket" so that
> each write is hitting say 1 of 32 buckets. Each agent would be configured
> as follows:
>
> ...rowPrefix = bucket
> ...suffix = timestamp
>
Yes my row keys are bucketed and regions would be split per bucket. I just
wanted to see how the row keys are generated. Looks like this needs to be
implemented, which probably makes sense. But it would be good to have some
support for timeseries data as well. Let me see if I can share my
EventSerializer after I get it working :) I'll take a look at
SimpleHbaseEventSerializer

>  Brock
>
> On Sun, Jul 29, 2012 at 11:15 AM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:
>
>> I am looking at example in
>> http://flume.apache.org/FlumeUserGuide.html#hbasesinks but this doesn't
>> show me how to generate row keys. My row keys are timeseries data.
>
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce -
> http://incubator.apache.org/mrunit/
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB