Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Hbase performance with HDFS


+
Mohit Anchlia 2011-07-07, 18:12
+
Andrew Purtell 2011-07-07, 18:22
+
Mohit Anchlia 2011-07-07, 18:53
Copy link to this message
-
Re: Hbase performance with HDFS
Mohit,
just like how SSTables are stored on GFS?
BigTable sstable => HBase HFile.

Does this help?
Himanshu

On Thu, Jul 7, 2011 at 12:53 PM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:

> I have looked at bigtable and it's ssTables etc. But my question is
> directly related to how it's used with HDFS. HDFS recommends large
> files, bigger blocks, write once and read many sequential reads. But
> accessing small rows and writing small rows is more random and
> different than inherent design of HDFS. How do these 2 go together and
> is able to provide performance.
>
> On Thu, Jul 7, 2011 at 11:22 AM, Andrew Purtell <[EMAIL PROTECTED]>
> wrote:
> > Hi Mohit,
> >
> > Start here: http://labs.google.com/papers/bigtable.html
> >
> > Best regards,
> >
> >
> >     - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
> >
> >
> >>________________________________
> >>From: Mohit Anchlia <[EMAIL PROTECTED]>
> >>To: [EMAIL PROTECTED]
> >>Sent: Thursday, July 7, 2011 11:12 AM
> >>Subject: Hbase performance with HDFS
> >>
> >>I've been trying to understand how Hbase can provide good performance
> >>using HDFS when purpose of HDFS is sequential large block sizes which
> >>is inherently different than of Hbase where it's more random and row
> >>sizes might be very small.
> >>
> >>I am reading this but doesn't answer my question. It does say that
> >>HFile block size is different but how it really works with HDFS is
> >>what I am trying to understand.
> >>
> >>http://www.larsgeorge.com/2009/10/hbase-architecture-101-storage.html
> >>
> >>
> >>
>
+
Mohit Anchlia 2011-07-07, 19:05
+
Stack 2011-07-07, 19:09
+
Andrew Purtell 2011-07-07, 19:11
+
Mohit Anchlia 2011-07-07, 19:30
+
Doug Meil 2011-07-07, 19:38
+
Andrew Purtell 2011-07-07, 20:53
+
Mohit Anchlia 2011-07-07, 21:01
+
Buttler, David 2011-07-07, 21:43
+
Mohit Anchlia 2011-07-07, 22:02
+
Andrew Purtell 2011-07-07, 22:12
+
Mohit Anchlia 2011-07-07, 22:17
+
Arvind Jayaprakash 2011-07-11, 13:34
+
Andrew Purtell 2011-07-11, 16:20
+
Ted Dunning 2011-07-11, 16:47
+
Joey Echeverria 2011-07-11, 18:22
+
Ted Dunning 2011-07-11, 18:57
+
Joey Echeverria 2011-07-11, 19:37
+
M. C. Srivas 2011-07-11, 19:48
+
Luke Lu 2011-07-11, 20:33
+
Ted Dunning 2011-07-11, 20:47
+
Stack 2011-07-12, 03:45
+
Ted Dunning 2011-07-12, 04:54
+
Doug Meil 2011-07-07, 19:13
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB