Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - How many column families in one table ?


+
Vimal Jain 2013-06-28, 05:20
+
Michel Segel 2013-06-28, 05:37
+
Ted Yu 2013-06-28, 12:27
+
Vimal Jain 2013-06-28, 12:40
+
Otis Gospodnetic 2013-06-28, 18:36
+
Vimal Jain 2013-07-01, 08:44
+
Viral Bajaria 2013-07-01, 08:54
+
Vimal Jain 2013-07-01, 09:11
+
Vimal Jain 2013-07-01, 11:11
+
lars hofhansl 2013-07-01, 11:18
+
Vimal Jain 2013-07-01, 11:27
Copy link to this message
-
Re: How many column families in one table ?
Ted Yu 2013-07-01, 11:39
bq. I have configured Hbase in pseudo distributed mode on top of HDFS.

What was the reason for using pseudo distributed mode in production setup ?

Cheers

On Mon, Jul 1, 2013 at 1:44 AM, Vimal Jain <[EMAIL PROTECTED]> wrote:

> Thanks Dhaval/Michael/Ted/Otis for your replies.
> Actually , i asked this question because i am seeing some performance
> degradation in my production Hbase setup.
> I have configured Hbase in pseudo distributed mode on top of HDFS.
> I have created 17 Column families :( . I am actually using 14 out of these
> 17 column families.
> Each column family has around on average 8-10 column qualifiers so total
> around 140 columns are there for each row key.
> I have around 1.6 millions rows in the table.
> To completely scan the table for all 140 columns  , it takes around 30-40
> minutes.
> Is it normal or Should i redesign my table schema ( probably merging 4-5
> column families into one , so that at the end i have just 3-4 cf ) ?
>
>
>
> On Sat, Jun 29, 2013 at 12:06 AM, Otis Gospodnetic <
> [EMAIL PROTECTED]> wrote:
>
> > Hm, works for me -
> >
> >
> http://search-hadoop.com/m/qOx8l15Z1q42/column+families+fb&subj=Re+HBase+Column+Family+Limit+Reasoning
> >
> > Shorter version: http://search-hadoop.com/m/qOx8l15Z1q42
> >
> > Otis
> > --
> > Solr & ElasticSearch Support -- http://sematext.com/
> > Performance Monitoring -- http://sematext.com/spm
> >
> >
> >
> > On Fri, Jun 28, 2013 at 8:40 AM, Vimal Jain <[EMAIL PROTECTED]> wrote:
> > > Hi All ,
> > > Thanks for your replies.
> > >
> > > Ted,
> > > Thanks for the link, but its not working . :(
> > >
> > >
> > > On Fri, Jun 28, 2013 at 5:57 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> > >
> > >> Vimal:
> > >> Please also refer to:
> > >>
> > >>
> >
> http://search-hadoop.com/m/qOx8l15Z1q42/column+families+fb&subj=Re+HBase+Column+Family+Limit+Reasoning
> > >>
> > >> On Fri, Jun 28, 2013 at 1:37 PM, Michel Segel <
> > [EMAIL PROTECTED]
> > >> >wrote:
> > >>
> > >> > Short answer... As few as possible.
> > >> >
> > >> > 14 CF doesn't make too much sense.
> > >> >
> > >> > Sent from a remote device. Please excuse any typos...
> > >> >
> > >> > Mike Segel
> > >> >
> > >> > On Jun 28, 2013, at 12:20 AM, Vimal Jain <[EMAIL PROTECTED]> wrote:
> > >> >
> > >> > > Hi,
> > >> > > How many column families should be there in an hbase table ? Is
> > there
> > >> any
> > >> > > performance issue in read/write if we have more column families ?
> > >> > > I have designed one table with around 14 column families in it
> with
> > >> each
> > >> > > having on average 6 qualifiers.
> > >> > > Is it a good design ?
> > >> > >
> > >> > > --
> > >> > > Thanks and Regards,
> > >> > > Vimal Jain
> > >> >
> > >>
> > >
> > >
> > >
> > > --
> > > Thanks and Regards,
> > > Vimal Jain
> >
>
>
>
> --
> Thanks and Regards,
> Vimal Jain
>
+
Vimal Jain 2013-07-01, 11:44
+
lars hofhansl 2013-07-01, 15:38
+
Vimal Jain 2013-07-01, 17:03
+
Vimal Jain 2013-07-01, 17:06
+
Viral Bajaria 2013-07-01, 19:18
+
Vimal Jain 2013-08-04, 06:28
+
Kevin Odell 2013-08-04, 14:44
+
Inder Pall 2013-08-04, 14:55
+
Kevin Odell 2013-08-04, 15:04
+
Inder Pall 2013-08-04, 15:05
+
lars hofhansl 2013-08-04, 16:03
+
Rohit Kelkar 2013-08-04, 20:55
+
Pablo Medina 2013-08-05, 14:00
+
Kevin Odell 2013-08-05, 14:44
+
Michael Segel 2013-06-28, 12:42