Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Hbase as mongodb


Copy link to this message
-
RE: Hbase as mongodb
Panshul Whisper 2013-01-17, 14:51
Thank you for the suggestions, but timestamp is not a unique value in my
case so using it as key is not suggested. The data is too large, so full
table scan is also not good.
Will look into Panthera.

Regards,
Ouch Whisper
01010101010
On Jan 17, 2013 4:52 AM, "Anoop Sam John" <[EMAIL PROTECTED]> wrote:

> Yes Mohammad. Smarter way like this is needed..  I was telling that even
> if the full JSON is stored as a column value it will be possible to achive
> what Panshul needs. :) But a full table scan will not be acceptable I guess.
>
> As Ted suggested pls check Panthera also. Panthera seems to use Hive HBase
> integration in a smart way.
>
> -Anoop-
> __________________________________
> From: Mohammad Tariq [[EMAIL PROTECTED]]
> Sent: Wednesday, January 16, 2013 7:08 PM
> To: [EMAIL PROTECTED]
> Subject: Re: Hbase as mongodb
>
> @Anoop sir : Does it make sense to extract the timestamp of JSON
> object beforehand and use it as the rowkey? After that serialize the
> JSON object and store it in the Hbase cell. Gets would a lot faster
> then???
>
> Warm Regards,
> Tariq
> https://mtariq.jux.com/
> cloudfront.blogspot.com
>
>
> On Wed, Jan 16, 2013 at 7:02 PM, Imran M Yousuf <[EMAIL PROTECTED]>
> wrote:
>
> > We have used Jackson library for converting Java Object to JSON String
> > and eventually to byte[] and vice-versa; but that is not scan/query
> > friendly, so we integrated Apache Solr to the stack to get that done.
> > http://smart-cms.org
> >
> > Thank you,
> >
> > Imran
> >
> > On Wed, Jan 16, 2013 at 7:27 PM, Anoop Sam John <[EMAIL PROTECTED]>
> > wrote:
> > >>Such as I can directly say Mongodb to get me
> > > all the objects having timestamp value of xxx date where timestamp is a
> > > field in Json objects stored in Mongodb
> > >
> > > It is possible to store any data in HBase which can be converted into
> > byte[].  Yes using filters one can perform above kind of query. There is
> no
> > built in filter for above kind of need but custom one can be created.
>  But
> > remember that there is no built in secondary indexing capability in
> HBase.
> >  Here by I can see you have a need for indexing a part of column value.
> > [timestamp is a field in Json objects ]
> > >
> > > -Anoop-
> > > ________________________________________
> > > From: Panshul Whisper [[EMAIL PROTECTED]]
> > > Sent: Wednesday, January 16, 2013 6:36 PM
> > > To: [EMAIL PROTECTED]
> > > Subject: Re: Hbase as mongodb
> > >
> > > Hello Tariq,
> > >
> > > Thank you for the reply.
> > >
> > > My concern is that I have been working with MongoDB, but now I am
> > switching
> > > over to Hadoop and I want to use HBase for certain reasons. I was
> > wondering
> > > if I can store Json files in Hbase in a way that I can query the Json
> > files
> > > in Hbase as I can in Mongodb. Such as I can directly say Mongodb to get
> > me
> > > all the objects having timestamp value of xxx date where timestamp is a
> > > field in Json objects stored in Mongodb. Can I perform similar
> operations
> > > on Hbase or does it have another approach for doing similar operations.
> > > I do not have much knowledge on Hbase yet. I am beginning to learn it,
> > but
> > > I just want to be sure i am investing my time in the right direction.
> > >
> > > Thank you so much for the help,
> > >
> > > Regards,
> > > Panshul.
> > >
> > >
> > > On Wed, Jan 16, 2013 at 11:45 AM, Mohammad Tariq <[EMAIL PROTECTED]>
> > wrote:
> > >
> > >> Hello Panshul,
> > >>
> > >>         Hbase and MongoDB are built to serve different purposes. You
> > can't
> > >> replace one with the other. They have different strengths and
> > weaknesses.
> > >> So, if you are using Hbase for something, think well before switching
> to
> > >> MongoDB or vice verca.
> > >>
> > >> Coming back to the actual question, you can store anything which can
> be
> > >> converted into a sequence of bytes into Hbase and query it. Could you
> > >> please elaborate your problem a bit?It will help us to answer your
> > question