Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Hbase as mongodb


Copy link to this message
-
RE: Hbase as mongodb
Anoop Sam John 2013-01-17, 03:51
Yes Mohammad. Smarter way like this is needed..  I was telling that even if the full JSON is stored as a column value it will be possible to achive what Panshul needs. :) But a full table scan will not be acceptable I guess.

As Ted suggested pls check Panthera also. Panthera seems to use Hive HBase integration in a smart way.

-Anoop-
__________________________________
From: Mohammad Tariq [[EMAIL PROTECTED]]
Sent: Wednesday, January 16, 2013 7:08 PM
To: [EMAIL PROTECTED]
Subject: Re: Hbase as mongodb

@Anoop sir : Does it make sense to extract the timestamp of JSON
object beforehand and use it as the rowkey? After that serialize the
JSON object and store it in the Hbase cell. Gets would a lot faster
then???

Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Wed, Jan 16, 2013 at 7:02 PM, Imran M Yousuf <[EMAIL PROTECTED]> wrote:

> We have used Jackson library for converting Java Object to JSON String
> and eventually to byte[] and vice-versa; but that is not scan/query
> friendly, so we integrated Apache Solr to the stack to get that done.
> http://smart-cms.org
>
> Thank you,
>
> Imran
>
> On Wed, Jan 16, 2013 at 7:27 PM, Anoop Sam John <[EMAIL PROTECTED]>
> wrote:
> >>Such as I can directly say Mongodb to get me
> > all the objects having timestamp value of xxx date where timestamp is a
> > field in Json objects stored in Mongodb
> >
> > It is possible to store any data in HBase which can be converted into
> byte[].  Yes using filters one can perform above kind of query. There is no
> built in filter for above kind of need but custom one can be created.  But
> remember that there is no built in secondary indexing capability in HBase.
>  Here by I can see you have a need for indexing a part of column value.
> [timestamp is a field in Json objects ]
> >
> > -Anoop-
> > ________________________________________
> > From: Panshul Whisper [[EMAIL PROTECTED]]
> > Sent: Wednesday, January 16, 2013 6:36 PM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Hbase as mongodb
> >
> > Hello Tariq,
> >
> > Thank you for the reply.
> >
> > My concern is that I have been working with MongoDB, but now I am
> switching
> > over to Hadoop and I want to use HBase for certain reasons. I was
> wondering
> > if I can store Json files in Hbase in a way that I can query the Json
> files
> > in Hbase as I can in Mongodb. Such as I can directly say Mongodb to get
> me
> > all the objects having timestamp value of xxx date where timestamp is a
> > field in Json objects stored in Mongodb. Can I perform similar operations
> > on Hbase or does it have another approach for doing similar operations.
> > I do not have much knowledge on Hbase yet. I am beginning to learn it,
> but
> > I just want to be sure i am investing my time in the right direction.
> >
> > Thank you so much for the help,
> >
> > Regards,
> > Panshul.
> >
> >
> > On Wed, Jan 16, 2013 at 11:45 AM, Mohammad Tariq <[EMAIL PROTECTED]>
> wrote:
> >
> >> Hello Panshul,
> >>
> >>         Hbase and MongoDB are built to serve different purposes. You
> can't
> >> replace one with the other. They have different strengths and
> weaknesses.
> >> So, if you are using Hbase for something, think well before switching to
> >> MongoDB or vice verca.
> >>
> >> Coming back to the actual question, you can store anything which can be
> >> converted into a sequence of bytes into Hbase and query it. Could you
> >> please elaborate your problem a bit?It will help us to answer your
> question
> >> in a better manner.
> >>
> >> Warm Regards,
> >> Tariq
> >> https://mtariq.jux.com/
> >> cloudfront.blogspot.com
> >>
> >>
> >> On Wed, Jan 16, 2013 at 4:03 PM, Panshul Whisper <[EMAIL PROTECTED]
> >> >wrote:
> >>
> >> > Hello,
> >> >
> >> > Is it possible to use hbase to query json documents in a same way as
> we
> >> can
> >> > do with Mongodb
> >> >
> >> > Suggestions please.
> >> > If we can then a small example as how.. not the query but the process
> >> > flow..
> >> > Thanku so much