Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - hdfs-1623 Was: ceph and hbase.


Copy link to this message
-
Re: hdfs-1623 Was: ceph and hbase.
Andrey Stepachev 2011-12-25, 06:28
Thanks!

25 декабря 2011 г. 3:13 п��льзователь Ted Yu <[EMAIL PROTECTED]> написал:

> Andrey:
> A quick search led me to https://github.com/toddlipcon where you would be
> able to find:
> https://github.com/toddlipcon/hadoop-common
>
> Cheers
>
> On Sat, Dec 24, 2011 at 12:39 PM, Andrey Stepachev <[EMAIL PROTECTED]>
> wrote:
>
> > 23 декабря 2011 г. 22:48 пользователь Todd Lipcon <[EMAIL PROTECTED]
> > >написал:
> >
> > > On Tue, Dec 20, 2011 at 12:56 AM, Andrey Stepachev <[EMAIL PROTECTED]>
> > > wrote:
> > > > I see, that most issues addressed to HA branch.
> > > > What version this branch is applied to? 0.22 or
> > > > i should build hadoop from sources?
> > >
> > > It's currently only available in the HDFS-1623 branch, which is in
> > > active development and definitely shouldn't be used unless you plan to
> > > help us finish debugging it :) There are still some known bugs and
> > > deficiencies to address before we merge.
> > >
> >
> > Looks like this is one of possible scenarios :). We need
> > some solution for HA, but no one (except MapR) still exists.
> > So we must use MapR (costs, closed) or debug some
> > not-ready-yet solution.
> >
> >
> > >
> > > The plan is to merge it into 0.23 but not 0.22 - it will hopefully be
> > > merged in January. We'll also make it available in CDH4 beta releases
> > > early next year.
> > >
> >
> > Sounds good. But still can't find such branch in cloudera (or any other)
> > github
> > repositories.
> > Is it publicly available right now, or it in some private repository?
> >
> >
> > >
> > > -Todd
> > >
> > > >
> > > > 20 декабря 2011 г. 11:46 пользователь Todd Lipcon <[EMAIL PROTECTED]
> > > >написал:
> > > >
> > > >> Hi Andrey,
> > > >>
> > > >> I don't think anyone has ever run Ceph in a production use case,
> much
> > > >> less run it in a production use case with HBase.
> > > >>
> > > >> The SPOF problem is currently being addressed and will be available
> > > >> for production use by the middle of next calendar year. It will be
> > > >> available for preview/beta usage in Q1 (it's already working in
> > > >> development setups - feel free to follow HDFS-1623 for details)
> > > >>
> > > >> I think you're way better off waiting for the HA NameNode support in
> > > >> HDFS than going with an unproven FS like Ceph. Ceph certainly has
> > > >> promise and is a nice design, but it hasn't had the years of
> pounding
> > > >> that HDFS has.
> > > >>
> > > >> -Todd
> > > >>
> > > >> On Mon, Dec 19, 2011 at 10:23 PM, Andrey Stepachev <
> [EMAIL PROTECTED]>
> > > >> wrote:
> > > >> > Hi all.
> > > >> >
> > > >> > I have requirements to use hbase in several datacenters.
> > > >> > But HDFS has as SPOF, so we can't use it.
> > > >> > I plan to use ceph as the file system for hbase.
> > > >> >
> > > >> > In general, interested in issues of:
> > > >> > a) use the hadoop + сeph in the production environment
> > > >> > b) using hbase + ceph in the production environment
> > > >> >
> > > >> > In particular:
> > > >> > Ceph Wiki states that the integration of hadoop/ceph has the
> problem
> > > in
> > > >> the
> > > >> > form of modification dates of the files.
> > > >> > Does hbase uses modification times for some critical tasks?
> > > >> >
> > > >> > --
> > > >> > Andrey.
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Todd Lipcon
> > > >> Software Engineer, Cloudera
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > Андрей.
> > >
> > >
> > >
> > > --
> > > Todd Lipcon
> > > Software Engineer, Cloudera
> > >
> >
> >
> >
> > --
> > Андрей.
> >
>

--
Андрей.