Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> hdfs-1623 Was: ceph and hbase.


+
Ted Yu 2011-12-24, 23:13
+
Andrey Stepachev 2011-12-25, 06:28
+
Todd Lipcon 2011-12-27, 01:00
Copy link to this message
-
Re: hdfs-1623 Was: ceph and hbase.
Thanks Todd. I'll check svn.

27 декабря 2011 г. 5:00 п��льзователь Todd Lipcon <[EMAIL PROTECTED]>написал:

> That's my github but I don't regularly push there -- so it's a bit out of
> date. Working from the apache svn is probably the best bet
>
> Todd
>
> On Sunday, December 25, 2011, Andrey Stepachev <[EMAIL PROTECTED]> wrote:
> > Thanks!
> >
> > 25 декабря 2011 г. 3:13 пользователь Ted Yu <[EMAIL PROTECTED]>
> написал:
> >
> >> Andrey:
> >> A quick search led me to https://github.com/toddlipcon where you would
> be
> >> able to find:
> >> https://github.com/toddlipcon/hadoop-common
> >>
> >> Cheers
> >>
> >> On Sat, Dec 24, 2011 at 12:39 PM, Andrey Stepachev <[EMAIL PROTECTED]>
> >> wrote:
> >>
> >> > 23 декабря 2011 г. 22:48 ��ользователь Todd Lipcon <[EMAIL PROTECTED]
> >> > >написал:
> >> >
> >> > > On Tue, Dec 20, 2011 at 12:56 AM, Andrey Stepachev <
> [EMAIL PROTECTED]>
> >> > > wrote:
> >> > > > I see, that most issues addressed to HA branch.
> >> > > > What version this branch is applied to? 0.22 or
> >> > > > i should build hadoop from sources?
> >> > >
> >> > > It's currently only available in the HDFS-1623 branch, which is in
> >> > > active development and definitely shouldn't be used unless you plan
> to
> >> > > help us finish debugging it :) There are still some known bugs and
> >> > > deficiencies to address before we merge.
> >> > >
> >> >
> >> > Looks like this is one of possible scenarios :). We need
> >> > some solution for HA, but no one (except MapR) still exists.
> >> > So we must use MapR (costs, closed) or debug some
> >> > not-ready-yet solution.
> >> >
> >> >
> >> > >
> >> > > The plan is to merge it into 0.23 but not 0.22 - it will hopefully
> be
> >> > > merged in January. We'll also make it available in CDH4 beta
> releases
> >> > > early next year.
> >> > >
> >> >
> >> > Sounds good. But still can't find such branch in cloudera (or any
> other)
> >> > github
> >> > repositories.
> >> > Is it publicly available right now, or it in some private repository?
> >> >
> >> >
> >> > >
> >> > > -Todd
> >> > >
> >> > > >
> >> > > > 20 декабря 2011 г. 11:46 пользователь Todd Lipcon <
> [EMAIL PROTECTED]
> >> > > >написал:
> >> > > >
> >> > > >> Hi Andrey,
> >> > > >>
> >> > > >> I don't think anyone has ever run Ceph in a production use case,
> >> much
> >> > > >> less run it in a production use case with HBase.
> >> > > >>
> >> > > >> The SPOF problem is currently being addressed and will be
> available
> >> > > >> for production use by the middle of next calendar year. It will
> be
> >> > > >> available for preview/beta usage in Q1 (it's already working in
> >> > > >> development setups - feel free to follow HDFS-1623 for details)
> >> > > >>
> >> > > >> I think you're way better off waiting for the HA NameNode support
> in
> >> > > >> HDFS than going with an unproven FS like Ceph. Ceph certainly has
> >> > > >> promise and is a nice design, but it hasn't had the years of
> >> pounding
> >> > > >> that HDFS has.
> >> > > >>
> >> > > >> -Todd
> >> > > >>
> >> > > >> On Mon, Dec 19, 2011 at 10:23 PM, Andrey Stepachev <
> >> [EMAIL PROTECTED]>
> >> > > >> wrote:
> >> > > >> > Hi all.
> >> > > >> >
> >> > > >> > I have requirements to use hbase in several datacenters.
> >> > > >> > But HDFS has as SPOF, so we can't use it.
> >> > > >> > I plan to use ceph as the file system for hbase.
> >> > > >> >
> >> > > >> > In general, interested in issues of:
> >> > > >> > a) use the hadoop + сeph in the production environment
> >> > > >> > b) using hbase + ceph in the production environment
> >> > > >> >
> >> > > >> > In particular:
> >> > > >> > Ceph Wiki states that the integration of hadoop/ceph has the
> >> problem
> >> > > in
> >> > > >> the
> >> > > >> > form of modification dates of the files.
> >> > > >> > Does hbase uses modification times f--
> > Андрей.
> >
>
> --
> Todd Lipcon
> Software Engineer, Cloudera
>

--
Андрей.