Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo, mail # dev - GSoC proposal: Ambari for Accumulo - forever : )


Copy link to this message
-
RE: GSoC proposal: Ambari for Accumulo - forever : )
Drew Pierce 2013-04-26, 15:01
Not sure if these are solo initiatives or those needing assistance. Let me know if it is the latter :)
> Date: Fri, 26 Apr 2013 10:47:21 -0400
> Subject: Re: GSoC proposal: Ambari for Accumulo - forever : )
> From: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
>
> Thanks, Drew, for the enthusiam.
>
> And thanks, John, for the good information.  It is definitely an area I
> need to look into.
>  On Apr 26, 2013 10:31 AM, "John Vines" <[EMAIL PROTECTED]> wrote:
>
> > The init.d scripts we provide are well tested, provided you have accumulo
> > installed into /usr/lib. There is probably room for improvement to utilize
> > /etc/defaults/accumulo to make it configurable. This makes them not
> > configurable with the existing RPM packaging internal to Accumulo. And
> > Ambari uses the init.d scripts to start/stop things.
> >
> > As mentioned in the other thread, I'm pretty sure Ambari is pretty tightly
> > integrated with Bigtop. There is an Accumulo ticket for bigtop support (
> > Accumulo-138 ). I went ahead and threw a patch on there in which the RPM
> > generated has been tested (the deb is lacking though). Furthermore, they do
> > not use the given Accumulo init.d scripts, so there may be room for
> > improvement in there somewhere, but I'm not sure.
> >
> > Should you need to work down that path more, I can definitely provide more
> > guidance.
> >
> >
> > On Thu, Apr 25, 2013 at 12:18 PM, Keith Turner <[EMAIL PROTECTED]> wrote:
> >
> > > On Thu, Apr 25, 2013 at 11:40 AM, Andres Danter <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > Excellent feedback, Keith. Thanks.
> > > >
> > > > I should have mentioned the REST API in the proposal.  I'm not sure if
> > I
> > > > can use it for the CLI.  I will certainly try, since I would like to
> > > adhere
> > > > to the Ambari architecture as much as possible.
> > > >
> > > > As for your other points:
> > > >
> > > > *3.1.1 loggers do not exists in 1.5 ... so would only need to consider
> > > them
> > > > if working w/ 1.4 .  I suppose you would want to work Accumulo 1.4,
> > since
> > > > that the current stable release.*
> > > >
> > > > Yes. I was going to work with Accumulo 1.4, but it is good to know that
> > > the
> > > > loggers are not supported in 1.5.
> > > >
> > > > *3.1.3
> > > >   Accumulo supports reading system config from xml local file and then
> > > > zookeeper (whats set in zookeeper takes precedence).  The nice thing
> > > about
> > > > setting something a config zookeeper, is that process restart is not
> > > > required.*
> > > >
> > > > Good to know this too.  Does this only affect Zookeeper?  I should
> > > > distinguish between processes that may need restarts to load a
> > > > configuration vs those that do not.  Is the Zookeeper process the only
> > > one
> > > > like that?
> > > >
> > > >
> > > Not sure about zookeeper, I think it requires a restart.  Accumulo can
> > > optionally store a lot of its configuration in zookeeper.  When Accumulo
> > > configuration stored in zookeeper is changed, Accumulo processes may pick
> > > up these config changes immediately w/o restart.   Some properties do
> > > require a restart when changed in zookeeper.  This is documented in
> > > Accumulo config documentation.
> > >
> > >
> > > >
> > > > *For section 3.2, are you proposing adding features to the existing
> > > Ambari
> > > > GUI?  If so, are the Accumulo specific?*
> > > >
> > > > I am proposing to add features to the existing Ambari GUI.  The idea
> > here
> > > > is that something like user access controls can be generalized so that
> > > any
> > > > Hadoop component being managed by Ambari is able to utilize them.  I'm
> > > > hoping that the Ambari PMC is OK with me doing this.  I do not want to
> > > > introduce any Accumulo-specific features that would make no sense for
> > > other
> > > > components.
> > > > *
> > > > It seems that Ambari relies on RPMs.  Its possible you may have to
> > spend
> > > > time creating Accumulo RPMs that are useful for Ambari. You may want to