Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo, mail # dev - GSOC Idea - Accumulo Control Panel


Copy link to this message
-
Re: GSOC Idea - Accumulo Control Panel
Andres Danter 2013-04-13, 16:15
Awesome suggestions!  Thank you, Josh.
 On Apr 12, 2013 10:01 PM, "Josh Elser" <[EMAIL PROTECTED]> wrote:

> Andres,
>
> Looks good. Glad to see a lot of good ideas here already. I have a couple
> of refinements if you don't mind.
>
> 3. Have the ability to schedule /graceful/ restart of Accumulo...
>
> It would be really cool to have the option of bringing down an entire
> cluster or do a rolling-restart (iteratively bring down a node, let things
> quiesce, then restart that node) to try to ensure 100% availability.
> Accumulo handles most of this for you -- it's more a matter of waiting for
> any unhosted tablets to be re-assigned after a tabletserver is stopped.
>
> 4. Push Accumulo code ...
>
> With 1.5 releases, there's a VFS classloader built in which allows for
> various types of file systems to be used to load files onto the classpath.
> The most interesting of which probably include HDFS, HTTP(S), and (S)FTP.
> It would be neat to support not only loading classes from the local
> filesystem but also by a variety of other means.
>
> 6. Gather system and/or application metrics..
>
> Just be aware that this is a very open-ended subject and, most likely,
> could be a full GSOC task on its own. You probably want to think about what
> might be best for Accumulo (starting with what the monitor and master
> already supply) and how best you can integrate with Ambari.
>
> Again, overall, sounds awesome. I look forward to working with you.
>
>
> On 04/12/2013 05:58 PM, Andres Danter wrote:
>
>> Thanks, Billie.  I'm liking this task more and more.  I would love to take
>> this on for GSoC.  Please run it by the Ambari PMC.  I will start drafting
>> the proposal this weekend.
>>
>> Just to be clear, the goal would be to integrate Ambari with Accumulo in
>> order to achieve the following capabilities (I've expanded David's
>> original
>> list of features):
>>
>> 1. Control (start/stop) Accumulo processes on any cluster node
>> 2. Have the ability to edit Accumulo configuration files via a web-based
>> editor (I don't think Ambari provides this.  Please let me know if I'm
>> wrong)
>> 3. Have the ability to schedule restart of Accumulo processes after a
>> configuration change
>> 4. Push Accumulo code and configuration files to a new cluster node
>> 5.  Gracefully remove a node from a cluster
>> 6.  Gather system and/or application metrics that can be used to monitor
>> the system and perhaps create reports on usability
>> 7.  Be able to monitor and control the Accumulo cluster from a web-based
>> GUI  (this kind of goes with #2 above)
>> 8.  Allow read-only monitor sessions, as well as full-admin sessions and
>> have the ability to strictly manage who can access either.  (this I got
>> from ACCUMULO-196)
>> 9.  Provide the ability to authenticate user sessions with SSL
>> (see ACCUMULO-196)
>>
>> It seems like the product of this work would largely replace the current
>> Accumulo Monitor.  If that is the case, are there features of the monitor
>> which you would like to see integrated?
>>
>> I will have about 3 months to complete this work (actually about 220-240
>> hours), so that list is doable.  Most of the work will involve the GUI
>> portions, unless Ambari already comes with much of the functionality.  If
>> the list is too short, please let me know.
>>
>> I guess I should sign up to the Ambari mailing list as well, right?
>>
>> Thanks again and I look forward to being your mentee and to working with
>> the Accumulo community.
>>
>> Andres
>>
>>
>> On Fri, Apr 12, 2013 at 3:43 PM, David Medinets <[EMAIL PROTECTED]
>> >**wrote:
>>
>>  The project is open source ... we can't stop you!
>>>
>>>
>>> On Fri, Apr 12, 2013 at 2:25 PM, Andres Danter <[EMAIL PROTECTED]>
>>> wrote:
>>>
>>>  Could the work of integrating Accumulo with Ambari be something that you
>>>> would allow a student to tackle for GSoC?  I don't want to step on
>>>>
>>> anyone's
>>>
>>>> planned work, but such a task really interests me.  I want to tackle