Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo, mail # dev - GSOC: Monitor Improvements


Copy link to this message
-
Re: GSOC: Monitor Improvements
Josh Elser 2013-04-21, 17:45
Supun,

Looks good! Can I make some suggestions/comments?

For: "Per table plots: ACCUMULO-594", I'd also like to see minor
compactions, major compactions, index cache hit rate, and data cache hit
rate per table (same graphs that are displayed system-wide when you
visit http://${MONITOR_HOST}:50095/.

For "Per tablet [server] plots", it would be neat if you could also
extract some general statistics like top N least performing, top N
highest performing, etc. tablet servers. Ideally, this could correlate
with servers that may be having problems :).

Do you see these proposed changes as being sufficient for 3-4 months of
40hrs/week work? If you plan to really dig into these changes (perhaps
reworking components of the monitor itself), I could perhaps see this.
Do you have any ideas for more lofty goals that you could pursue as
well? I don't want you/us to get one month into things and see you
complete everything we initially planned to accomplish :)

- Josh

On 04/21/2013 10:37 AM, Supun Kamburugamuva wrote:
> Hi all,
>
> I would like to start writing the proposal for the GSoc. I've put together
> some initial high level goals of the project. Please let me know what I can
> improve.
>
> Per table plots: Accumulo 594
> ---------------------
>
> The goal of this is to display plots that explains the various activtities
> that happens per table. When we go to the tables page of the monitor and go
> to a specific table it displays some information in a table format. We can
> argument this information by showing graphs for
>
> 1. Ingest entries
> 2. Ingest data size
> 3. Scan entries
> 4. Scan data size
>
> Per tablet plots
> ----------------------
>
> Same as in the table plots we can display information regarding tablet
> servers in the tablet server page. The plots will display the same
> information as table plots considering data per tablet server.
>
> Trace Visualization: Accumulo 1198
> ----------------------------
>
> Since we are displaying graphs about each tablet and each table we can add
> major and minor compaction graph to each table and each tablet.
>
> Or other option is to display this in a single graph in overview page with
> different graph lines for different tables and tablets.
>
> Server type information : Accumulo 807
> ---------------------------------
>
> For displaying this informations we can add a new page and display the
> information as a table. The table should specify the network address of the
> server, server type, weather it is active or in-active etc.
>
> Thanks,
> Supun...
>