Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # dev - I'm interested in working with HDFS-4680. Can somebody be a mentor?


Copy link to this message
-
Re: I'm interested in working with HDFS-4680. Can somebody be a mentor?
Todd Lipcon 2013-07-18, 00:23
I'm happy to help with this as well. I actually have a prototype patch that
I built during a hackathon a few months ago, and was able to get a full
stack trace including Client, NN, and DN. I'm on vacation this week but
will try to post my prototype upstream when I get back. Feel free to ping
me on this if I slack :)

-Todd

On Wed, Jul 17, 2013 at 4:12 PM, Stack <[EMAIL PROTECTED]> wrote:

> Folks over at HBase would be interested in helping out.
>
> What does a mentor have to do?  I poked around the icfoss link but didn't
> see list of duties (I've been know to be certified blind on occasion).
>
> I am not up on the malleability of hdfs RPC; is it just a matter of adding
> the trace info to a pb header record or would it require more (Sanjay was
> saying something recently off-list that trace id is imminent -- but I've
> not done the digging)?
>
> St.Ack
>
>
> On Wed, Jul 17, 2013 at 1:44 PM, Sreejith Ramakrishnan <
> [EMAIL PROTECTED]> wrote:
>
> > Hey,
> >
> > I was originally researching options to work on ACCUMULO-1197. Basically,
> > it was a bid to pass trace functionality through the DFSClient. I
> discussed
> > with the guys over there on implementing a Google Dapper-style trace with
> > HTrace. The guys at HBase are also trying to achieve the same HTrace
> > integration [HBASE-6449]
> >
> > But, that meant adding stuff to the RPC in HDFS. For a start, we've to
> add
> > a 64-bit span-id to every RPC with tracing enabled. There's some more in
> > the original Dapper paper and HTrace documentation.
> >
> > I was told by the Accumulo people to talk with and seek help from the
> > experts at HDFS. I'm open to suggestions.
> >
> > Additionally, I'm participating in a Joint Mentoring Programme by Apache
> > which is quite similar to GSoC. Luciano Resende (Community Development,
> > Apache) is incharge of the programme. I'll attach a link. The last date
> is
> > 19th July. So, I'm pretty tensed without any mentors :(
> >
> > [1] https://issues.apache.org/jira/browse/ACCUMULO-1197
> > [2] https://issues.apache.org/jira/browse/HDFS-4680
> > [3] https://github.com/cloudera/htrace
> > [4] http://community.apache.org/mentoringprogramme-icfoss-pilot.html
> > [5] https://issues.apache.org/jira/browse/HBASE-6449
> >
> > Thank you,
> > Sreejith R
> >
>

--
Todd Lipcon
Software Engineer, Cloudera