|
S Ahmed
2012-05-17, 13:39
Ian Varley
2012-05-17, 13:44
S Ahmed
2012-05-17, 23:45
Andrew Purtell
2012-05-17, 23:52
S Ahmed
2012-12-02, 02:07
Jonathan Hsieh
2012-12-02, 02:10
S Ahmed
2012-12-02, 02:36
Jonathan Hsieh
2012-12-02, 03:27
S Ahmed
2012-12-02, 03:56
|
-
understanding the code base, patterns, threading, etc.S Ahmed 2012-05-17, 13:39
Greetings,
Other than reading the the source code, google papers, seda, etc. how does someone get solid understanding of the code base? Are there any high-level (or low level!) diagrams of sort that go over the various components of hbase? (various read/write stages, gossip, etc.) I'm guessing this is wishful thinking but I thought I'd ask :)
-
Re: understanding the code base, patterns, threading, etc.Ian Varley 2012-05-17, 13:44
Well, the first answer is always the same: read the code! :)
Of course, sometimes it's difficult to get the high level concepts quickly that way (even with good docs, like the HBase code generally has). So I'd recommend seeing the upcoming talk by committer Lars Hofhansl at HBaseCon on Tuesday--that's exactly what it's about! It's called "HBase Internals". If you're not attending, I'm sure they'll post slides (and maybe video?) afterwards. Ian On May 17, 2012, at 8:39 AM, S Ahmed wrote: > Greetings, > > Other than reading the the source code, google papers, seda, etc. how does > someone get solid understanding of the code base? > > Are there any high-level (or low level!) diagrams of sort that go over the > various components of hbase? (various read/write stages, gossip, etc.) > > I'm guessing this is wishful thinking but I thought I'd ask :)
-
Re: understanding the code base, patterns, threading, etc.S Ahmed 2012-05-17, 23:45
I was afraid you were going to say that :)
Looking forward to the vidoes! On Thu, May 17, 2012 at 9:44 AM, Ian Varley <[EMAIL PROTECTED]> wrote: > Well, the first answer is always the same: read the code! :) > > Of course, sometimes it's difficult to get the high level concepts quickly > that way (even with good docs, like the HBase code generally has). So I'd > recommend seeing the upcoming talk by committer Lars Hofhansl at HBaseCon > on Tuesday--that's exactly what it's about! It's called "HBase Internals". > > If you're not attending, I'm sure they'll post slides (and maybe video?) > afterwards. > > Ian > > On May 17, 2012, at 8:39 AM, S Ahmed wrote: > > > Greetings, > > > > Other than reading the the source code, google papers, seda, etc. how > does > > someone get solid understanding of the code base? > > > > Are there any high-level (or low level!) diagrams of sort that go over > the > > various components of hbase? (various read/write stages, gossip, etc.) > > > > I'm guessing this is wishful thinking but I thought I'd ask :) > >
-
Re: understanding the code base, patterns, threading, etc.Andrew Purtell 2012-05-17, 23:52
I'd also recommend Lars George's excellent "HBase The Definitive
Guide". It will give you a good conceptual foundation and an understanding of how the API works. Then when you are tracing code paths in the internals that act in service to the API, they will make more sense. On Thu, May 17, 2012 at 4:45 PM, S Ahmed <[EMAIL PROTECTED]> wrote: > I was afraid you were going to say that :) > > Looking forward to the vidoes! > > On Thu, May 17, 2012 at 9:44 AM, Ian Varley <[EMAIL PROTECTED]> wrote: > >> Well, the first answer is always the same: read the code! :) >> >> Of course, sometimes it's difficult to get the high level concepts quickly >> that way (even with good docs, like the HBase code generally has). So I'd >> recommend seeing the upcoming talk by committer Lars Hofhansl at HBaseCon >> on Tuesday--that's exactly what it's about! It's called "HBase Internals". >> >> If you're not attending, I'm sure they'll post slides (and maybe video?) >> afterwards. >> >> Ian >> >> On May 17, 2012, at 8:39 AM, S Ahmed wrote: >> >> > Greetings, >> > >> > Other than reading the the source code, google papers, seda, etc. how >> does >> > someone get solid understanding of the code base? >> > >> > Are there any high-level (or low level!) diagrams of sort that go over >> the >> > various components of hbase? (various read/write stages, gossip, etc.) >> > >> > I'm guessing this is wishful thinking but I thought I'd ask :) >> >> -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
-
Re: understanding the code base, patterns, threading, etc.S Ahmed 2012-12-02, 02:07
It's been a while I know, but is that talk online somewhere?
On Thu, May 17, 2012 at 9:44 AM, Ian Varley <[EMAIL PROTECTED]> wrote: > Lars Hofhansl
-
Re: understanding the code base, patterns, threading, etc.Jonathan Hsieh 2012-12-02, 02:10
Hey S,
Video and ppt on this link. http://www.hbasecon.com/sessions/learning-hbase-internals/ Jon. On Sat, Dec 1, 2012 at 6:07 PM, S Ahmed <[EMAIL PROTECTED]> wrote: > It's been a while I know, but is that talk online somewhere? > > On Thu, May 17, 2012 at 9:44 AM, Ian Varley <[EMAIL PROTECTED]> > wrote: > > > Lars Hofhansl > -- // Jonathan Hsieh (shay) // Software Engineer, Cloudera // [EMAIL PROTECTED]
-
Re: understanding the code base, patterns, threading, etc.S Ahmed 2012-12-02, 02:36
Thanks but the video link goes to a page with no video?
On Sat, Dec 1, 2012 at 9:10 PM, Jonathan Hsieh <[EMAIL PROTECTED]> wrote: > Hey S, > > Video and ppt on this link. > http://www.hbasecon.com/sessions/learning-hbase-internals/ > > Jon. > > On Sat, Dec 1, 2012 at 6:07 PM, S Ahmed <[EMAIL PROTECTED]> wrote: > > > It's been a while I know, but is that talk online somewhere? > > > > On Thu, May 17, 2012 at 9:44 AM, Ian Varley <[EMAIL PROTECTED]> > > wrote: > > > > > Lars Hofhansl > > > > > > -- > // Jonathan Hsieh (shay) > // Software Engineer, Cloudera > // [EMAIL PROTECTED] >
-
Re: understanding the code base, patterns, threading, etc.Jonathan Hsieh 2012-12-02, 03:27
Ooh -- sorry about that -- let me contact the folks to fix that problem.
Jon. On Sat, Dec 1, 2012 at 6:36 PM, S Ahmed <[EMAIL PROTECTED]> wrote: > Thanks but the video link goes to a page with no video? > > > On Sat, Dec 1, 2012 at 9:10 PM, Jonathan Hsieh <[EMAIL PROTECTED]> wrote: > > > Hey S, > > > > Video and ppt on this link. > > http://www.hbasecon.com/sessions/learning-hbase-internals/ > > > > Jon. > > > > On Sat, Dec 1, 2012 at 6:07 PM, S Ahmed <[EMAIL PROTECTED]> wrote: > > > > > It's been a while I know, but is that talk online somewhere? > > > > > > On Thu, May 17, 2012 at 9:44 AM, Ian Varley <[EMAIL PROTECTED]> > > > wrote: > > > > > > > Lars Hofhansl > > > > > > > > > > > -- > > // Jonathan Hsieh (shay) > > // Software Engineer, Cloudera > > // [EMAIL PROTECTED] > > > -- // Jonathan Hsieh (shay) // Software Engineer, Cloudera // [EMAIL PROTECTED]
-
Re: understanding the code base, patterns, threading, etc.S Ahmed 2012-12-02, 03:56
Great, I think out of all of them only like 1 of them works:
http://www.hbasecon.com/tracks/development/ On Sat, Dec 1, 2012 at 10:27 PM, Jonathan Hsieh <[EMAIL PROTECTED]> wrote: > Ooh -- sorry about that -- let me contact the folks to fix that problem. > > Jon. > > On Sat, Dec 1, 2012 at 6:36 PM, S Ahmed <[EMAIL PROTECTED]> wrote: > > > Thanks but the video link goes to a page with no video? > > > > > > On Sat, Dec 1, 2012 at 9:10 PM, Jonathan Hsieh <[EMAIL PROTECTED]> wrote: > > > > > Hey S, > > > > > > Video and ppt on this link. > > > http://www.hbasecon.com/sessions/learning-hbase-internals/ > > > > > > Jon. > > > > > > On Sat, Dec 1, 2012 at 6:07 PM, S Ahmed <[EMAIL PROTECTED]> wrote: > > > > > > > It's been a while I know, but is that talk online somewhere? > > > > > > > > On Thu, May 17, 2012 at 9:44 AM, Ian Varley <[EMAIL PROTECTED]> > > > > wrote: > > > > > > > > > Lars Hofhansl > > > > > > > > > > > > > > > > -- > > > // Jonathan Hsieh (shay) > > > // Software Engineer, Cloudera > > > // [EMAIL PROTECTED] > > > > > > > > > -- > // Jonathan Hsieh (shay) > // Software Engineer, Cloudera > // [EMAIL PROTECTED] > |