Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
and serve about 200ml images from HBASE.  The stats of our are:

60 Region Servers running HBASE
Configured Capacity : 517.44 TB
DFS Used : 286.93 TB
Table count: 1,000
Average file size: 500KB

I am doing this mostly to bring our dev. and QA teams up to speed, but
we would have open doors as well, and will serve Pizza.  So, if anyone
is interested, RSVP to me. This should happen in next 2-3 weeks.  (We
are in South Bay, Los Gatos CA).

-Jack

If it is possible I think any slides or even a video would be very
interesting to some of us that can't travel. I, for one, would love to hear
how you do it.

Thanks!

On Tue, Jun 7, 2011 at 6:07 PM, Jack Levin <[EMAIL PROTECTED]> wrote:

> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
> and serve about 200ml images from HBASE.  The stats of our are:
>
> 60 Region Servers running HBASE
> Configured Capacity      :       517.44 TB
> DFS Used         :       286.93 TB
> Table count: 1,000
> Average file size: 500KB
>
> I am doing this mostly to bring our dev. and QA teams up to speed, but
> we would have open doors as well, and will serve Pizza.  So, if anyone
> is interested, RSVP to me. This should happen in next 2-3 weeks.  (We
> are in South Bay, Los Gatos CA).
>
> -Jack
>

+1 to Matt's opinion (if possible?).

I am interested in your use case, sounds very impressive by the stats you
gave. You said 1000 tables?
Looking forward to see what optimizations/config tweaks you had to do to
cope up with your read/write requirements.

Thanks,
Himanshu

On Wed, Jun 8, 2011 at 8:57 AM, Matt Davies <[EMAIL PROTECTED]> wrote:

> If it is possible I think any slides or even a video would be very
> interesting to some of us that can't travel. I, for one, would love to hear
> how you do it.
>
> Thanks!
>
> On Tue, Jun 7, 2011 at 6:07 PM, Jack Levin <[EMAIL PROTECTED]> wrote:
>
> > Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
> > and serve about 200ml images from HBASE.  The stats of our are:
> >
> > 60 Region Servers running HBASE
> > Configured Capacity      :       517.44 TB
> > DFS Used         :       286.93 TB
> > Table count: 1,000
> > Average file size: 500KB
> >
> > I am doing this mostly to bring our dev. and QA teams up to speed, but
> > we would have open doors as well, and will serve Pizza.  So, if anyone
> > is interested, RSVP to me. This should happen in next 2-3 weeks.  (We
> > are in South Bay, Los Gatos CA).
> >
> > -Jack
> >
>

Would you like to transform this into a HUG? See
http://www.meetup.com/hbaseusergroup/

J-D

On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <[EMAIL PROTECTED]> wrote:
> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
> and serve about 200ml images from HBASE.  The stats of our are:
>
> 60 Region Servers running HBASE
> Configured Capacity      :       517.44 TB
> DFS Used         :       286.93 TB
> Table count: 1,000
> Average file size: 500KB
>
> I am doing this mostly to bring our dev. and QA teams up to speed, but
> we would have open doors as well, and will serve Pizza.  So, if anyone
> is interested, RSVP to me. This should happen in next 2-3 weeks.  (We
> are in South Bay, Los Gatos CA).
>
> -Jack
>

Would love to see the video and slides form this... sounds super
interesting.

On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans <[EMAIL PROTECTED]>wrote:

> Would you like to transform this into a HUG? See
> http://www.meetup.com/hbaseusergroup/
>
> J-D
>
> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <[EMAIL PROTECTED]> wrote:
> > Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
> > and serve about 200ml images from HBASE.  The stats of our are:
> >
> > 60 Region Servers running HBASE
> > Configured Capacity      :       517.44 TB
> > DFS Used         :       286.93 TB
> > Table count: 1,000
> > Average file size: 500KB
> >
> > I am doing this mostly to bring our dev. and QA teams up to speed, but
> > we would have open doors as well, and will serve Pizza.  So, if anyone
> > is interested, RSVP to me. This should happen in next 2-3 weeks.  (We
> > are in South Bay, Los Gatos CA).
> >
> > -Jack
> >
>

Yep.  I'd do HUG, its probably larger building/room anyway :).

-Jack

On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
<[EMAIL PROTECTED]> wrote:
> Would you like to transform this into a HUG? See
> http://www.meetup.com/hbaseusergroup/
>
> J-D
>
> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <[EMAIL PROTECTED]> wrote:
>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
>> and serve about 200ml images from HBASE.  The stats of our are:
>>
>> 60 Region Servers running HBASE
>> Configured Capacity      :       517.44 TB
>> DFS Used         :       286.93 TB
>> Table count: 1,000
>> Average file size: 500KB
>>
>> I am doing this mostly to bring our dev. and QA teams up to speed, but
>> we would have open doors as well, and will serve Pizza.  So, if anyone
>> is interested, RSVP to me. This should happen in next 2-3 weeks.  (We
>> are in South Bay, Los Gatos CA).
>>
>> -Jack
>>
>

http://www.slideshare.net/jacque74/hug-hbase-presentation

My presentation posted on slideshare, from todays talk. FYI.

Best,

-Jack

On Fri, Jun 10, 2011 at 3:11 PM, Jack Levin <[EMAIL PROTECTED]> wrote:
> Yep.  I'd do HUG, its probably larger building/room anyway :).
>
> -Jack
>
> On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
> <[EMAIL PROTECTED]> wrote:
>> Would you like to transform this into a HUG? See
>> http://www.meetup.com/hbaseusergroup/
>>
>> J-D
>>
>> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <[EMAIL PROTECTED]> wrote:
>>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
>>> and serve about 200ml images from HBASE.  The stats of our are:
>>>
>>> 60 Region Servers running HBASE
>>> Configured Capacity      :       517.44 TB
>>> DFS Used         :       286.93 TB
>>> Table count: 1,000
>>> Average file size: 500KB
>>>
>>> I am doing this mostly to bring our dev. and QA teams up to speed, but
>>> we would have open doors as well, and will serve Pizza.  So, if anyone
>>> is interested, RSVP to me. This should happen in next 2-3 weeks.  (We
>>> are in South Bay, Los Gatos CA).
>>>
>>> -Jack
>>>
>>
>

Thank you, looks very interesting.

Mark

On Thu, Jun 30, 2011 at 11:29 PM, Jack Levin <[EMAIL PROTECTED]> wrote:

> http://www.slideshare.net/jacque74/hug-hbase-presentation
>
> My presentation posted on slideshare, from todays talk. FYI.
>
> Best,
>
> -Jack
>
> On Fri, Jun 10, 2011 at 3:11 PM, Jack Levin <[EMAIL PROTECTED]> wrote:
> > Yep.  I'd do HUG, its probably larger building/room anyway :).
> >
> > -Jack
> >
> > On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
> > <[EMAIL PROTECTED]> wrote:
> >> Would you like to transform this into a HUG? See
> >> http://www.meetup.com/hbaseusergroup/
> >>
> >> J-D
> >>
> >> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <[EMAIL PROTECTED]> wrote:
> >>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
> >>> and serve about 200ml images from HBASE.  The stats of our are:
> >>>
> >>> 60 Region Servers running HBASE
> >>> Configured Capacity      :       517.44 TB
> >>> DFS Used         :       286.93 TB
> >>> Table count: 1,000
> >>> Average file size: 500KB
> >>>
> >>> I am doing this mostly to bring our dev. and QA teams up to speed, but
> >>> we would have open doors as well, and will serve Pizza.  So, if anyone
> >>> is interested, RSVP to me. This should happen in next 2-3 weeks.  (We
> >>> are in South Bay, Los Gatos CA).
> >>>
> >>> -Jack
> >>>
> >>
> >
>

Very interesting use case which is similar to ours. Though we use
HBase for all other purposes, we are looking at alternatives for image
storing. I'm very interested to look at your implementation
(presentation and possibly video).

Ravi

On Thursday, June 30, 2011, Mark Kerzner <[EMAIL PROTECTED]> wrote:
> Thank you, looks very interesting.
>
> Mark
>
> On Thu, Jun 30, 2011 at 11:29 PM, Jack Levin <[EMAIL PROTECTED]> wrote:
>
>> http://www.slideshare.net/jacque74/hug-hbase-presentation
>>
>> My presentation posted on slideshare, from todays talk. FYI.
>>
>> Best,
>>
>> -Jack
>>
>> On Fri, Jun 10, 2011 at 3:11 PM, Jack Levin <[EMAIL PROTECTED]> wrote:
>> > Yep.  I'd do HUG, its probably larger building/room anyway :).
>> >
>> > -Jack
>> >
>> > On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
>> > <[EMAIL PROTECTED]> wrote:
>> >> Would you like to transform this into a HUG? See
>> >> http://www.meetup.com/hbaseusergroup/
>> >>
>> >> J-D
>> >>
>> >> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <[EMAIL PROTECTED]> wrote:
>> >>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we store
>> >>> and serve about 200ml images from HBASE.  The stats of our are:
>> >>>
>> >>> 60 Region Servers running HBASE
>> >>> Configured Capacity      :       517.44 TB
>> >>> DFS Used         :       286.93 TB
>> >>> Table count: 1,000
>> >>> Average file size: 500KB
>> >>>
>> >>> I am doing this mostly to bring our dev. and QA teams up to speed, but
>> >>> we would have open doors as well, and will serve Pizza.  So, if anyone
>> >>> is interested, RSVP to me. This should happen in next 2-3 weeks.  (We
>> >>> are in South Bay, Los Gatos CA).
>> >>>
>> >>> -Jack
>> >>>
>> >>
>> >
>>
>

Hi Jack,

This looks like a great presentation.  Very interesting slides.  Was there
video of the talk that will be posted?

Thanks
Dave Viner
On Thu, Jun 30, 2011 at 9:57 PM, Ravi Veeramachaneni <
[EMAIL PROTECTED]> wrote:

> Very interesting use case which is similar to ours. Though we use
> HBase for all other purposes, we are looking at alternatives for image
> storing. I'm very interested to look at your implementation
> (presentation and possibly video).
>
> Ravi
>
> On Thursday, June 30, 2011, Mark Kerzner <[EMAIL PROTECTED]> wrote:
> > Thank you, looks very interesting.
> >
> > Mark
> >
> > On Thu, Jun 30, 2011 at 11:29 PM, Jack Levin <[EMAIL PROTECTED]> wrote:
> >
> >> http://www.slideshare.net/jacque74/hug-hbase-presentation
> >>
> >> My presentation posted on slideshare, from todays talk. FYI.
> >>
> >> Best,
> >>
> >> -Jack
> >>
> >> On Fri, Jun 10, 2011 at 3:11 PM, Jack Levin <[EMAIL PROTECTED]> wrote:
> >> > Yep.  I'd do HUG, its probably larger building/room anyway :).
> >> >
> >> > -Jack
> >> >
> >> > On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
> >> > <[EMAIL PROTECTED]> wrote:
> >> >> Would you like to transform this into a HUG? See
> >> >> http://www.meetup.com/hbaseusergroup/
> >> >>
> >> >> J-D
> >> >>
> >> >> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <[EMAIL PROTECTED]>
> wrote:
> >> >>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we
> store
> >> >>> and serve about 200ml images from HBASE.  The stats of our are:
> >> >>>
> >> >>> 60 Region Servers running HBASE
> >> >>> Configured Capacity      :       517.44 TB
> >> >>> DFS Used         :       286.93 TB
> >> >>> Table count: 1,000
> >> >>> Average file size: 500KB
> >> >>>
> >> >>> I am doing this mostly to bring our dev. and QA teams up to speed,
> but
> >> >>> we would have open doors as well, and will serve Pizza.  So, if
> anyone
> >> >>> is interested, RSVP to me. This should happen in next 2-3 weeks.
>  (We
> >> >>> are in South Bay, Los Gatos CA).
> >> >>>
> >> >>> -Jack
> >> >>>
> >> >>
> >> >
> >>
> >
>

AFAIK, there was no recording of the talk.

-jack

On Fri, Jul 1, 2011 at 9:06 AM, Dave Viner <[EMAIL PROTECTED]> wrote:
> Hi Jack,
>
> This looks like a great presentation.  Very interesting slides.  Was there
> video of the talk that will be posted?
>
> Thanks
> Dave Viner
>
>
> On Thu, Jun 30, 2011 at 9:57 PM, Ravi Veeramachaneni <
> [EMAIL PROTECTED]> wrote:
>
>> Very interesting use case which is similar to ours. Though we use
>> HBase for all other purposes, we are looking at alternatives for image
>> storing. I'm very interested to look at your implementation
>> (presentation and possibly video).
>>
>> Ravi
>>
>> On Thursday, June 30, 2011, Mark Kerzner <[EMAIL PROTECTED]> wrote:
>> > Thank you, looks very interesting.
>> >
>> > Mark
>> >
>> > On Thu, Jun 30, 2011 at 11:29 PM, Jack Levin <[EMAIL PROTECTED]> wrote:
>> >
>> >> http://www.slideshare.net/jacque74/hug-hbase-presentation
>> >>
>> >> My presentation posted on slideshare, from todays talk. FYI.
>> >>
>> >> Best,
>> >>
>> >> -Jack
>> >>
>> >> On Fri, Jun 10, 2011 at 3:11 PM, Jack Levin <[EMAIL PROTECTED]> wrote:
>> >> > Yep.  I'd do HUG, its probably larger building/room anyway :).
>> >> >
>> >> > -Jack
>> >> >
>> >> > On Fri, Jun 10, 2011 at 11:39 AM, Jean-Daniel Cryans
>> >> > <[EMAIL PROTECTED]> wrote:
>> >> >> Would you like to transform this into a HUG? See
>> >> >> http://www.meetup.com/hbaseusergroup/
>> >> >>
>> >> >> J-D
>> >> >>
>> >> >> On Wed, Jun 8, 2011 at 12:07 AM, Jack Levin <[EMAIL PROTECTED]>
>> wrote:
>> >> >>> Hey Guys, I plan to do a tech talk here at ImageShack, on how we
>> store
>> >> >>> and serve about 200ml images from HBASE.  The stats of our are:
>> >> >>>
>> >> >>> 60 Region Servers running HBASE
>> >> >>> Configured Capacity      :       517.44 TB
>> >> >>> DFS Used         :       286.93 TB
>> >> >>> Table count: 1,000
>> >> >>> Average file size: 500KB
>> >> >>>
>> >> >>> I am doing this mostly to bring our dev. and QA teams up to speed,
>> but
>> >> >>> we would have open doors as well, and will serve Pizza.  So, if
>> anyone
>> >> >>> is interested, RSVP to me. This should happen in next 2-3 weeks.
>>  (We
>> >> >>> are in South Bay, Los Gatos CA).
>> >> >>>
>> >> >>> -Jack
>> >> >>>
>> >> >>
>> >> >
>> >>
>> >
>>
>