Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Storing images in Hbase


Copy link to this message
-
Re: Storing images in Hbase
It would be nice a blog post around this.

El 11/01/2013 0:51, lars hofhansl escribi�:
> Interesting. That's close to a PB if my math is correct.
> Is there a write up about this somewhere? Something that we could link from the HBase homepage?
>
> -- Lars
>
>
> ----- Original Message -----
> From: Jack Levin <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Cc: Andrew Purtell <[EMAIL PROTECTED]>
> Sent: Thursday, January 10, 2013 9:24 AM
> Subject: Re: Storing images in Hbase
>
> We stored about 1 billion images into hbase with file size up to 10MB.
> Its been running for close to 2 years without issues and serves
> delivery of images for Yfrog and ImageShack.  If you have any
> questions about the setup, I would be glad to answer them.
>
> -Jack
>
> On Sun, Jan 6, 2013 at 1:09 PM, Mohit Anchlia <[EMAIL PROTECTED]> wrote:
>> I have done extensive testing and have found that blobs don't belong in the
>> databases but are rather best left out on the file system. Andrew outlined
>> issues that you'll face and not to mention IO issues when compaction occurs
>> over large files.
>>
>> On Sun, Jan 6, 2013 at 12:52 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:
>>
>>> I meant this to say "a few really large values"
>>>
>>> On Sun, Jan 6, 2013 at 12:49 PM, Andrew Purtell <[EMAIL PROTECTED]>
>>> wrote:
>>>
>>>> Consider if the split threshold is 2 GB but your one row contains 10 GB
>>> as
>>>> really large value.
>>>
>>>
>>>
>>>    --
>>> Best regards,
>>>
>>>      - Andy
>>>
>>> Problems worthy of attack prove their worth by hitting back. - Piet Hein
>>> (via Tom White)
>>>
>
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>
> http://www.uci.cu
> http://www.facebook.com/universidad.uci
> http://www.flickr.com/photos/universidad_uci
10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION

http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB