| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
263 (0.288s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Storing images in Hbase - HBase - [mail # user]
|
|
...I've never tried it, HBASE worked out nicely for this task, caching and all is a bonus for files. -jack On Mon, Jan 28, 2013 at 2:01 AM, Adrien Mogenet wrote:...
|
|
|
Author: Jack Levin,
2013-01-28, 18:08
|
|
|
Re: Storing images in Hbase - HBase - [mail # user]
|
|
...One thing to note about our setup, is that images that come from end-users (uploads) are first inserted into a queuing system from which they are pulled by an asynchronous job and inserted i...
|
|
|
Author: Jack Levin,
2013-01-28, 04:16
|
|
|
Re: Storing images in Hbase - HBase - [mail # user]
|
|
...We store image/media data into second hbase cluster, but I don't see a reason why it would not work with the same cluster as a separate family for example. -Jack On Sun, Jan 27, ...
|
|
|
Author: Jack Levin,
2013-01-28, 04:06
|
|
|
Re: Storing images in Hbase - HBase - [mail # user]
|
|
...We did some experiments, open source project HOOP works well with interfacing to HDFS to expose REST Api interface to your file system. -Jack On Sun, Jan 27, 2013 at 7:37 AM, yiy...
|
|
|
Author: Jack Levin,
2013-01-27, 16:56
|
|
|
Re: Storing images in Hbase - HBase - [mail # user]
|
|
...AFAIK, namenode would not like tracking 20 billion small files :) -jack On Sat, Jan 26, 2013 at 6:00 PM, S Ahmed wrote:...
|
|
|
Author: Jack Levin,
2013-01-27, 02:56
|
|
|
Re: 答复: GC pause issues - HBase - [mail # user]
|
|
...How much memory are you flushing? Can you paste the log here? The large the chunk of the flush the longer your GC is going to be. -Jack On Fri, Jan 25, 2013 at ...
|
|
|
Author: Jack Levin,
2013-01-26, 06:54
|
|
|
Re: 答复: GC pause issues - HBase - [mail # user]
|
|
...Generally, the larger the flush to harder the GC will work. Flush more often to avoid this. What is your total heap size set at? On Jan 24, 2013 9:02 PM, "Varun Sharma" wrote: ...
|
|
|
Author: Jack Levin,
2013-01-25, 07:46
|
|
|
Re: Storing images in Hbase - HBase - [mail # user]
|
|
...Two people including myself, its fairly hands off. Took about 3 months to tune it right, however we did have had multiple years of experience with datanodes and hadoop in general, so that wa...
|
|
|
Author: Jack Levin,
2013-01-25, 07:41
|
|
|
Re: Storing images in Hbase - HBase - [mail # user]
|
|
...Its best to keep some RAM for caching of the filesystem, besides we also run datanode which takes heap as well. Now, please keep in mind that even if you specify heap of say 5GB, if your ser...
|
|
|
Author: Jack Levin,
2013-01-24, 04:53
|
|
|
Re: Storing images in Hbase - HBase - [mail # user]
|
|
...I forgot to mention that I also have this setup: hbase.hregion.memstore.flush.size 33554432 Flush more often. Default: 67108864 This parameter works on per...
|
|
|
Author: Jack Levin,
2013-01-20, 19:49
|
|
|
|
