| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
48 (0.092s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Version control of files present in HDFS - HDFS - [mail # user]
|
|
...How big is that? On Mon, Nov 21, 2011 at 9:26 PM, Stuti Awasthi wrote: ...
|
|
|
Author: Ted Dunning,
2011-11-22, 06:13
|
|
|
Re: Version control of files present in HDFS - HDFS - [mail # user]
|
|
...HDFS is a filesystem that is designed to support map-reduce computation. As such, the semantics differ from what SVN or GIT would want to have. HBase provides versioned values. &...
|
|
|
Author: Ted Dunning,
2011-11-21, 15:27
|
|
|
Re: Sizing help - HDFS - [mail # user]
|
|
...Matt, Thanks for pointing that out. I was talking about machine chassis failure since it is the more serious case, but should have pointed out that losing single disks is subject...
|
|
|
Author: Ted Dunning,
2011-11-11, 17:49
|
|
|
Re: Sizing help - HDFS - [mail # user]
|
|
...For archival purposes, you don't need speed (mostly). That eliminates one argument for 3x replication. If you have RAID-5 or RAID-6 on your storage nodes, then you eliminate most...
|
|
|
Author: Ted Dunning,
2011-11-08, 12:38
|
|
|
Re: dfs.write.packet.size set to 2G - HDFS - [mail # user]
|
|
...By snapshots, I mean that you can freeze a copy of a portion of the the file system for later use as a backup or reference. By mirror, I mean that a snapshot can be transported to anot...
|
|
|
Author: Ted Dunning,
2011-11-08, 09:37
|
|
|
Re: Sizing help - HDFS - [mail # user]
|
|
...3x replication has two effects. One is reliability. This is probably more important in large clusters than small. Another important effect is data locality during map-reduc...
|
|
|
Author: Ted Dunning,
2011-11-08, 00:53
|
|
|
Re: Sizing help - HDFS - [mail # user]
|
|
...Depending on which distribution and what your data center power limits are you may save a lot of money by going with machines that have 12 x 2 or 3 tb drives. With suitable engineering...
|
|
|
Author: Ted Dunning,
2011-11-07, 22:06
|
|
|
Re: A question about RPC - HDFS - [mail # user]
|
|
...IDL's are nice, but old school systems like CORBA are death when you need to change things. Avro, protobufs and thrift are all miles better. On Wed, Sep 21, 2011 at 1:59 PM, Koer...
|
|
|
Author: Ted Dunning,
2011-09-21, 21:46
|
|
|
Re: Regarding design of HDFS - HDFS - [mail # user]
|
|
...2011/9/13 kang hua I said this because meta-data is updated often. Caching in the presence of high updates requires some sort of coherency model. For meta-data, it i...
|
|
|
Author: Ted Dunning,
2011-09-13, 11:20
|
|
|
Re: Regarding design of HDFS - HDFS - [mail # user]
|
|
...The namenode is already a serious bottleneck for meta-data updates. If you allow some of the block map or meta-data to page out to disk, then the bottleneck is going to get much worse....
|
|
|
Author: Ted Dunning,
2011-09-05, 17:53
|
|
|
|
