| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
24 (0.102s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Finding mean and median python streaming - HDFS - [mail # user]
|
|
...How many Reducer did you start for this job? If you start many Reducers for this job, it will produce multiple output file which named as part-*****. And each part is only the local mean and...
|
|
|
Author: Yanbo Liang,
2013-04-02, 09:14
|
|
|
Re: are we able to decommission multi nodes at one time? - HDFS - [mail # user]
|
|
...It's reasonable to decommission 7 nodes at the same time. But may be it also takes long time to finish it. Because all the replicas in these 7 nodes need to be copied to remaining 8 nodes. T...
|
|
|
Author: Yanbo Liang,
2013-04-02, 07:36
|
|
|
Re: are we able to decommission multi nodes at one time? - HDFS - [mail # user]
|
|
...You want to decommission how many nodes? 2013/4/2 Henry JunYoung KIM ...
|
|
|
Author: Yanbo Liang,
2013-04-02, 03:01
|
|
|
Re: DFSOutputStream.sync() method latency time - HDFS - [mail # user]
|
|
..."The write method write data to memory of client, the sync method send package to pipeline" I thin you made a mistake for understanding the write procedure of HDFS. It's right that the...
|
|
|
Author: Yanbo Liang,
2013-03-29, 03:29
|
|
|
Re: Inspect a context object and see whats in it - HDFS - [mail # user]
|
|
...You can try to add some probes to source code and recompile it. If you want to know the keys and values you add at each step, you can add print code to map() function of class Mapper and red...
|
|
|
Author: Yanbo Liang,
2013-03-28, 15:57
|
|
|
Re: DFSOutputStream.sync() method latency time - HDFS - [mail # user]
|
|
...1st when client wants to write data to HDFS, it should be create DFSOutputStream. Then the client write data to this output stream and this stream will transfer data to all DataNodes with th...
|
|
|
Author: Yanbo Liang,
2013-03-28, 15:40
|
|
|
Re: using test.org.apache.hadoop.fs.s3native.InMemoryNativeFileSystemStore class in hadoop - HDFS - [mail # user]
|
|
...It just unit test, so you don't need to set any parameters in configuration files. 2013/3/18 Agarwal, Nikhil ...
|
|
|
Author: Yanbo Liang,
2013-03-19, 05:17
|
|
|
Re: using test.org.apache.hadoop.fs.s3native.InMemoryNativeFileSystemStore class in hadoop - HDFS - [mail # user]
|
|
...These test classes are used for unit testing. You can run these cases to test particular function of a class. But when we run these test case, we need some additional classes and functions t...
|
|
|
Author: Yanbo Liang,
2013-03-18, 11:06
|
|
|
Re: Why hadoop is spawing two map over file size 1.5 KB ? - HDFS - [mail # user]
|
|
...I guess may be one of them is the speculative execution. You can check the parameter "mapred.map.tasks.speculative.execution" to ensure whether it is allowed speculative execution. You can g...
|
|
|
Author: Yanbo Liang,
2013-03-14, 15:11
|
|
|
Re: HDFS Cluster Summary DataNode usages - HDFS - [mail # user]
|
|
...It means : the minimum number of used storage capacity / total storage capacity of a datanode; the median number of used storage capacity / total storage capacity of a datanode; the maxmum n...
|
|
|
Author: Yanbo Liang,
2013-03-14, 15:01
|
|
|
|
