Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 18 (0.053s).
Loading phrases to help you
refine your search...
Re: Read hflushed data without reopen file - HDFS - [mail # user]
...Hi Chao, As far as I know, if client B opens the file which is under construction,  the DFSInputStream will get the LocatedBlocks object and it contains a member variable which called "...
   Author: Yanbo Liang, 2013-12-27, 15:54
Re: Finding mean and median python streaming - HDFS - [mail # user]
...How many Reducer did you start for this job? If you start many Reducers for this job, it will produce multiple output file which named as part-*****. And each part is only the local mean and...
   Author: Yanbo Liang, 2013-04-02, 09:14
Re: are we able to decommission multi nodes at one time? - HDFS - [mail # user]
...It's reasonable to decommission 7 nodes at the same time. But may be it also takes long time to finish it. Because all the replicas in these 7 nodes need to be copied to remaining 8 nodes. T...
[+ more]    Author: Yanbo Liang, 2013-04-02, 07:36
Re: DFSOutputStream.sync() method latency time - HDFS - [mail # user]
..."The write method write data to memory of client, the sync method send package to pipeline" I thin you made a mistake for understanding the write procedure of HDFS.  It's right that the...
[+ more]    Author: Yanbo Liang, 2013-03-29, 03:29
Re: Inspect a context object and see whats in it - HDFS - [mail # user]
...You can try to add some probes to source code and recompile it. If you want to know the keys and values you add at each step, you can add print code to map() function of class Mapper and red...
   Author: Yanbo Liang, 2013-03-28, 15:57
Re: using test.org.apache.hadoop.fs.s3native.InMemoryNativeFileSystemStore class in hadoop - HDFS - [mail # user]
...It just unit test, so you don't need to set any parameters in configuration files.   2013/3/18 Agarwal, Nikhil  ...
[+ more]    Author: Yanbo Liang, 2013-03-19, 05:17
Re: Why hadoop is spawing two map over file size 1.5 KB ? - HDFS - [mail # user]
...I guess may be one of them is the speculative execution. You can check the parameter "mapred.map.tasks.speculative.execution" to ensure whether it is allowed speculative execution. You can g...
   Author: Yanbo Liang, 2013-03-14, 15:11
Re: HDFS Cluster Summary DataNode usages - HDFS - [mail # user]
...It means : the minimum number of used storage capacity / total storage capacity of a datanode; the median number of used storage capacity / total storage capacity of a datanode; the maxmum n...
   Author: Yanbo Liang, 2013-03-14, 15:01
IOException in offerService - HDFS - [mail # dev]
...DataNode may received IOException in heartbeat sending process. When running TestStartup, I got the following warn log:  2012-11-13 01:28:19,217 WARN  datanode.DataNode (BPServiceA...
   Author: Yanbo Liang, 2012-11-13, 10:51
Re: The lease hard limit is 1 hour and in another client want to append to a file need to wait for 1 hour? - HDFS - [mail # dev]
...The answer is useful, thanks to all of you.  2012/10/18 Uma Maheswara Rao G  ...
[+ more]    Author: Yanbo Liang, 2012-10-18, 09:47
MapReduce (17)
HDFS (16)
Hadoop (10)
Spark (4)
HBase (2)
Impala (2)
mail # user (13)
mail # dev (3)
issue (2)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (18)
Todd Lipcon (326)
Eli Collins (263)
Harsh J (261)
Colin Patrick McCabe (230)
Tsz Wo (206)
Chris Nauroth (166)
Jing Zhao (162)
Aaron T. Myers (141)
Suresh Srinivas (138)
Haohui Mai (135)
Andrew Wang (131)
Brandon Li (125)
Kihwal Lee (113)
Arpit Agarwal (110)
Daryn Sharp (100)
Uma Maheswara Rao G (79)
Ted Yu (74)
Alejandro Abdelnur (67)
Konstantin Shvachko (59)
Akira AJISAKA (55)
Stephen Chu (55)
Steve Loughran (51)
Yongjun Zhang (49)
Azuryy Yu (48)
Mohammad Tariq (46)
Yanbo Liang