Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 66 (0.049s).
Loading phrases to help you
refine your search...
how to caculate a HDFS directory size ? - MapReduce - [mail # user]
...hi,maillist:           i want to caculate the size of a HDFS directory ,how to do it ?...
   Author: ch huang, 2014-01-09, 00:57
issue about how to assiging map output to reducer? - MapReduce - [mail # user]
...hi,maillist:             i look the containers log from " hadoop fs -cat /var/log/hadoop-yarn/apps/root/logs/application_1388730279827_2770/CHBM221_50853"  ...
   Author: ch huang, 2014-01-08, 07:32
Re: issue about running hive MR job in hadoop - MapReduce - [mail # user]
...yes i checked the code ,and find the Exception from       lfs.mkdir(userFileCacheDir, null, false);  also find the AM located in CHBM224 ,all will failed but,AM located i...
   Author: ch huang, 2014-01-03, 08:40
issue about hadoop streaming - MapReduce - [mail # user]
...hi,maillist:     i read the doc about hadoop streaming,is it possible to construct job chain through pipeline and hadoop streaming ? if the first job like this first job : hadoop j...
   Author: ch huang, 2013-12-26, 02:15
Re: PriviledgedActionException as:root (auth:SIMPLE) cause:java.io.IOException: No input paths specified in job - MapReduce - [mail # dev]
...I changed the following code in my test code ,it's ok  FileInputFormat. *addInputPath*(job, *new* Path(args[0])); =>  MyFileInputFormat. *addInputPath*(job, *new* Path(args[0]))...
   Author: ch huang, 2013-12-24, 01:43
problem about use mapreduce get big file - MapReduce - [mail # dev]
...hi,maillist:      i want to produce a big input file( or a collection of big files) use MR job,my output file is very sample ,like following info  1,text 2,text 3,text .....
   Author: ch huang, 2013-12-20, 05:44
Re: issue about no class find in running MR job - MapReduce - [mail # user]
...i think it's a official uage ,you can type hadoop ,and read the last line of the help output ,and i use CDH 4.4 ,i do not know if community version is support this usage   On Sat, Dec 1...
   Author: ch huang, 2013-12-16, 00:56
Re: issue about Shuffled Maps in MR job summary - MapReduce - [mail # user]
...one of important things is my input file is very small ,each file less than 10M,and i have a huge number of files  On Thu, Dec 12, 2013 at 9:58 AM, java8964  wrote:  ...
   Author: ch huang, 2013-12-12, 03:12
is mapreduce.task.io.sort.mb control both map merge buffer and reduce merge buffer? - MapReduce - [mail # user]
...hi,maillist:               Due to the heavy job on reduce task, i try to increase buffer size for sort merge,i wander if i increase mapreduce.task.io.sort....
   Author: ch huang, 2013-12-12, 01:52
how to corrupt a replica of a block by manually? - MapReduce - [mail # user]
...hi,maillist:         what is the sample way to corrupt a replica of a block ,i opened a replica data file ,and delete a line,than use fsck ,nothing corrupt,  should ...
   Author: ch huang, 2013-12-12, 01:07
HBase (64)
MapReduce (57)
Hadoop (51)
HDFS (41)
Hive (30)
Sqoop (7)
Zookeeper (7)
Flume (3)
Spark (2)
mail # user (63)
mail # dev (3)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (66)
Harsh J (454)
Arun C Murthy (326)
Vinod Kumar Vavilapalli (309)
Todd Lipcon (212)
Amar Kamat (181)
Thomas Graves (165)
Jason Lowe (157)
Amareshwari Sriramadasu (153)
Sandy Ryza (124)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Owen O'Malley (105)
Devaraj K (103)
Ramya Sunil (103)
Alejandro Abdelnur (101)
Robert Joseph Evans (101)
Hemanth Yamijala (97)
Steve Loughran (90)
Eli Collins (77)
Ted Yu (77)
Ravi Gummadi (76)
Karthik Kambatla (67)
Mahadev konar (67)
Ravi Prakash (66)
ch huang