Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 5 from 5 (0.187s).
Loading phrases to help you
refine your search...
RE: MAP_INPUT_RECORDS counter in the reducer - Hadoop - [mail # user]
...Or you do the calculation in the reducer close() method, even though I am not sure in the reducer you can get the Mapper's count. But even you can't, here is what can do:1) Save the JobConf ...
   Author: java8964 java8964, 2013-09-18, 02:08
RE: distcp failed "Copy failed: ENOENT: No such file or directory" - Hadoop - [mail # user]
...The error doesn't mean the file not existed in the HDFS, but it means local disk. If you read the error stack trace: at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSyst...
   Author: java8964 java8964, 2013-09-06, 20:38
RE: Question related to Decompressor interface - Hadoop - [mail # user]
...Can someone share some idea what the Hadoop source code of class org.apache.hadoop.io.compress.BlockDecompressorStream, method rawReadInt() is trying to do here? There is a comment in the co...
   Author: java8964 java8964, 2013-02-12, 20:21
RE: Loader for small files - Hadoop - [mail # user]
... Hi, Davie: I am not sure I understand this suggestion. Why smaller block size will help this performance issue? As hadoop needs to start a lot of mappers (I think creating a mapper als...
   Author: java8964 java8964, 2013-02-12, 15:15
RE: number input files to mapreduce job - Hadoop - [mail # user]
...I don't think you can get list of all input files in the mapper, but what you can get is the current file's information. In the context object reference, you can get the InputSplit(), which ...
   Author: java8964 java8964, 2013-02-12, 15:01
MapReduce (18)
Hive (13)
HDFS (5)
Hadoop (5)
Avro (4)
mail # user (5)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (5)
Harsh J (560)
Owen O'Malley (394)
Steve Loughran (391)
Todd Lipcon (238)
Eli Collins (182)
Alejandro Abdelnur (178)
Arun C Murthy (163)
Allen Wittenauer (148)
Chris Nauroth (146)
Ted Yu (127)
Tom White (120)
Daryn Sharp (115)
Nigel Daley (115)
Konstantin Shvachko (107)
Doug Cutting (96)
Aaron Kimball (94)
Colin Patrick McCabe (94)
Edward Capriolo (88)
Mark Kerzner (87)
jason hadoop (82)
Hairong Kuang (74)
Konstantin Boudnik (72)
Runping Qi (72)
Benoy Antony (69)
Suresh Srinivas (64)
java8964 java8964