| clear query|facets|time |
Search criteria: .
Results from 1 to 6 from
6 (0.299s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: number of mapper tasks - MapReduce - [mail # user]
|
|
...Hello, I have been able to make this work. I don't know why, but when but input file is zipped (read as a input stream) it creates only 1 mapper. However, when it's not z...
|
|
|
Author: Marcelo Elias Del Valle,
2013-01-29, 12:53
|
|
|
Re: number of mapper tasks - MapReduce - [mail # user]
|
|
...I implemented my custom input format. Here is how I used it: https://github.com/mvallebr/CSVInputFormat/blob/master/src/test/java/org/apache/hadoop/mapreduce/lib/input/test/CSVTestRunner.jav...
|
|
|
Author: Marcelo Elias Del Valle,
2013-01-29, 10:52
|
|
|
Re: number of mapper tasks - MapReduce - [mail # user]
|
|
...Just to complement the last question, I have implemented the getSplits method in my input format: https://github.com/mvallebr/CSVInputFormat/blob/master/src/main/java/org/apache/hadoop/mapre...
|
|
|
Author: Marcelo Elias Del Valle,
2013-01-28, 20:56
|
|
|
Re: number of mapper tasks - MapReduce - [mail # user]
|
|
...Sorry for asking too many questions, but the answers are really happening. 2013/1/28 Harsh J Indeed, CPU is my bottleneck. That's why I want more things in parallel. Actu...
|
|
|
Author: Marcelo Elias Del Valle,
2013-01-28, 16:55
|
|
|
Re: number of mapper tasks - MapReduce - [mail # user]
|
|
...Hello Harsh, First of all, thanks for the answer! 2013/1/28 Harsh J Is there anything I can do in my job, my code or in my inputFormat so that hadoop would ...
|
|
|
Author: Marcelo Elias Del Valle,
2013-01-28, 16:31
|
|
|
number of mapper tasks - MapReduce - [mail # user]
|
|
...Hello, I am using hadoop with TextInputFormat, a mapper and no reducers. I am running my jobs at Amazon EMR. When I run my job, I set both following options: -s,mapred.ta...
|
|
|
Author: Marcelo Elias Del Valle,
2013-01-28, 15:54
|
|
|
|
