| clear query|facets|time |
Search criteria: .
Results from 31 to 39 from
39 (0.112s).
|
|
|
Loading phrases to help you
refine your search...
|
|
does hadoop always respect setNumReduceTasks? - Hadoop - [mail # user]
|
|
...i am wondering if hadoop always respect Job.setNumReduceTasks(int)? as i am emitting items from the mapper, i expect/desire only 1 reducer to get these items because i want to assign e...
|
|
|
Author: Jane Wayne,
2012-03-09, 02:30
|
|
|
Re: can i specify no shuffle and/or no sort in the reducer and no disk space left IOException when there is DFS space remaining - Hadoop - [mail # user]
|
|
...thanks Jie. that worked. instead of part-r-00000, i just get part-m-00000. so, that's no problem. however, i'm going to see if i still get that IOException complaining about no more fr...
|
|
|
Author: Jane Wayne,
2012-03-08, 05:28
|
|
|
Re: can i specify no shuffle and/or no sort in the reducer and no disk space left IOException when there is DFS space remaining - Hadoop - [mail # user]
|
|
...Jie, so if if i set the number of reduce tasks to 0, do i need to specify the reducer (or should i set it null)? if i don't specify the reducer, and just have a mapper, where do all th...
|
|
|
Author: Jane Wayne,
2012-03-08, 05:06
|
|
|
can i specify no shuffle and/or no sort in the reducer and no disk space left IOException when there is DFS space remaining - Hadoop - [mail # user]
|
|
...i have a Mapper and Reducer as a part of a job. all my data transformation occurs in the mapper, and there is absolutely nothing that needs to be done in the reducer. when i set the reducer ...
|
|
|
Author: Jane Wayne,
2012-03-08, 04:28
|
|
|
how to get rid of -libjars ? - Hadoop - [mail # user]
|
|
...currently, i have my main jar and then 2 depedent jars. what i do is 1. copy dependent-1.jar to $HADOOP/lib 2. copy dependent-2.jar to $HADOOP/lib then, when i need to run my job, MyJo...
|
|
|
Author: Jane Wayne,
2012-03-06, 15:37
|
|
|
Re: is there anyway to detect the file size as am i writing a sequence file? - Hadoop - [mail # user]
|
|
...Thanks Joey. That's what I meant (I've been staring at the screen too long). :) On Tue, Mar 6, 2012 at 10:00 AM, Joey Echeverria wrote: ...
|
|
|
Author: Jane Wayne,
2012-03-06, 15:27
|
|
|
is there anyway to detect the file size as am i writing a sequence file? - Hadoop - [mail # user]
|
|
...hi, i am writing a little util class to recurse into a directory and add all *.txt files into a sequence file (key is the file name, value is the content of the corresponding text file...
|
|
|
Author: Jane Wayne,
2012-03-06, 14:53
|
|
|
Re: why does my mapper class reads my input file twice? - Hadoop - [mail # user]
|
|
...Harsh, Thanks. I went into the code on FileInputFormat.addInputPath(Job,Path) and it is as you stated. That make sense now. I simply commented out FileInputFormat.addInputPath(job, inp...
|
|
|
Author: Jane Wayne,
2012-03-06, 13:52
|
|
|
why does my mapper class reads my input file twice? - Hadoop - [mail # user]
|
|
...i have code that reads in a text file. i notice that each line in the text file is somehow being read twice. why is this happening? my mapper class looks like the following: publ...
|
|
|
Author: Jane Wayne,
2012-03-06, 03:33
|
|
|
|
