| clear query|facets|time |
Search criteria: .
Results from 101 to 110 from
112 (0.456s).
|
|
|
Loading phrases to help you refine your search...
|
|
NLineInputFormat and very high number of maptasks - Hadoop - [mail # user]
|
|
...Hello, When I use NLIneInputFormat, when I output: System.out.println("mapred.map.tasks:"+jobConf.get("mapred.map.tasks")); I see 51, but on the jobtracker site, the number is 18114. Yet wi...
|
|
|
Author: Saptarshi Guha,
2009-01-20, 16:39
|
|
|
Sorting on several columns using KeyFieldSeparator and Paritioner - Hadoop - [mail # user]
|
|
...Hello, I have a file with n columns, some which are text and some numeric. Given a sequence of indices, i would like to sort on those indices i.e first on Index1, then within Index2 an...
|
|
|
Author: Saptarshi Guha,
2009-01-18, 01:06
|
|
|
A reporter thread during the reduce stage for a long running line - Hadoop - [mail # user]
|
|
...Hello, Sorry for the puzzling subject. I have a single long running /statement/ in my reduce method, so the the framework might assume my reduce is not responding and kill it. I solve...
|
|
|
Author: Saptarshi Guha,
2009-01-09, 08:09
|
|
|
Re: Combiner run specification and questions - Hadoop - [mail # user]
|
|
.... So as long as the correctness of the computation doesn't Right, i had the same thought. So, i explicitly call the combiner? However at times, the reducer needs all the ...
|
|
|
Author: Saptarshi Guha,
2009-01-08, 06:32
|
|
|
Re: Problem loading hadoop-site.xml - dumping parameters - Hadoop - [mail # user]
|
|
...I have checked, the classpath and $HADOOP_CONF_DIR respectively contain and point to my conf folder. Regards Saptarshi On Jan 6, 2009, at 12:53 AM, Sharad Agarwal wrote: ...
|
|
|
Author: Saptarshi Guha,
2009-01-06, 15:27
|
|
|
Re: Combiner run specification and questions - Hadoop - [mail # user]
|
|
...I agree with the requirement that the key does not change. Of course, the values can change. I am primarily worried that the combiner might not be run at all - I have 'successf...
|
|
|
Author: Saptarshi Guha,
2009-01-06, 15:23
|
|
|
Re: Problem loading hadoop-site.xml - dumping parameters - Hadoop - [mail # user]
|
|
...Possibly. When i force load the configuration Configuration cf = new Configuration(); LOG.info("Adding new resource"); cf.addResource("hadoop-site.xml") It...
|
|
|
Author: Saptarshi Guha,
2009-01-06, 02:12
|
|
|
Re: Map input records(on JobTracker website) increasing and decreasing - Hadoop - [mail # user]
|
|
...True, i suspected that, however none died. (Nothing in the Tasks killed/Failed field) On Mon, Jan 5, 2009 at 4:04 PM, Doug Cutting wrote: Saptarshi Guha - [EMAIL PRO...
|
|
|
Author: Saptarshi Guha,
2009-01-05, 21:15
|
|
|
Re: Problem loading hadoop-site.xml - dumping parameters - Hadoop - [mail # user]
|
|
...For some strange reason, neither hadoop-default.xml nor hadoop-site.xml is loading. Both files are in hadoop-0.19.0/conf/ folder. HADOOP_CONF_DIR points to thi In some java code, (not a job)...
|
|
|
Author: Saptarshi Guha,
2009-01-05, 20:50
|
|
|
Re: Problem loading hadoop-site.xml - dumping parameters - Hadoop - [mail # user]
|
|
...Hello, I have set my HADOOP_CONF_DIR to the conf folder and still not loading. I have to manually set the options when I create my conf. Have you resolved this? Regards Saptarshi  ...
|
|
|
Author: Saptarshi Guha,
2009-01-05, 19:26
|
|
|
|