| clear query|facets|time |
Search criteria: .
Results from 21 to 30 from
53 (0.198s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: setNumTasks - Hadoop - [mail # user]
|
|
...Hi Mohit The number of map tasks is determined by your number of input splits and the Input Format used by your MR job. Setting this value won't help you control the sam...
|
|
|
Author: Bejoy Ks,
2012-03-22, 15:01
|
|
|
Re: how to implements the 'diff' cmd in hadoop - Hadoop - [mail # user]
|
|
...Yes, if you are having more than 2 files to be compared against then, the file name/ id is required from mapper. If it is just two files and you just want to know which lines are not u...
|
|
|
Author: Bejoy Ks,
2012-03-20, 11:13
|
|
|
Re: how to implements the 'diff' cmd in hadoop - Hadoop - [mail # user]
|
|
...Hi Lin In you mapper make the line no as the key and the line contents as the value. In your reducer check whether the two values for a key are matching. ie if yo...
|
|
|
Author: Bejoy Ks,
2012-03-20, 10:09
|
|
|
Re: _temporary doesn't exist - Hadoop - [mail # user]
|
|
...Hi Vipul AFAIK, the clean up should happen after the job completion not task. But what is causing this clean up, may be you can get some info from the NN logs. Reg...
|
|
|
Author: Bejoy Ks,
2012-03-16, 20:33
|
|
|
Re: _temporary doesn't exist - Hadoop - [mail # user]
|
|
...Hi Vipul Is there any reason you are with 0.17 version of hadoop? It is a pretty old version of hadoop (more than 2 years back) and tons of bug fixes and optimizations h...
|
|
|
Author: Bejoy Ks,
2012-03-16, 19:09
|
|
|
Re: Not able to Make directory in HDFS - Hadoop - [mail # user]
|
|
...Hi Sujit Strange. Is it throwing any errors? If so please attach the console log. Regards Bejoy.K.S On Fri, Mar 16, 2012 at 11:23 PM, Sujit Dhamale wrote: &nb...
|
|
|
Author: Bejoy Ks,
2012-03-16, 18:51
|
|
|
Re: Hadoop 1.0.0 - stuck at map reduce - Hadoop - [mail # user]
|
|
...Hey Bob Looks like you don't have the map and reduce slots configured on your system it is pointing to zero. In your mapred-site.xml set mapred.tasktracker.map.tas...
|
|
|
Author: Bejoy Ks,
2012-03-16, 18:47
|
|
|
Re: SequenceFile split question - Hadoop - [mail # user]
|
|
...Hi Mohit You are right. If your smaller XML files are in hdfs then MR would be the best approach to combine it to a sequence file. It'd do the job in parallel. Rega...
|
|
|
Author: Bejoy Ks,
2012-03-15, 14:58
|
|
|
Re: SequenceFile split question - Hadoop - [mail # user]
|
|
...Hi Mohit If you are using a stand alone client application to do the same definitely there is just one instance of the same running and you'd be writing the sequence fil...
|
|
|
Author: Bejoy Ks,
2012-03-15, 09:15
|
|
|
Re: does hadoop always respect setNumReduceTasks? - Hadoop - [mail # user]
|
|
...Hi Jayne Adding on to Lance's comments, (answer to other queries) Yes, unless you mark it final in mapred-site.xml (you ...
|
|
|
Author: Bejoy Ks,
2012-03-09, 19:08
|
|
|
|
