| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
47 (0.095s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: mapred.tasktracker.map.tasks.maximum not working - Hadoop - [mail # user]
|
|
...Adding on to Chen's response. This is a setting meant at Task Tracker level(environment setting based on parameters like your CPU cores, memory etc) and you need to override the same a...
|
|
|
Author: bejoy.hadoop@...,
2012-03-10, 06:39
|
|
|
Re: mapred.map.tasks vs mapred.tasktracker.map.tasks.maximum - Hadoop - [mail # user]
|
|
...Mohit It is a job level config parameter. For plain map reduce jobs you can set the same through CLI as hadoop jar ... -D mapred.map.tasks=n You should be able to do it p...
|
|
|
Author: bejoy.hadoop@...,
2012-03-10, 06:35
|
|
|
Re: Splitting files on new line using hadoop fs - Hadoop - [mail # user]
|
|
...Hi Mohit I'm not an expert in pig and it'd be better using the pig user group for pig specific queries. I'd try to help you with some basic trouble shooting of th...
|
|
|
Author: bejoy.hadoop@...,
2012-02-22, 20:44
|
|
|
Re: Splitting files on new line using hadoop fs - Hadoop - [mail # user]
|
|
...Hi Mohit AFAIK there is no default mechanism available for the same in hadoop. File is split into blocks just based on the configured block size during hdfs copy....
|
|
|
Author: bejoy.hadoop@...,
2012-02-22, 20:23
|
|
|
Re: How do I synchronize Hadoop jobs? - Hadoop - [mail # user]
|
|
...Hi McNeil Have a look at OOZIE. It is meant for work flow management in hadoop and can serve your purpose. From: W.P. McNeill To: Hadoop...
|
|
|
Author: bejoy.hadoop@...,
2012-02-15, 19:28
|
|
|
Re: Combining MultithreadedMapper threadpool size & map.tasks.maximum - Hadoop - [mail # user]
|
|
...Hi Rob I'd try to answer this. From my understanding if you are using Multithreaded mapper on word count example with TextInputFormat and imagine you have 2 thread...
|
|
|
Author: bejoy.hadoop@...,
2012-02-10, 19:15
|
|
|
Re: Combining MultithreadedMapper threadpool size & map.tasks.maximum - Hadoop - [mail # user]
|
|
...Hi Rob I'm the culprit who posted the blog. :) The topic was of my interest as well and I found the conversation informative and useful. Just thought of docu...
|
|
|
Author: bejoy.hadoop@...,
2012-02-10, 19:00
|
|
|
Re: Processing compressed files in Hadoop - Hadoop - [mail # user]
|
|
...Leo It should work with your custom Input Formats as well. Add the Lzo codec class to io.compression.codecs and try. Regards Bejoy K S From handheld, Please...
|
|
|
Author: bejoy.hadoop@...,
2012-02-08, 19:03
|
|
|
Re: Preferred ways to specify input and output directories to Hadoop jobs - Hadoop - [mail # user]
|
|
...From what I know, a lot of guys including us provide the input and output dirs as position arguments for our custom mapreduce jobs along with other position arguments required for each job. ...
|
|
|
Author: bejoy.hadoop@...,
2012-02-08, 18:21
|
|
|
Re: Preferred ways to specify input and output directories to Hadoop jobs - Hadoop - [mail # user]
|
|
...Hi When you give in the arguments on CLI in your driver class you are making it assign to mapred.input.dir and mapred.output.dir . I believe no such default exists...
|
|
|
Author: bejoy.hadoop@...,
2012-02-08, 18:13
|
|
|
|
