| clear query|facets|time |
Search criteria: .
Results from 41 to 50 from
173 (0.368s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Newb question on HDFS - Hadoop - [mail # user]
|
|
...change localhost.com to localhost On Thu, Jun 24, 2010 at 12:11 PM, Blargy wrote: son my me and authority at. en the file is stion-on-HDFS-tp918683p918683.html ...
|
|
|
Author: Jeff Zhang,
2010-06-24, 04:52
|
|
|
Re: Questions about recommendation value of the "io.sort.mb" parameter - Hadoop - [mail # dev]
|
|
...Hi 李钰 The size of map output depends on your Mapper class. The Mapper class will do processing on the input data. 2010/6/23 李钰 : e �Srigurunath Chakravarthi 写道� � arge job...
|
|
|
Author: Jeff Zhang,
2010-06-23, 10:08
|
|
|
Re: Stuck MR job - Hadoop - [mail # user]
|
|
...Dd you put the jar which contains your mapper and reducer class on your classpath ? On Wed, Jun 23, 2010 at 5:06 PM, Vidhyashankar Venkataraman wrote: help.. y configs (pr...
|
|
|
Author: Jeff Zhang,
2010-06-23, 09:40
|
|
|
Re: Performance tuning of sort - Hadoop - [mail # user]
|
|
...The scale of each reducer depends on the Partitioner. You can think of Partitioner as a Hash Function, and the reducer as bucket, So you can not expect that each bucket has same number of it...
|
|
|
Author: Jeff Zhang,
2010-06-18, 05:34
|
|
|
Re: Performance tuning of sort - Hadoop - [mail # user]
|
|
...The input of each reducer is not same, it depends on the input data distribution and Partitioner. And the running time of each reducer consist of three phases: copy, sort and reducer. ...
|
|
|
Author: Jeff Zhang,
2010-06-18, 02:59
|
|
|
Re: Performance tuning of sort - Hadoop - [mail # user]
|
|
...Todd, Why's there a sorting in map task, the sorting here seems useless in my opi nion. On Thu, Jun 17, 2010 at 9:26 AM, Todd Lipcon wrote: The a wrote: s nd: ...
|
|
|
Author: Jeff Zhang,
2010-06-17, 16:37
|
|
|
Re: how to query JobTracker - Hadoop - [mail # user]
|
|
...Use JobClient.submitJob(JobConf job) , this method will return RunningJob. Then you can call RunningJob.isComplete() to query whether the previous job has been done. On Thu, Jun...
|
|
|
Author: Jeff Zhang,
2010-06-17, 14:42
|
|
|
Re: Performance tuning of sort - Hadoop - [mail # user]
|
|
...Your understanding of Sort is not right. The key concept of Sort is the TotalOrderPartitioner. Actually before the map-reduce job, client side will do sampling of input data to estimate the ...
|
|
|
Author: Jeff Zhang,
2010-06-17, 07:43
|
|
|
Re: job execution - Hadoop - [mail # user]
|
|
...There's a class org.apache.hadoop.mapred.jobcontrol.Job which is a wapper of JobConf. And You and dependent jobs to it. Then put it to JobControl. On Mon, Jun 14, 2010 at 9:55 ...
|
|
|
Author: Jeff Zhang,
2010-06-15, 01:43
|
|
|
Re: Hadoop code execution!! - Hadoop - [mail # user]
|
|
...You should put hadoop-*.core.jar on your classpath. and initialize your FileSystem by the following method public static FileSystem get(URI uri, Configuration conf) You can make the ur...
|
|
|
Author: Jeff Zhang,
2010-06-12, 07:08
|
|
|
|
