| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
173 (0.251s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: JobConf - Hadoop - [mail # user]
|
|
...Use FileInputFormat.setInputPaths On Thu, Nov 11, 2010 at 5:45 AM, maha wrote: hadoop-0.20.2-core.jar file, the class JobConf didn't have this method. How can I add ...
|
|
|
Author: Jeff Zhang,
2010-11-11, 01:13
|
|
|
Re: mapper and reducer scheduling - Hadoop - [mail # dev]
|
|
...TaskTracker will tell JobTracker how many free slots it has through heartbeat. And JobTracker will choose the best tasktracker with the consideration of data locality. On Thu, Oct 28,...
|
|
|
Author: Jeff Zhang,
2010-10-29, 07:15
|
|
|
How about hadoop world 2010 ? - Hadoop - [mail # user]
|
|
...Hi all, I haven't the opportunity to attend the hadoop world 2010, but still curious to know the conference and hear the voice from the attendees. And it would be better if someone can...
|
|
|
Author: Jeff Zhang,
2010-10-19, 16:46
|
|
|
Re: Corrupted input data to map - Hadoop - [mail # user]
|
|
...You can read the input as plain text then do type conversion in mapper, if there's NumberFormatException happens, you can decide how to do with it , like add a customized Counter to record i...
|
|
|
Author: Jeff Zhang,
2010-10-16, 01:21
|
|
|
Re: another quick question - Hadoop - [mail # user]
|
|
...Hi Maha , I don't think the hadoop.tmp.dir relates the problem of web ui. The web ui is bind to 0.0.0.0:50070 And localhost is mapped to 127.0.0.1 of your home machine in your client s...
|
|
|
Author: Jeff Zhang,
2010-10-06, 21:41
|
|
|
Re: how to set diffent VM parameters for mappers and reducers? - Hadoop - [mail # user]
|
|
...You can set mapred.child.java.opts in mapred-site.xml BTW, combiner can been run both in map side and reduce side On Tue, Oct 5, 2010 at 8:59 PM, Vitaliy Semochkin ...
|
|
|
Author: Jeff Zhang,
2010-10-05, 13:14
|
|
|
Re: Help!!The problem about Hadoop - Hadoop - [mail # user]
|
|
...Hi Jander, Hadoop has overhead compared to single-machine solution. How many task have you get when you run your hadoop job ? And what is time consuming for each map and reduce task ? ...
|
|
|
Author: Jeff Zhang,
2010-10-05, 08:28
|
|
|
Re: readFields() throws a NullPointerException - Hadoop - [mail # general]
|
|
...Do you have a no-argument constructor for your customer class and in the constructor do you do initialize the members ? Otherwise these members in your customer class will be null. On...
|
|
|
Author: Jeff Zhang,
2010-09-20, 01:34
|
|
|
Re: Number of Mappers - Hadoop - [mail # general]
|
|
...Hi Rahul, You can not determined set the mapper number as reducer number. The mapper number is determined by the your InputFormat. If you are using PigStorage, then the InputFormat is ...
|
|
|
Author: Jeff Zhang,
2010-09-15, 01:22
|
|
|
Re: changing SequenceFile format - Hadoop - [mail # user]
|
|
...The next method has three version for three type of sequence file: non-compression, record compression and block compression) I think maybe you should write a new class for your data format ...
|
|
|
Author: Jeff Zhang,
2010-09-13, 12:41
|
|
|
|