| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
29 (0.194s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Loading Data to HDFS - Hadoop - [mail # user]
|
|
...It might sound like a deprecated way but can't you move the data physically? good method if you the access of course. Regards Bertrand On Tue, Oct 30, 2012 at 11:07 AM, sum...
|
|
|
Author: Bertrand Dechoux,
2012-10-30, 10:16
|
|
|
Re: Maps split size - Hadoop - [mail # user]
|
|
...Okay, then it would be because you didn't really change the block size. Of course, you might change the value of the property but the block size is actually something which is part of the fi...
|
|
|
Author: Bertrand Dechoux,
2012-10-29, 06:15
|
|
|
Re: Maps split size - Hadoop - [mail # user]
|
|
...Hi Mark, I think http://wiki.apache.org/hadoop/HowManyMapsAndReduces might interest you. If you require more information, feel free to ask after reading it. Regards Bertran...
|
|
|
Author: Bertrand Dechoux,
2012-10-26, 21:23
|
|
|
Re: puzzled at the output - Hadoop - [mail # user]
|
|
...Combiner? And you are only using 'Text' as type? Please do a real test with a specified input. We can only guess. Bertrand On Tue, Oct 2, 2012 at 6:52 PM, Chris Nauroth wro...
|
|
|
Author: Bertrand Dechoux,
2012-10-02, 17:01
|
|
|
Re: puzzled at the output - Hadoop - [mail # user]
|
|
...And a simple way to do that is actually writing a unit test, with MRunit for exemple. A little sample for a a full mapper-reducer test : MapReduceDriver.newMapReduceDriver(new Wo...
|
|
|
Author: Bertrand Dechoux,
2012-10-02, 14:14
|
|
|
Re: Restricting the number of slave nodes used for a given job (regardless of the # of map/reduce tasks involved) - Hadoop - [mail # user]
|
|
...If that is only for benchmarking, you could stop the task-trackers on the machines you don't want to use. Or you could setup another cluster. But yes, there is not standard way to limi...
|
|
|
Author: Bertrand Dechoux,
2012-09-10, 11:18
|
|
|
Re: Using hadoop for analytics - Hadoop - [mail # user]
|
|
...Hi, It would depend on the data volume mainly. Hadoop can be used to refine the data before inserting into a traditional architecture (like a database). If you want to write jobs...
|
|
|
Author: Bertrand Dechoux,
2012-09-05, 08:57
|
|
|
[HADOOP-8741] Broken links from "Cluster setup" to *-default.html - Hadoop - [issue]
|
|
...Hi,The links from the cluster setup pages to the configuration files are broken.http://hadoop.apache.org/common/docs/stable/cluster_setup.htmlRead-only default configurationhttp://hadoop.apa...
|
|
|
http://issues.apache.org/jira/browse/HADOOP-8741
Author: Bertrand Dechoux,
2012-08-30, 07:31
|
|
|
Re: no output written to HDFS - Hadoop - [mail # user]
|
|
...Do you observe the same thing when running without Hadoop? (cat, map, sort and then reduce) Could you provide the counters of your job? You should be able to get them using the job tra...
|
|
|
Author: Bertrand Dechoux,
2012-08-30, 05:45
|
|
|
Re: Measuring Shuffle time for MR job - Hadoop - [mail # user]
|
|
...Shuffle time is considered as part of the reduce step. Without reduce, there is no need for shuffling. One way to measure it would be using the full reduce time with a '/dev/null' reducer. &...
|
|
|
Author: Bertrand Dechoux,
2012-08-27, 07:57
|
|
|
|
