| clear query|facets|time |
Search criteria: .
Results from 81 to 90 from
99 (0.078s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Fixing a failed reduce task - MapReduce - [mail # user]
|
|
...Yes - of course but the question is whether there is a way to do it while the job is running rather than restarting with different parameter On Tue, Jul 13, 2010 at 4:51 PM, Ted Yu &nb...
|
|
|
Author: Steve Lewis,
2010-07-14, 01:57
|
|
|
Fixing a failed reduce task - MapReduce - [mail # user]
|
|
...I am running a map reduce ob where a few reduce tasks fail with an out of memory error - Increasing the memory is not an option. However if a retry had information that an earlier attempt fa...
|
|
|
Author: Steve Lewis,
2010-07-13, 17:16
|
|
|
Restarting a cluster - MapReduce - [mail # user]
|
|
...We have a cluster with 4 Cloudera VMs - hadoop fs -ls / says 10/07/12 05:42:22 INFO ipc.Client: Retrying connect to server: localhost/ 127.0.0.1:8022. Already tried 0 time(s). 10/07/1...
|
|
|
Author: Steve Lewis,
2010-07-12, 18:51
|
|
|
How does performance scale with the size of the data? - MapReduce - [mail # user]
|
|
...Assume we have a medium size cluster - say 20 nodes and that the cluster is used for one job and cannot change in size. Assume we are sorting a large data set. As we increase the size of the...
|
|
|
Author: Steve Lewis,
2010-07-01, 05:15
|
|
|
Re: Who creates job.jar? - MapReduce - [mail # user]
|
|
...I have attached code for creating a Hadoop Jar - All you need to do is run HadoopDeployer in the same environment that your hadoop job runs as a local process (You did test your job in this ...
|
|
|
Author: Steve Lewis,
2010-06-25, 15:55
|
|
|
Re: Who creates job.jar? - MapReduce - [mail # user]
|
|
...You create the jar and export it to aws before running the job. The jar should contain all of your code and in a directory called lib all libraries you need - I have a tool for generating ja...
|
|
|
Author: Steve Lewis,
2010-06-24, 22:52
|
|
|
Custom File reader - MapReduce - [mail # user]
|
|
...I have a number of files which can be read and converted into a series of lines of lext - however the means of reading the file is not known to the standard Hadoop splitters. I understand th...
|
|
|
Author: Steve Lewis,
2010-06-24, 19:44
|
|
|
Using a custom FileSplitter? - MapReduce - [mail # user]
|
|
...Assume I have one of the two situations (I have both) 1) I have a directory with several hundred files - of these some fraction need to be passed to the mapper (say the ones ending in ".foo"...
|
|
|
Author: Steve Lewis,
2010-06-23, 17:21
|
|
|
Newbie - question - how do I use Hadoop to sort a very large file - MapReduce - [mail # user]
|
|
...Assume I have a large file called *BigData.unsorted* ( say 500GB) consisting of lines of text. Assume that these lines are in random order - I understand how to assign a key to lines a...
|
|
|
Author: Steve Lewis,
2010-06-23, 17:15
|
|
|
Re: HDFS Errors - MapReduce - [mail # user]
|
|
...No I have been using it for about two weeks and have many dozen files but it may be close to full On Jun 22, 2010 3:14 PM, "Allen Wittenauer" wrote: On Jun 22, 2010, at 1:...
|
|
|
Author: Steve Lewis,
2010-06-23, 00:19
|
|
|
|
