| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
106 (0.24s).
|
|
|
Loading phrases to help you refine your search...
|
|
Inconsistent results when reading from s3n - MapReduce - [mail # user]
|
|
...Ran into a puzzling - and worrisome - issue late last night. I was running a Hadoop streaming job, which reads input from 2 different buckets in Amazon S3 (using s3n://). W...
|
|
|
Author: David Rosenstrauch,
2013-05-07, 21:06
|
|
|
Re: Combine data from different HDFS FS - MapReduce - [mail # user]
|
|
...I don't think you need a special input format. I think you just need to specify your list of input files like this: hdfs://HOST1/folder-name/file-name,hdfs://HOST2/folder-n...
|
|
|
Author: David Rosenstrauch,
2013-04-09, 13:37
|
|
|
Distcp reliability issue - MapReduce - [mail # user]
|
|
...I've run into an issue with the reliability of distcp. Specifically, I have a distcp job that seems to have not copied over a few files - and yet didn't fail the job.  ...
|
|
|
Author: David Rosenstrauch,
2013-02-28, 06:12
|
|
|
Re: Large static structures in M/R heap - MapReduce - [mail # user]
|
|
...On 02/27/2013 01:42 PM, Adam Phelps wrote: We use a similar solution to what you suggested to address this issue. Though, the in-memory app we run on each datanode is a proprieta...
|
|
|
Author: David Rosenstrauch,
2013-02-27, 18:53
|
|
|
[MAPREDUCE-2293] Enhance MultipleOutputs to allow additional characters in the named output name - MapReduce - [issue]
|
|
...Currently you are only allowed to use alpha-numeric characters in a named output name in the MultipleOutputs class. This is a bit of an onerous restriction, as it would be extremely co...
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-2293
Author: David Rosenstrauch,
2013-01-27, 17:47
|
|
|
Re: How do find the version of Hadoop inside a running Map or reduce task - MapReduce - [mail # user]
|
|
...On 11/05/2012 04:02 PM, David Rosenstrauch wrote: Sorry, make that "hadoop version". Also, FYI, it looks like that command just calls out to methods in http://hadoop.apache...
|
|
|
Author: David Rosenstrauch,
2012-11-05, 21:08
|
|
|
Re: How do find the version of Hadoop inside a running Map or reduce task - MapReduce - [mail # user]
|
|
...On 11/05/2012 03:54 PM, Steve Lewis wrote: Probably not the best way, but one possible way: make a call to Runtime.exec() and call "hadoop -version". DR...
|
|
|
Author: David Rosenstrauch,
2012-11-05, 21:02
|
|
|
[MAPREDUCE-2001] Enhancement to SequenceFileOutputFormat to allow user to set MetaData - MapReduce - [issue]
|
|
...The org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat class currently does not provide a way for the user to pass in a MetaData object to be written to the SequenceFile.Current...
|
|
|
http://issues.apache.org/jira/browse/MAPREDUCE-2001
Author: David Rosenstrauch,
2012-10-17, 05:01
|
|
|
Re: Task Attempt Failed - MapReduce - [mail # user]
|
|
...I get those too. It's probably this issue: https://issues.apache.org/jira/browse/MAPREDUCE-2374 If you go look in the task tracker log on the node that had the failed  ...
|
|
|
Author: David Rosenstrauch,
2012-10-08, 14:31
|
|
|
Re: OK to run data node on same machine as secondary name node? - MapReduce - [mail # user]
|
|
...Very helpful info. I hadn't considered the bandwidth aspect of it. Thanks much, Harsh! DR On 08/16/2012 12:58 AM, Harsh J wrote:...
|
|
|
Author: David Rosenstrauch,
2012-08-16, 17:11
|
|
|
|