| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
27 (0.248s).
|
|
|
Loading phrases to help you
refine your search...
|
|
[HADOOP-9293] For S3 use credentials file - Hadoop - [issue]
|
|
...The following document describes the current way that S3 credentials can be specified ( http://wiki.apache.org/hadoop/AmazonS3 ). In summary they are: in the S3 URI. in the hadoop-site...
|
|
|
http://issues.apache.org/jira/browse/HADOOP-9293
Author: Andy Sautins,
2013-02-21, 21:36
|
|
|
RE: Shuffle In Memory OutOfMemoryError - Hadoop - [mail # user]
|
|
... Thanks Christopher. The heap size for reduce tasks is configured to be 640M ( mapred.child.ja va.opts set to -Xmx640m ). Andy From: Christopher ...
|
|
|
Author: Andy Sautins,
2010-03-10, 01:01
|
|
|
RE: Shuffle In Memory OutOfMemoryError - Hadoop - [mail # user]
|
|
... Ah. My mistake. We will apply the patch manually to 0.20.2 and re-run. Just out of curiosity, why do the release notes for 0.20.2 indicate that MAPREDUC...
|
|
|
Author: Andy Sautins,
2010-03-09, 22:41
|
|
|
RE: Shuffle In Memory OutOfMemoryError - Hadoop - [mail # user]
|
|
... Thanks Ted. My understanding is that MAPREDUCE-1182 is included in the 0.20.2 release. We upgraded our cluster to 0.20.2 this weekend and re-ran the same...
|
|
|
Author: Andy Sautins,
2010-03-09, 22:23
|
|
|
RE: Shuffle In Memory OutOfMemoryError - Hadoop - [mail # user]
|
|
... Thanks Ted. Very helpful. You are correct that I misunderstood the code at ReduceTask.java:1535. I missed the fact that it's in a IOException cat ch block. &nb...
|
|
|
Author: Andy Sautins,
2010-03-07, 23:57
|
|
|
RE: Shuffle In Memory OutOfMemoryError - Hadoop - [mail # user]
|
|
... Ted, I'm trying to follow the logic in your mail and I'm not sure I'm following. If you would mind helping me understand I would appreciate it. ...
|
|
|
Author: Andy Sautins,
2010-03-07, 21:03
|
|
|
What do you use for capturing Disk I/O? - Hadoop - [mail # user]
|
|
... I have a question that I got an interesting and helpful answer for on t he IRC channel today, but thought I'd open it up to a larger group as well. My problem is ...
|
|
|
Author: Andy Sautins,
2009-12-11, 00:55
|
|
|
question on data/task node specific configuration... - Hadoop - [mail # user]
|
|
... I've run into a situation where it would be helpful to set specific con figuration variables local to a data/task node. I've got a solution, but I 'm curious if there is ...
|
|
|
Author: Andy Sautins,
2009-10-30, 19:21
|
|
|
RE: Map/Reduce and sequence file metadata... - Hadoop - [mail # user]
|
|
... Thanks for the response Tom. I'll probably try the approach of extending SequenceFileOutputFormat to write sequence file metadata. What I am getting from your...
|
|
|
Author: Andy Sautins,
2009-10-02, 20:48
|
|
|
Map/Reduce and sequence file metadata... - Hadoop - [mail # user]
|
|
... Hi all. I'm struggling a bit to figure this out and wondering if anyone had any pointers. I'm using SequenceFiles as output from a MapReduce job ( usin...
|
|
|
Author: Andy Sautins,
2009-10-01, 16:10
|
|
|
|
