| clear query|facets|time |
Search criteria: .
Results from 1 to 6 from
6 (0.064s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Job cleanup - Hadoop - [mail # user]
|
|
...I think the problem is I need to report progress() from my cleanup task. How can I do this? The commitJob() in my custom org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter[1] o...
|
|
|
Author: Robert Dyer,
2013-04-17, 08:44
|
|
|
[HADOOP-9386] MapFile.fix does not allow custom index intervals - Hadoop - [issue]
|
|
...MapFile.Writer provides a setIndexInterval() method for customizing how frequently an index is written. By default it is set to 128.The method MapFile.fix() provides the ability to reg...
|
|
|
http://issues.apache.org/jira/browse/HADOOP-9386
Author: Robert Dyer,
2013-03-09, 17:22
|
|
|
Re: Namenode failures - Hadoop - [mail # user]
|
|
...On Sun, Feb 17, 2013 at 5:08 PM, Harsh J wrote: I don't believe so. The only files I push to HDFS are SequenceFiles (with protobuf objects in them) and HBase's regio...
|
|
|
Author: Robert Dyer,
2013-02-17, 23:29
|
|
|
Re: more reduce tasks - Hadoop - [mail # user]
|
|
...You could create a CustomOutputCommitter and in the commitJob() method simply read in the part-* files and write them out into a single aggregated file. This requires making a CustomOu...
|
|
|
Author: Robert Dyer,
2013-01-04, 05:55
|
|
|
Re: Strange machine behavior - Hadoop - [mail # user]
|
|
...Yes but even with a MR running, it is only 36GB heap total out of 64GB ram. This leaves plenty for OS and caching. The problem seems to be the OS preferring to cache over giving ...
|
|
|
Author: Robert Dyer,
2012-12-09, 02:10
|
|
|
Strange machine behavior - Hadoop - [mail # user]
|
|
...Has anyone experienced a TaskTracker/DataNode behaving like the attached image? This was during a MR job (which runs often). Note the extremely high System CPU time. Upon i...
|
|
|
Author: Robert Dyer,
2012-12-09, 00:09
|
|
|
|
