|
|
+
ranjith raghunath 2012-10-07, 01:52
-
Spill related errors after modifying parametersranjith raghunath 2012-10-07, 12:56
In looking through the conversations on this mailing list I though this
conversation may be appropriate here. I apologize for the duplication. The issue that i am having is around spill failure after memory modifications. The error messages however are around security. I am using hadoop 1.0.3. Have listed some more context below. On Oct 6, 2012 8:52 PM, "ranjith raghunath" <[EMAIL PROTECTED]> wrote: > This seems a little odd but after modifying the following parameters > > io.sort.mb > *io*.*sort*.*spill*.percent > mapred.min.split.size > mapred.inmem.merge.threshold > > mapred.child.java.opts > > I am seeing the following error messages: > > java.io.IOException: Spill failed at org.apache.hadoop.mapred. > MapTask$MapOutputBuffer.collect(MapTask.java:1029) at > org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask. > java:691) > > > Any help on this topic appreciated would be appreciated > > Thanks > |