Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Map Rask has IO exception


Copy link to this message
-
Re: Map Rask has IO exception
Steve Lewis 2011-11-07, 16:36
0.202 and using that API  -

On Mon, Nov 7, 2011 at 8:27 AM, Robert Evans <[EMAIL PROTECTED]> wrote:

>  What version of Hadoop are you using?
>
>
>
> On 11/5/11 11:09 AM, "Steve Lewis" <[EMAIL PROTECTED]> wrote:
>
> My job is dying during a  map task write. This happened in enough task to
> kill the job although most tasks succeeded -
>
> Any ideas as to where to start diagnosing the problem
>
>
>
> Caused by: java.lang.NullPointerException
>  at
> org.apache.hadoop.io.compress.BZip2Codec$BZip2CompressionOutputStream.write(BZip2Codec.java:200)
>  at
> org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:41)
>  at java.io.DataOutputStream.writeByte(DataOutputStream.java:136)
>  at org.apache.hadoop.io.WritableUtils.writeVLong(WritableUtils.java:263)
>  at org.apache.hadoop.io.WritableUtils.writeVInt(WritableUtils.java:243)
>  at org.apache.hadoop.mapred.IFile$Writer.close(IFile.java:126)
>  at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1242)
>  at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.access$1800(MapTask.java:648)
>  at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer$SpillThread.run(MapTask.java:1135)
>
>
--
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com