Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Map Rask has IO exception


Copy link to this message
-
Re: Map Rask has IO exception
0.202 and using that API  -

On Mon, Nov 7, 2011 at 8:27 AM, Robert Evans <[EMAIL PROTECTED]> wrote:

>  What version of Hadoop are you using?
>
>
>
> On 11/5/11 11:09 AM, "Steve Lewis" <[EMAIL PROTECTED]> wrote:
>
> My job is dying during a  map task write. This happened in enough task to
> kill the job although most tasks succeeded -
>
> Any ideas as to where to start diagnosing the problem
>
>
>
> Caused by: java.lang.NullPointerException
>  at
> org.apache.hadoop.io.compress.BZip2Codec$BZip2CompressionOutputStream.write(BZip2Codec.java:200)
>  at
> org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:41)
>  at java.io.DataOutputStream.writeByte(DataOutputStream.java:136)
>  at org.apache.hadoop.io.WritableUtils.writeVLong(WritableUtils.java:263)
>  at org.apache.hadoop.io.WritableUtils.writeVInt(WritableUtils.java:243)
>  at org.apache.hadoop.mapred.IFile$Writer.close(IFile.java:126)
>  at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1242)
>  at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.access$1800(MapTask.java:648)
>  at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer$SpillThread.run(MapTask.java:1135)
>
>
--
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB