Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> ArrayIndexOutOfBoundsException occurs from MapTask


Copy link to this message
-
Re: ArrayIndexOutOfBoundsException occurs from MapTask
Thanks for your information!

However, if so, it should be a Hadoop bug, because there is no restrictions
on setting the value to "mapreduce.task.io.sort.mb"
2013/9/12 Brahma Reddy Battula <[EMAIL PROTECTED]>

>  I had also faced same issue, after chnaging "*mapreduce.task.io.sort.mb*"
> from 2047 to 512, then jobs are executed success
>
>
>
> It might help in your case also..
>
>
>
> ------------------------------
>
>  *From:* sam liu [[EMAIL PROTECTED]]
> *Sent:* Thursday, September 12, 2013 9:37 AM
> *To:* [EMAIL PROTECTED]
> *Subject:* ArrayIndexOutOfBoundsException occurs from MapTask
>
>   Hi,
>
>  We are using Hadoop-1.1.1. When run a big workload mapreduce
> application, it threw a ArrayIndexOutOfBoundsException as below. Seems the
> issue was threw in line 'System.arraycopy(b, off, kvbuffer, bufindex,
> gaplen);' in MapTask. I am not familiar with the code of MapTask.java, and
> want to know which situations will cause this kind of exception?
>
> Caused by: java.lang.ArrayIndexOutOfBoundsException
>         at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer$Buffer.write(MapTask.java:1270)
>         at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer$Buffer.write(MapTask.java:1193)
>         at java.io.DataOutputStream.write(DataOutputStream.java:82)
>         at java.io.DataOutputStream.writeInt(DataOutputStream.java:191)
>
>  Thanks!
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB