Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> DFSClient error


Copy link to this message
-
Re: DFSClient error
On Thu, Apr 26, 2012 at 10:24 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> Is only the same IP printed in all such messages? Can you check the DN
> log in that machine to see if it reports any form of issues?
>
> All IPs were logged with this message
> Also, did your jobs fail or kept going despite these hiccups? I notice
> you're threading your clients though (?), but I can't tell if that may
> cause this without further information.
>
> It started with this error message and slowly all the jobs died with
"shortRead" errors.
I am not sure about threading. I am using pig script to read .gz file
> On Fri, Apr 27, 2012 at 5:19 AM, Mohit Anchlia <[EMAIL PROTECTED]>
> wrote:
> > I had 20 mappers in parallel reading 20 gz files and each file around
> > 30-40MB data over 5 hadoop nodes and then writing to the analytics
> > database. Almost midway it started to get this error:
> >
> >
> > 2012-04-26 16:13:53,723 [Thread-8] INFO org.apache.hadoop.hdfs.DFSClient
> -
> > Exception in createBlockOutputStream
> > 17.18.62.192:50010java.io.IOException: Bad connect ack with
>  > firstBadLink as
> > 17.18.62.191:50010
> >
> > I am trying to look at the logs but doesn't say much. What could be the
> > reason? We are in pretty closed reliable network and all machines are up.
>
>
>
> --
> Harsh J
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB