Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - DFSClient error


Copy link to this message
-
Re: DFSClient error
Mohit Anchlia 2012-04-27, 14:50
On Thu, Apr 26, 2012 at 10:24 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> Is only the same IP printed in all such messages? Can you check the DN
> log in that machine to see if it reports any form of issues?
>
> All IPs were logged with this message
> Also, did your jobs fail or kept going despite these hiccups? I notice
> you're threading your clients though (?), but I can't tell if that may
> cause this without further information.
>
> It started with this error message and slowly all the jobs died with
"shortRead" errors.
I am not sure about threading. I am using pig script to read .gz file
> On Fri, Apr 27, 2012 at 5:19 AM, Mohit Anchlia <[EMAIL PROTECTED]>
> wrote:
> > I had 20 mappers in parallel reading 20 gz files and each file around
> > 30-40MB data over 5 hadoop nodes and then writing to the analytics
> > database. Almost midway it started to get this error:
> >
> >
> > 2012-04-26 16:13:53,723 [Thread-8] INFO org.apache.hadoop.hdfs.DFSClient
> -
> > Exception in createBlockOutputStream
> > 17.18.62.192:50010java.io.IOException: Bad connect ack with
>  > firstBadLink as
> > 17.18.62.191:50010
> >
> > I am trying to look at the logs but doesn't say much. What could be the
> > reason? We are in pretty closed reliable network and all machines are up.
>
>
>
> --
> Harsh J
>