Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # dev >> Backoff returned from HDFSEventSink after IOException


Copy link to this message
-
Re: Backoff returned from HDFSEventSink after IOException
Hi,

I am not an expert in the FailoverSinkProcessor but this sounds like a
bug to me. Can you file a jira?

Brock

On Tue, Dec 11, 2012 at 7:22 AM, Jaroslaw Grabowski
<[EMAIL PROTECTED]> wrote:
> Hello,
>
> could sameone please tell me why HDFSEventSink returns Status.BACKOFF in
> case of IOException? Because of this implementation, FailoverSinkProcessor
> will never push event to next sink in case of any hdfs failure.
>
> Another thing is that BucketWriters should be removed from sfWriters map
> after IOException, can anyone please confirm that?
>
> --
> Regards,
> J. Grabowski

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB