Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # dev >> Handling EOFexception while splitlog


+
Ramkrishna.S.Vasudevan 2012-02-21, 14:52
Copy link to this message
-
Re: Handling EOFexception while splitlog
Can you provide stack trace for this issue ?

Thanks

On Feb 21, 2012, at 8:52 AM, "Ramkrishna.S.Vasudevan" <[EMAIL PROTECTED]> wrote:

> Hi Devs
>
>
>
> We ran into one issue while splitting HLogs due to EOFException. (0.90.6
> version).
>
>
>
> Due to some reason the DNs were not able to connect to NN (network
> fluctuation) and the master was splitting the logs.
>
> While parsing the hlog, we get  the length and we expect it might be 0. (No
> problem here).
>
>
>
> But in this scenario the DFSClient throws an EOFException as all DNs are not
> able to connect to NN and due to that the while reading we get an
> EOFException.
>
>
>
> In this specific case we just return and the master considers the split to
> be successful.  This leads to data loss.
>
>
>
> May be  this can be fixed from HDFS side, I would like to know can we throw
> an IOException in this case and make the split log to be retried as we have
> a retry logic now.
>
>
>
> I was going through HBASE-2643 as part of which EOFException was handled and
> dint find this scenario in that.
>
> Please provide your suggestions.
>
>
>
> Regards
>
> Ram
>
+
Ramkrishna.S.Vasudevan 2012-02-21, 15:44
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB