Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # dev - Handling EOFexception while splitlog


+
Ramkrishna.S.Vasudevan 2012-02-21, 14:52
Copy link to this message
-
Re: Handling EOFexception while splitlog
yuzhihong@... 2012-02-21, 15:08
Can you provide stack trace for this issue ?

Thanks

On Feb 21, 2012, at 8:52 AM, "Ramkrishna.S.Vasudevan" <[EMAIL PROTECTED]> wrote:

> Hi Devs
>
>
>
> We ran into one issue while splitting HLogs due to EOFException. (0.90.6
> version).
>
>
>
> Due to some reason the DNs were not able to connect to NN (network
> fluctuation) and the master was splitting the logs.
>
> While parsing the hlog, we get  the length and we expect it might be 0. (No
> problem here).
>
>
>
> But in this scenario the DFSClient throws an EOFException as all DNs are not
> able to connect to NN and due to that the while reading we get an
> EOFException.
>
>
>
> In this specific case we just return and the master considers the split to
> be successful.  This leads to data loss.
>
>
>
> May be  this can be fixed from HDFS side, I would like to know can we throw
> an IOException in this case and make the split log to be retried as we have
> a retry logic now.
>
>
>
> I was going through HBASE-2643 as part of which EOFException was handled and
> dint find this scenario in that.
>
> Please provide your suggestions.
>
>
>
> Regards
>
> Ram
>
+
Ramkrishna.S.Vasudevan 2012-02-21, 15:44