Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # dev - Tablesplit.getLength returns 0

Copy link to this message
Re: Tablesplit.getLength returns 0
Nick Dimiduk 2014-01-30, 17:15
Sounds good, I'll watch for your patch!

On Thursday, January 30, 2014, Lukas Nalezenec <

> I talked with guy who worked on this and he said our production issue was
> probably not directly caused by getLength() returning 0.
> Anyway, we are interested in fixing that, estimating length from files is
> good idea.
> Lukas
>  InputSplit.getLength() and RecordReader.getProgress() is important for the
>> MR framework to be able to show progress etc. It would be good to return
>> raw data sizes in getLength() computed from region's total size of store
>> files, and progress being calculated from scanner's amount of raw data
>> seen.
> Enis