Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Hadoop I/O buffer size

Copy link to this message
Hadoop I/O buffer size
Hi guys,

   Need help figuring out Hadoop I/O buffer size. This link:
implies that
*io.file.buffersize* is 4K or 64K which makes me wonder. Is that the buffer
which gets filled with records from disk when I have the following in code:

*While( reader.next(Key,Value)) ;  ? *

If yes, when I change io.file.buffersize = 64M will that fetch 64MB of
records into memory when I do "reader.next" ?

if no, then how many records are fetched when I do one
"reader.next(key,value)" ?

Thank you,