Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Re: Block size


Copy link to this message
-
Re: Block size
Shahab Yunus 2014-01-03, 16:45
Yes it can. It is a configurable property. The exact name might differ
depending on the version though.
Read the details here:
https://hadoop.apache.org/docs/current2/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml

http://books.google.com/books?id=H3mvcxPeUfwC&pg=PA183&lpg=PA183&dq=change+hadoop+default+block+size&source=bl&ots=pXxPwd2Hv8&sig=xbcUaJ10zOkLqOPw4u35ZTRPCVc&hl=en&sa=X&ei=gujGUs-eK4ulsASMi4GIDw&ved=0CFYQ6AEwAw#v=onepage&q=change%20hadoop%20default%20block%20size&f=false

You can do it programmatically as well.
http://stackoverflow.com/questions/2669800/changing-the-block-size-of-a-dfs-file-in-hadoop

Changing for an existing file:
http://stackoverflow.com/questions/7320625/how-to-dynamic-change-existing-files-block-size-in-hadoop

Regards,
Shahab
On Fri, Jan 3, 2014 at 11:37 AM, Kurt Moesky <[EMAIL PROTECTED]> wrote:

> I see the default block size for HDFS is 64 MB, is this a value that can
> be changed easily?
>