Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: Block size


Copy link to this message
-
Re: Block size
Yes it can. It is a configurable property. The exact name might differ
depending on the version though.
Read the details here:
https://hadoop.apache.org/docs/current2/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml

http://books.google.com/books?id=H3mvcxPeUfwC&pg=PA183&lpg=PA183&dq=change+hadoop+default+block+size&source=bl&ots=pXxPwd2Hv8&sig=xbcUaJ10zOkLqOPw4u35ZTRPCVc&hl=en&sa=X&ei=gujGUs-eK4ulsASMi4GIDw&ved=0CFYQ6AEwAw#v=onepage&q=change%20hadoop%20default%20block%20size&f=false

You can do it programmatically as well.
http://stackoverflow.com/questions/2669800/changing-the-block-size-of-a-dfs-file-in-hadoop

Changing for an existing file:
http://stackoverflow.com/questions/7320625/how-to-dynamic-change-existing-files-block-size-in-hadoop

Regards,
Shahab
On Fri, Jan 3, 2014 at 11:37 AM, Kurt Moesky <[EMAIL PROTECTED]> wrote:

> I see the default block size for HDFS is 64 MB, is this a value that can
> be changed easily?
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB