Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # dev >> Block emulation on local FS


Copy link to this message
-
Re: Block emulation on local FS
Hi,

On Thu, Dec 20, 2012 at 2:14 AM, Hans Uhlig <[EMAIL PROTECTED]> wrote:
> Is there a good way to emulate or determine the blocks that would exist on
> HDFS for a given file. if I have a 135mb file and my block size is 128,
> does it stand to say I would have 2 blocks, block A is byte 0-134217728 and
> Block b is 134217729-141557761 deterministically?

Yes, blocks are split exactly at the specified block boundary.

--
Harsh J
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB