Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Data Locality and WebHDFS


Copy link to this message
-
Re: Data Locality and WebHDFS
The file offset is considered in WebHDFS redirection.  It redirects to a datanode with the first block the client going to read, not the first block of the file.

Hope it helps.
Tsz-Wo

On Monday, March 17, 2014 10:09 AM, Alejandro Abdelnur <[EMAIL PROTECTED]> wrote:
 
actually, i am wrong, the webhdfs rest call has an offset. 
are redirected to the corresponding datanodes. It uses the full
bandwidth of the Hadoop cluster for streaming data.
built-in component of HDFS. It runs inside Namenodes and Datanodes,
therefore, it can use all HDFS functionalities. It is a part of HDFS –
there are no additional servers to install
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB