Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Data Locality and WebHDFS


Copy link to this message
-
Re: Data Locality and WebHDFS
The file offset is considered in WebHDFS redirection.  It redirects to a datanode with the first block the client going to read, not the first block of the file.

Hope it helps.
Tsz-Wo

On Monday, March 17, 2014 10:09 AM, Alejandro Abdelnur <[EMAIL PROTECTED]> wrote:
 
actually, i am wrong, the webhdfs rest call has an offset. 
are redirected to the corresponding datanodes. It uses the full
bandwidth of the Hadoop cluster for streaming data.
built-in component of HDFS. It runs inside Namenodes and Datanodes,
therefore, it can use all HDFS functionalities. It is a part of HDFS –
there are no additional servers to install