Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> help in learning hadoop

Copy link to this message
RE: help in learning hadoop
In HDFS file will will be devided based on dfs.blocksize configuration.
You can see the code at DFSClient where the client will write the block of data. You can post it to [EMAIL PROTECTED] to get moredetails from mapreduce as well.
In mapreduce, tasktrackers will run on each DN machines. Job tracker will assign the work to them. They will read the blocks and process.

I would suggest you to read Hadoop definitive guide to get more understanding of the system.

From: Hadoop Sai [[EMAIL PROTECTED]]
Sent: Thursday, November 24, 2011 10:28 PM
Subject: help in learning hadoop

How the file will be divided into blocks and how the map reduce read those
blocks of data .Can anyone can point out this piece of code.