Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Re: Basic Doubt in Hadoop


Copy link to this message
-
Re: Basic Doubt in Hadoop
The data is in HDFS in case of WordCount MR sample.

In hdfs, you have the metadata in NameNode and actual data as blocks replicated across DataNodes.

In case of reducer, If a reducer is running on a particular node then you have one replica of the blocks in the same node (If there is no space issues) and rest replicas on other nodes.
Regards
Bejoy KS

Sent from remote device, Please excuse typos

-----Original Message-----
From: Raj Hadoop <[EMAIL PROTECTED]>
Date: Tue, 16 Apr 2013 21:49:34
To: [EMAIL PROTECTED]<[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Basic Doubt in Hadoop

Hi,

I am new to Hadoop. I started reading the standard Wordcount program. I got this basic doubt in Hadoop.

After the Map - Reduce is done, where is the output generated?  Does the reducer ouput sit on individual DataNodes ? Please advise.

Thanks,
Raj

+
maisnam ns 2013-04-17, 09:06
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB