Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> reducers outputs


Copy link to this message
-
Re: reducers outputs
The NameNode doesn't care how you wrote the file i.e. either via 'bin/hadoop dfs -put <>' or via a MR job.

Arun

On Jan 29, 2012, at 10:09 PM, aliyeh saeedi wrote:

> I studied it, but I could not get the point. I mean if I save reducer's output with my own selected names, does NameNode behave with them like other files?
> regards.
>
> From: Ashwanth Kumar <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]; aliyeh saeedi <[EMAIL PROTECTED]>
> Sent: Monday, 30 January 2012, 9:25
> Subject: Re: Fw: reducers outputs
>
> You should have a look at this -  http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapred/FileOutputFormat.html
>
>  - Ashwanth Kumar
>
> On Mon, Jan 30, 2012 at 11:17 AM, aliyeh saeedi <[EMAIL PROTECTED]> wrote:
>
>
>
> I want to save them with my own names, How NameNode will keep their names?
>
> From: Joey Echeverria <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]; aliyeh saeedi <[EMAIL PROTECTED]>
> Sent: Sunday, 29 January 2012, 17:10
> Subject: Re: reducers outputs
>
> Reduce output is normally stored in HDFS, just like your other files.
> Are you seeing different behavior?
>
> -Joey
>
> On Sun, Jan 29, 2012 at 1:05 AM, aliyeh saeedi <[EMAIL PROTECTED]> wrote:
> > Hi
> > I want to save reducers outputs like other files in Hadoop. Does NameNode
> > keep any information about them? How can I do this?
> > Or can I add a new component to Hadoop like NameNode and make JobTracker to
> > consult with it too (I mean I want to make JobTracker to consult with
> > NameNode AND myNewComponent both)?
>
>
>
> --
> Joseph Echeverria
> Cloudera, Inc.
> 443.305.9434
>
>
>
>
>
>
>

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB