Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> reducers outputs


Copy link to this message
-
Re: reducers outputs
The NameNode doesn't care how you wrote the file i.e. either via 'bin/hadoop dfs -put <>' or via a MR job.

Arun

On Jan 29, 2012, at 10:09 PM, aliyeh saeedi wrote:

> I studied it, but I could not get the point. I mean if I save reducer's output with my own selected names, does NameNode behave with them like other files?
> regards.
>
> From: Ashwanth Kumar <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]; aliyeh saeedi <[EMAIL PROTECTED]>
> Sent: Monday, 30 January 2012, 9:25
> Subject: Re: Fw: reducers outputs
>
> You should have a look at this -  http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapred/FileOutputFormat.html
>
>  - Ashwanth Kumar
>
> On Mon, Jan 30, 2012 at 11:17 AM, aliyeh saeedi <[EMAIL PROTECTED]> wrote:
>
>
>
> I want to save them with my own names, How NameNode will keep their names?
>
> From: Joey Echeverria <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]; aliyeh saeedi <[EMAIL PROTECTED]>
> Sent: Sunday, 29 January 2012, 17:10
> Subject: Re: reducers outputs
>
> Reduce output is normally stored in HDFS, just like your other files.
> Are you seeing different behavior?
>
> -Joey
>
> On Sun, Jan 29, 2012 at 1:05 AM, aliyeh saeedi <[EMAIL PROTECTED]> wrote:
> > Hi
> > I want to save reducers outputs like other files in Hadoop. Does NameNode
> > keep any information about them? How can I do this?
> > Or can I add a new component to Hadoop like NameNode and make JobTracker to
> > consult with it too (I mean I want to make JobTracker to consult with
> > NameNode AND myNewComponent both)?
>
>
>
> --
> Joseph Echeverria
> Cloudera, Inc.
> 443.305.9434
>
>
>
>
>
>
>

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/