|
|
-
Writing out a single file
Mark 2011-07-05, 15:09
Is there anyway I can write out the results of my mapreduce job into 1 local file... ie the opposite of getmerge?
Thanks
-
Re: Writing out a single file
John Armstrong 2011-07-05, 15:17
On Tue, 05 Jul 2011 08:09:16 -0700, Mark <[EMAIL PROTECTED]> wrote: > Is there anyway I can write out the results of my mapreduce job into 1 > local file... ie the opposite of getmerge?
I don't know about writing directly to the local filesystem, but if you specify a single reducer you should get only one output file, which your Tool can then copy to the local filesystem wherever you want it.
-
Re: Writing out a single file
James Seigel 2011-07-05, 15:22
Single reducer.
On 2011-07-05, at 9:09 AM, Mark wrote:
> Is there anyway I can write out the results of my mapreduce job into 1 local file... ie the opposite of getmerge? > > Thanks
-
Re: Writing out a single file
madhu phatak 2011-07-27, 10:56
Always Map/Reduce jobs write to the HDFS. So you can use FS.copyToLocalFile API to copy the result into local systems
On Tue, Jul 5, 2011 at 8:52 PM, James Seigel <[EMAIL PROTECTED]> wrote:
> Single reducer. > > On 2011-07-05, at 9:09 AM, Mark wrote: > > > Is there anyway I can write out the results of my mapreduce job into 1 > local file... ie the opposite of getmerge? > > > > Thanks > >
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext