Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Re: Cannot write the output of the reducer to a sequence file


Copy link to this message
-
Re: Cannot write the output of the reducer to a sequence file
Hi,

Can you explain the problem you actually face in trying to run the
above setup? Do you also set your reducer output types?

On Mon, Jul 29, 2013 at 4:48 PM, Pavan Sudheendra <[EMAIL PROTECTED]> wrote:
> I have a Map function and a Reduce funtion outputting kep-value pairs
> of class Text and IntWritable.. This is just the gist of the Map part
> in the Main function :
>
> TableMapReduceUtil.initTableMapperJob(
>   tablename,        // input HBase table name
>   scan,             // Scan instance to control CF and attribute selection
>   AnalyzeMapper.class,   // mapper
>   Text.class,             // mapper output key
>   IntWritable.class,             // mapper output value
>   job);
>
> And here's my Reducer part in the Main function which writes the output to HDFS
>
> job.setReducerClass(AnalyzeReducerFile.class);
> job.setNumReduceTasks(1);
> FileOutputFormat.setOutputPath(job, new
> Path("hdfs://localhost:54310/output_file"));
>
> How do i make the reducer write to a Sequence File instead?
>
> I've tried the following code but doesn't work
>
> job.setReducerClass(AnalyzeReducerFile.class);
> job.setNumReduceTasks(1);
> job.setOutputFormatClass(SequenceFileOutputFormat.class);
> SequenceFileOutputFormat.setOutputPath(job, new
> Path("hdfs://localhost:54310/sequenceOutput"));
>
> Any help appreciated!
>
>
>
>
> --
> Regards-
> Pavan

--
Harsh J