Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Set<IntWritable> on reducer issue


Copy link to this message
-
Re: Set<IntWritable> on reducer issue
See
http://cornercases.wordpress.com/2011/08/18/hadoop-object-reuse-pitfall-all-my-reducer-values-are-the-same/for
an explanation of what's going on.

Paul
On 8 May 2013 16:10, Thamizhannal Paramasivam <[EMAIL PROTECTED]>wrote:

> Hi,
> I require clarification on using IntWritable in Set type in Java.
> Below is my sample code. When I execute reducer with E.x. key="abcd"
> values=12,3,4, then categorySet have any one value from values.
>
> My hadoop version is 0.20.2. Any help would be appreciated.
>
>         public void reduce(Text key, Iterable<IntWritable> values,
>                 Context context) throws IOException, InterruptedException {
>
>              Set<IntWritable> categorySet = new TreeSet<IntWritable>();
>              for (IntWritable val : values) {
>                  categorySet.add(val);
>              }
>             ----------------
>             ----------------
>     }
>
> Thanks,
> Thamizh
>