Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Set<IntWritable> on reducer issue


Copy link to this message
-
Re: Set<IntWritable> on reducer issue
See
http://cornercases.wordpress.com/2011/08/18/hadoop-object-reuse-pitfall-all-my-reducer-values-are-the-same/for
an explanation of what's going on.

Paul
On 8 May 2013 16:10, Thamizhannal Paramasivam <[EMAIL PROTECTED]>wrote:

> Hi,
> I require clarification on using IntWritable in Set type in Java.
> Below is my sample code. When I execute reducer with E.x. key="abcd"
> values=12,3,4, then categorySet have any one value from values.
>
> My hadoop version is 0.20.2. Any help would be appreciated.
>
>         public void reduce(Text key, Iterable<IntWritable> values,
>                 Context context) throws IOException, InterruptedException {
>
>              Set<IntWritable> categorySet = new TreeSet<IntWritable>();
>              for (IntWritable val : values) {
>                  categorySet.add(val);
>              }
>             ----------------
>             ----------------
>     }
>
> Thanks,
> Thamizh
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB