Home | About | Sematext search-lucene.com search-hadoop.com search-devops.com metrics + logs = try SPM and Logsene for free
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> hadoop-consumer code in contrib package


+
navneet sharma 2013-01-14, 18:35
+
Felix GV 2013-01-14, 22:43
+
navneet sharma 2013-01-15, 17:06
+
Felix GV 2013-01-15, 18:17
+
navneet sharma 2013-01-17, 00:41
Copy link to this message
-
Re: hadoop-consumer code in contrib package
I think the main reason for using SimpleConsumer is to manage offsets
explicitly. For example, this is useful when Hadoop retries failed tasks.
Another reason is that Hadoop already does load balancing. So, there is not
much need to balance the load again using the high level consumer.

Thanks,

Jun

On Wed, Jan 16, 2013 at 4:40 PM, navneet sharma <[EMAIL PROTECTED]
 
+
navneet sharma 2013-01-17, 14:21
+
Jun Rao 2013-01-17, 15:29
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB