Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> hadoop-consumer code in contrib package


Copy link to this message
-
hadoop-consumer code in contrib package
Hi,

I am trying to use the code supplied in hadoop-consumer package. I am
running into following issues:

1) This code is using SimpleConsumer which is actually contacting Kafka
Broker without Zookeeper. Because of which messages are not getting cleared
from broker.
And i am getting duplicate messages in each run.

2) The retention policy specified as log.retention.hours in
server.properties is not working. Not sure if its due to SimpleConsumer.

Is it expected behaviour. Is there any code using high level consumer for
same work?

Thanks,
Navneet Sharma

 
+
Felix GV 2013-01-14, 22:43
+
navneet sharma 2013-01-15, 17:06
+
Felix GV 2013-01-15, 18:17
+
navneet sharma 2013-01-17, 00:41
+
Jun Rao 2013-01-17, 05:12
+
navneet sharma 2013-01-17, 14:21
+
Jun Rao 2013-01-17, 15:29