Home | About | Sematext search-lucene.com search-hadoop.com search-devops.com metrics + logs = try SPM and Logsene for free
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> producer creating multiple log files after message sending


+
Snehalata Nagaje 2013-04-17, 07:06
+
Neha Narkhede 2013-04-17, 15:38
+
Snehalata Nagaje 2013-04-18, 06:11
Copy link to this message
-
RE: producer creating multiple log files after message sending
Hi Neha,

I was able to figure this out, this is happening due to time based rolling.

But now problem, when I fetch the messages for particular topic, server is
reading only one log file, returns those messages only.

Is there any way I can combine all log files which are already produced into
one, so that I can get all messages posted in that topic.

Thanks,
Snehalata
+
Swapnil Ghike 2013-04-18, 09:43
+
Jason Huang 2013-04-18, 13:07
+
Neha Narkhede 2013-04-18, 15:26
+
Jason Huang 2013-04-18, 15:37
+
Jay Kreps 2013-04-18, 16:20
+
Jason Huang 2013-04-18, 16:36
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB