Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - producer creating multiple log files after message sending


Copy link to this message
-
producer creating multiple log files after message sending
Snehalata Nagaje 2013-04-17, 07:06
Hi,

 

I am using kafak 0.8 version and sending messages to kafka server using
below code,

 

Producer<Integer, String> producer = new Producer<Integer, String>(new
ProducerConfig(props));

producer.send(new KeyedMessage(topicName,partitionKey,jsonString));

producer.close();

 

I am able to post messages with, but after certain days, kafka creating
multiple log files, messages are posted in new log file, although old file
size is very less.

 

What can be the reason for creating multiple log files? Does message format
matters while sending message to kafka?

 

Thanks,

Snehalata
Disclaimer:
This e-mail may contain Privileged/Confidential information and is intended only for the individual(s) named. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. Please notify the sender, if you have received this e-mail by mistake and delete it from your system. Information in this message that does not relate to the official business of the company shall be understood as neither given nor endorsed by it. E-mail transmission cannot be guaranteed to be secure or error-free. The sender does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. If verification is required please request a hard-copy version. Visit us at http://www.harbingergroup.com/

 
+
Neha Narkhede 2013-04-17, 15:38
+
Snehalata Nagaje 2013-04-18, 06:11
+
Snehalata Nagaje 2013-04-18, 08:53
+
Jason Huang 2013-04-18, 13:07
+
Neha Narkhede 2013-04-18, 15:26
+
Jason Huang 2013-04-18, 15:37
+
Jay Kreps 2013-04-18, 16:20
+
Jason Huang 2013-04-18, 16:36