Kafka, mail # user - Re: Using Kafka for "data" messages - 2013-06-14, 12:44
 Search Hadoop and all its subprojects:

Switch to Plain View
+
Josh Foure 2013-06-13, 15:22
+
Taylor Gautier 2013-06-13, 15:40
+
Mahendra M 2013-06-13, 16:56
+
Josh Foure 2013-06-13, 17:48
+
Timothy Chen 2013-06-13, 18:14
+
Josh Foure 2013-06-13, 19:13
+
Taylor Gautier 2013-06-13, 20:19
+
Mahendra M 2013-06-14, 12:03
Copy link to this message
-
Re: Using Kafka for "data" messages
Hi there,

I'm very new to Kafka but am also keen on this use case.

Is the number of topics just limited to the underlying filesystems constraints on number of files in 1 directory? There are other filesystems out there that have practical limits in the range of millions (though programs like 'ls' don't appreciate this).

I'm wondering if Kafka internally will hit another constraint due to the data structure it might be using to manage topics. Not that I have any idea what this is - again, I'm new here.

Thanks for the fun conversation :)

Cheers,

Archie

On Jun 13, 2013, at 4:18 PM, Taylor Gautier <[EMAIL PROTECTED]> wrote:
 
+
Josh Foure 2013-06-15, 03:28
+
Milind Parikh 2013-06-15, 21:10
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB