Kafka, mail # user - Re: Using Kafka for "data" messages - 2013-06-14, 12:44
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
Re: Using Kafka for "data" messages
Hi there,

I'm very new to Kafka but am also keen on this use case.

Is the number of topics just limited to the underlying filesystems constraints on number of files in 1 directory? There are other filesystems out there that have practical limits in the range of millions (though programs like 'ls' don't appreciate this).

I'm wondering if Kafka internally will hit another constraint due to the data structure it might be using to manage topics. Not that I have any idea what this is - again, I'm new here.

Thanks for the fun conversation :)



On Jun 13, 2013, at 4:18 PM, Taylor Gautier <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB