Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Kafka for passing large documents


Copy link to this message
-
Kafka for passing large documents
Hi,

We're considering using Kafka for transport of potentially large "documents" (think documents for full-text indexing, docs that can be as small as tweets or as large as PDF files, say 5MB).

I'm wondering if Kafka is suitable for transporting potentially large documents or if there is something inherent in Kafka that makes it a poor choice for this use case?

Thanks,
Otis
----
Performance Monitoring for Solr / ElasticSearch / HBase - http://sematext.com/spmĀ 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB