Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> HDFs file-create performance

Copy link to this message
Re: HDFs file-create performance
Small file creation is a well-documented major problem (and bottleneck) in
HDFS.  You can either roll your own protocol, or use MapR which is about
100x faster and 1000x scalable than HDFS for this particular problem.