Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> HDFs file-create performance


Copy link to this message
-
Re: HDFs file-create performance
Small file creation is a well-documented major problem (and bottleneck) in
HDFS.  You can either roll your own protocol, or use MapR which is about
100x faster and 1000x scalable than HDFS for this particular problem.