Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Avro, mail # user -


Copy link to this message
-
Re:
Sean Busbey 2014-03-17, 20:18
Hi Shaq!

Could you describe your use case in more detail?

Generally, HDFS will behave poorly in the face of many small files. Could
you perhaps colocate several data in one file? This will help both with the
relative overhead of the schema and the pressure on the HDFS NameNode.

-Sean
On Mon, Mar 17, 2014 at 2:55 PM, Salman Haq <[EMAIL PROTECTED]>wrote: