Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> CombineFileInputFormat


+
Stan Rosenberg 2012-04-09, 21:25
+
Deepak Nettem 2012-04-09, 21:29
Copy link to this message
-
Re: CombineFileInputFormat
On Mon, Apr 9, 2012 at 5:29 PM, Deepak Nettem <[EMAIL PROTECTED]> wrote:
> Hi Stan,
>
> Just out of curiosity, care to explain the use case a bit?
>

Very simply: lots of reasonably small files which I can't control,
i.e., changing block size is not an option.  Note that this is not an
issue in pig or hive, both of which
come with their own implementation of CombineFileInputFormat.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB