Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # dev - specific implementations of CombineFileInputFormat


Copy link to this message
-
specific implementations of CombineFileInputFormat
Sangjin Lee 2013-03-07, 21:05
My apologies if this has already been discussed in the past (couldn't find
any discussion threads on Google).

CombineFileInputFormat is abstract, and its specific equivalents to
TextInputFormat, SequenceFileInputFormat, etc. are currently not in the
hadoop code base. Is there a reason why these specific classes are not part
of hadoop-mapreduce-client-core?

To me these sound like very common need whenever CombineFileInputFormat is
used, and different folks would write the same code over and over to
achieve the same goal. It sounds very natural for hadoop to provide at
least the text and sequence file implementations of the
CombineFileInputFormat class. Thoughts?

Thanks,
Sangjin