Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> What is "emptyFile" doing in my input splits?


Copy link to this message
-
What is "emptyFile" doing in my input splits?
Following up my previous email about my SerDe not working when it
encounters Text it should be encountering, I noticed a difference in the
input splits of tasks where the SerdeFailed and those where it succeeds:
the failure cases have this mysterious "emptyFile".

How can I make emptyFile take a hike?

2013-03-11 23:43:48,859 [main] INFO  org.apache.hadoop.mapred.MapTask
- Processing split:
Paths:/tmp/hive-jkebinger/hive_2013-03-11_23-42-25_244_3654276131716185808/-mr-10002/3/emptyFile:0+87,/kir/externalblogs-prod/protos/2013/03/10/1362878283500-1-0:0+499,