-
What is "emptyFile" doing in my input splits?James Kebinger 2013-03-12, 03:52
Following up my previous email about my SerDe not working when it
encounters Text it should be encountering, I noticed a difference in the
input splits of tasks where the SerdeFailed and those where it succeeds:
the failure cases have this mysterious "emptyFile".
How can I make emptyFile take a hike?
2013-03-11 23:43:48,859 [main] INFO org.apache.hadoop.mapred.MapTask
- Processing split:
Paths:/tmp/hive-jkebinger/hive_2013-03-11_23-42-25_244_3654276131716185808/-mr-10002/3/emptyFile:0+87,/kir/externalblogs-prod/protos/2013/03/10/1362878283500-1-0:0+499,
encounters Text it should be encountering, I noticed a difference in the
input splits of tasks where the SerdeFailed and those where it succeeds:
the failure cases have this mysterious "emptyFile".
How can I make emptyFile take a hike?
2013-03-11 23:43:48,859 [main] INFO org.apache.hadoop.mapred.MapTask
- Processing split:
Paths:/tmp/hive-jkebinger/hive_2013-03-11_23-42-25_244_3654276131716185808/-mr-10002/3/emptyFile:0+87,/kir/externalblogs-prod/protos/2013/03/10/1362878283500-1-0:0+499,
