Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> What is "emptyFile" doing in my input splits?


Copy link to this message
-
What is "emptyFile" doing in my input splits?
Following up my previous email about my SerDe not working when it
encounters Text it should be encountering, I noticed a difference in the
input splits of tasks where the SerdeFailed and those where it succeeds:
the failure cases have this mysterious "emptyFile".

How can I make emptyFile take a hike?

2013-03-11 23:43:48,859 [main] INFO  org.apache.hadoop.mapred.MapTask
- Processing split:
Paths:/tmp/hive-jkebinger/hive_2013-03-11_23-42-25_244_3654276131716185808/-mr-10002/3/emptyFile:0+87,/kir/externalblogs-prod/protos/2013/03/10/1362878283500-1-0:0+499,
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB