Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Error: Unable to create input splits


Copy link to this message
-
RE: Error: Unable to create input splits
LZO is not supported out of the box in Hadoop 0.20.2 In order to enable LZO on Hadoop, you can follow the instructions at:

http://code.google.com/p/hadoop-gpl-compression/wiki/FAQ

Santhosh

-----Original Message-----
From: Saurav Datta [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, September 01, 2010 12:41 PM
To: [EMAIL PROTECTED]
Subject: Error: Unable to create input splits

Hi ,

I am getting the below error while running a pig script :
"ERROR 6017: org.apache.pig.backend.executionengine.ExecException:  
ERROR 2118: Unable to create input splits for: hdfs://localhost:9000"

Going by the below URL , it appears to be related to compression codec for LZO .
http://mail-archives.apache.org/mod_mbox/hadoop-pig-user/201008.mbox/%[EMAIL PROTECTED]%3E

Any suggestions on how to resolve this ?

I am using Pig 0.7.0 , with Hadoop 0.20.2  on a Mac OS X 10.6.3 box.

Regards,
Saurav

Below is the content of the log file :

Pig Stack Trace
---------------
ERROR 6017: org.apache.pig.backend.executionengine.ExecException:  
ERROR 2118: Unable to create input splits for: hdfs://localhost:9000/ user/rahulmalviya/main_merged_File_20100804.dat.completed

org.apache.pig.backend.executionengine.ExecException: ERROR 6017:  
org.apache.pig.backend.executionengine.ExecException: ERROR 2118:  
Unable to create input splits for: hdfs://localhost:9000/user/ rahulmalviya/main_merged_File_20100804.dat.completed
at
org
.apache
.pig
.backend
.hadoop
.executionengine
.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:227)
at
org
.apache
.pig
.backend
.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:
308)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:
835)
at org.apache.pig.PigServer.execute(PigServer.java:828)
at org.apache.pig.PigServer.access$100(PigServer.java:105)
at org.apache.pig.PigServer$Graph.execute(PigServer.java:1080)
at org.apache.pig.PigServer.executeBatch(PigServer.java:288)
at
org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:
109)
at
org
.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:
166)
at
org
.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:
138)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
at org.apache.pig.Main.main(Main.java:391)
=======================================================================
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB