Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Error: Unable to create input splits


Copy link to this message
-
RE: Error: Unable to create input splits
Santhosh Srinivasan 2010-09-01, 20:07
LZO is not supported out of the box in Hadoop 0.20.2 In order to enable LZO on Hadoop, you can follow the instructions at:

http://code.google.com/p/hadoop-gpl-compression/wiki/FAQ

Santhosh

-----Original Message-----
From: Saurav Datta [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, September 01, 2010 12:41 PM
To: [EMAIL PROTECTED]
Subject: Error: Unable to create input splits

Hi ,

I am getting the below error while running a pig script :
"ERROR 6017: org.apache.pig.backend.executionengine.ExecException:  
ERROR 2118: Unable to create input splits for: hdfs://localhost:9000"

Going by the below URL , it appears to be related to compression codec for LZO .
http://mail-archives.apache.org/mod_mbox/hadoop-pig-user/201008.mbox/%[EMAIL PROTECTED]%3E

Any suggestions on how to resolve this ?

I am using Pig 0.7.0 , with Hadoop 0.20.2  on a Mac OS X 10.6.3 box.

Regards,
Saurav

Below is the content of the log file :

Pig Stack Trace
---------------
ERROR 6017: org.apache.pig.backend.executionengine.ExecException:  
ERROR 2118: Unable to create input splits for: hdfs://localhost:9000/ user/rahulmalviya/main_merged_File_20100804.dat.completed

org.apache.pig.backend.executionengine.ExecException: ERROR 6017:  
org.apache.pig.backend.executionengine.ExecException: ERROR 2118:  
Unable to create input splits for: hdfs://localhost:9000/user/ rahulmalviya/main_merged_File_20100804.dat.completed
at
org
.apache
.pig
.backend
.hadoop
.executionengine
.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:227)
at
org
.apache
.pig
.backend
.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:
308)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:
835)
at org.apache.pig.PigServer.execute(PigServer.java:828)
at org.apache.pig.PigServer.access$100(PigServer.java:105)
at org.apache.pig.PigServer$Graph.execute(PigServer.java:1080)
at org.apache.pig.PigServer.executeBatch(PigServer.java:288)
at
org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:
109)
at
org
.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:
166)
at
org
.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:
138)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
at org.apache.pig.Main.main(Main.java:391)
=======================================================================