Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Fw: [sqoop-user] sqoop import shows ORA-00933: SQL command not properlyended error


Copy link to this message
-
Re: Fw: Fw: [sqoop-user] sqoop import shows ORA-00933: SQL command notproperlyended error
Hi Arvind
        Thank you for the detailed explanation to all our queries. I did try
out the options specified by you and now we are running into some different
issues. In our SQOOP import commands when the default connector was
chosen(avoided --driver in import commands) the SQL query generated didn't
contain 'AS' , ie the query syntax in default imports looks fine. The
analysis of other issues encountered are as follows, please go through the
same and share your thoughts. Should I specifically check for any details on
my user credentials with Oracle? Please advise

*Trial 1* : *SQOOP import command*
Execute the SQOOP import command without the --driver option so that the
default oracle connector would be selected
*Test 1:* no of mappers set to 1
*Sqoop Command : *
sqoop import -D oraoop.disabled=true  --connect
jdbc:oracle:thin:@servername:port:SID
--username <user name> --password <password> --table "ENGINE_RAW_OUTPUT"
--columns "Column-1,Column-2,Column-3,Column-4" --split-by
"ENGINE_POSITION"  --target-dir
"/userdata/bejoys/sqoop/aviation/BTEQPOC1/Table_EngineRawOP"  --num-mappers
1 --verbose
*Result :*
Map reduce job is triggered but it just halts after showing 'map 100% reduce
0%' . The job is not showing any failed status but stays in the same status
of 100% map done even after 12 hours. I tried the same import with --direct
option as well but still the same bug.
*Console Log*
11/08/02 04:06:12 DEBUG tool.BaseSqoopTool: Enabled debug logging.
11/08/02 04:06:12 DEBUG util.ClassLoaderStack: Checking for existing class:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:06:12 DEBUG util.ClassLoaderStack: Class is already available.
Skipping jar /usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Added factory
com.quest.oraoop.OraOopManagerFactory in jar
/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar specified by
/usr/lib/sqoop/conf/managers.d/oraoop
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:06:13 DEBUG oraoop.OraOopUtilities: Enabled OraOop debug
logging.
11/08/02 04:06:13 DEBUG oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop can be called by Sqoop!
11/08/02 04:06:13 INFO oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop is disabled.
11/08/02 04:06:13 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 04:06:13 DEBUG manager.DefaultManagerFactory: Trying with scheme:
jdbc:oracle:thin:@servername:port
11/08/02 04:06:13 DEBUG manager.OracleManager$ConnCache: Instantiated new
connection cache.
11/08/02 04:06:13 DEBUG sqoop.ConnFactory: Instantiated ConnManager
com.cloudera.sqoop.manager.OracleManager@7f2ad19e
11/08/02 04:06:13 INFO tool.CodeGenTool: Beginning code generation
11/08/02 04:06:13 DEBUG manager.OracleManager: Creating a new connection for
jdbc:oracle:thin:@servername:port:SID/<username>
11/08/02 04:06:14 INFO manager.OracleManager: Time zone has been set to GMT
11/08/02 04:06:14 INFO manager.SqlManager: Executing SQL statement: SELECT
t.* FROM ENGINE_RAW_OUTPUT t WHERE 1=0
11/08/02 04:06:15 DEBUG orm.ClassWriter: selected columns:
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-1
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-2
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-3
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-4
11/08/02 04:06:15 DEBUG orm.ClassWriter: Writing source file:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/ENGINE_RAW_OUTPUT.java
11/08/02 04:06:15 DEBUG orm.ClassWriter: Table name: ENGINE_RAW_OUTPUT
11/08/02 04:06:15 DEBUG orm.ClassWriter: Columns: Column-1:12, Column-2:2,
Column-3:12, Column-4:12,
11/08/02 04:06:15 DEBUG orm.ClassWriter: sourceFilename is
ENGINE_RAW_OUTPUT.java
11/08/02 04:06:15 DEBUG orm.CompilationManager: Found existing
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/
11/08/02 04:06:15 INFO orm.CompilationManager: HADOOP_HOME is
/usr/lib/hadoop
11/08/02 04:06:15 INFO orm.CompilationManager: Found hadoop core jar at:
/usr/lib/hadoop/hadoop-core.jar
11/08/02 04:06:15 DEBUG orm.CompilationManager: Adding source file:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/ENGINE_RAW_OUTPUT.java
11/08/02 04:06:15 DEBUG orm.CompilationManager: Invoking javac with args:
11/08/02 04:06:15 DEBUG orm.CompilationManager:   -sourcepath
11/08/02 04:06:15 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/
11/08/02 04:06:15 DEBUG orm.CompilationManager:   -d
11/08/02 04:06:15 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/
11/08/02 04:06:15 DEBUG orm.CompilationManager:   -classpath
11/08/02 04:06:15 DEBUG orm.CompilationManager:
/usr/lib/hadoop/conf:/usr/java/jdk1.6.0_21/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/cloudera-hadoop-lzo-20110406115906.0.4.10.0.g2bd0d5b.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/hadoop-lzo-0.4.10.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/hue-plugins-1.2.0.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop