Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Fw: [sqoop-user] sqoop import shows ORA-00933: SQL command not properlyended error


Copy link to this message
-
Re: Fw: Fw: [sqoop-user] sqoop import shows ORA-00933: SQL command notproperlyended error
Hi Arvind
        Thank you for the detailed explanation to all our queries. I did try
out the options specified by you and now we are running into some different
issues. In our SQOOP import commands when the default connector was
chosen(avoided --driver in import commands) the SQL query generated didn't
contain 'AS' , ie the query syntax in default imports looks fine. The
analysis of other issues encountered are as follows, please go through the
same and share your thoughts. Should I specifically check for any details on
my user credentials with Oracle? Please advise

*Trial 1* : *SQOOP import command*
Execute the SQOOP import command without the --driver option so that the
default oracle connector would be selected
*Test 1:* no of mappers set to 1
*Sqoop Command : *
sqoop import -D oraoop.disabled=true  --connect
jdbc:oracle:thin:@servername:port:SID
--username <user name> --password <password> --table "ENGINE_RAW_OUTPUT"
--columns "Column-1,Column-2,Column-3,Column-4" --split-by
"ENGINE_POSITION"  --target-dir
"/userdata/bejoys/sqoop/aviation/BTEQPOC1/Table_EngineRawOP"  --num-mappers
1 --verbose
*Result :*
Map reduce job is triggered but it just halts after showing 'map 100% reduce
0%' . The job is not showing any failed status but stays in the same status
of 100% map done even after 12 hours. I tried the same import with --direct
option as well but still the same bug.
*Console Log*
11/08/02 04:06:12 DEBUG tool.BaseSqoopTool: Enabled debug logging.
11/08/02 04:06:12 DEBUG util.ClassLoaderStack: Checking for existing class:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:06:12 DEBUG util.ClassLoaderStack: Class is already available.
Skipping jar /usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Added factory
com.quest.oraoop.OraOopManagerFactory in jar
/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar specified by
/usr/lib/sqoop/conf/managers.d/oraoop
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:06:13 DEBUG oraoop.OraOopUtilities: Enabled OraOop debug
logging.
11/08/02 04:06:13 DEBUG oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop can be called by Sqoop!
11/08/02 04:06:13 INFO oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop is disabled.
11/08/02 04:06:13 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 04:06:13 DEBUG manager.DefaultManagerFactory: Trying with scheme:
jdbc:oracle:thin:@servername:port
11/08/02 04:06:13 DEBUG manager.OracleManager$ConnCache: Instantiated new
connection cache.
11/08/02 04:06:13 DEBUG sqoop.ConnFactory: Instantiated ConnManager
com.cloudera.sqoop.manager.OracleManager@7f2ad19e
11/08/02 04:06:13 INFO tool.CodeGenTool: Beginning code generation
11/08/02 04:06:13 DEBUG manager.OracleManager: Creating a new connection for
jdbc:oracle:thin:@servername:port:SID/<username>
11/08/02 04:06:14 INFO manager.OracleManager: Time zone has been set to GMT
11/08/02 04:06:14 INFO manager.SqlManager: Executing SQL statement: SELECT
t.* FROM ENGINE_RAW_OUTPUT t WHERE 1=0
11/08/02 04:06:15 DEBUG orm.ClassWriter: selected columns:
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-1
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-2
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-3
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-4
11/08/02 04:06:15 DEBUG orm.ClassWriter: Writing source file:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/ENGINE_RAW_OUTPUT.java
11/08/02 04:06:15 DEBUG orm.ClassWriter: Table name: ENGINE_RAW_OUTPUT
11/08/02 04:06:15 DEBUG orm.ClassWriter: Columns: Column-1:12, Column-2:2,
Column-3:12, Column-4:12,
11/08/02 04:06:15 DEBUG orm.ClassWriter: sourceFilename is
ENGINE_RAW_OUTPUT.java
11/08/02 04:06:15 DEBUG orm.CompilationManager: Found existing
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/
11/08/02 04:06:15 INFO orm.CompilationManager: HADOOP_HOME is
/usr/lib/hadoop
11/08/02 04:06:15 INFO orm.CompilationManager: Found hadoop core jar at:
/usr/lib/hadoop/hadoop-core.jar
11/08/02 04:06:15 DEBUG orm.CompilationManager: Adding source file:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/ENGINE_RAW_OUTPUT.java
11/08/02 04:06:15 DEBUG orm.CompilationManager: Invoking javac with args:
11/08/02 04:06:15 DEBUG orm.CompilationManager:   -sourcepath
11/08/02 04:06:15 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/
11/08/02 04:06:15 DEBUG orm.CompilationManager:   -d
11/08/02 04:06:15 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/
11/08/02 04:06:15 DEBUG orm.CompilationManager:   -classpath
11/08/02 04:06:15 DEBUG orm.CompilationManager:
/usr/lib/hadoop/conf:/usr/java/jdk1.6.0_21/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/cloudera-hadoop-lzo-20110406115906.0.4.10.0.g2bd0d5b.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/hadoop-lzo-0.4.10.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/hue-plugins-1.2.0.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB