Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> SQOOP 1.3.0 questions using SQL Server


Copy link to this message
-
RE: SQOOP 1.3.0 questions using SQL Server
Don't pay attention to error that this table has two primary keys, I just want to know whether nvarchar still works.

[xxxxx@SERVERNAME ~]$ clear
[xxxxx@SERVERNAME ~]$ $SQOOP_HOME/bin/sqoop import-all-tables --connect "jdbc:sqlserver://dbserver;username=xxxx;password=xxxxx;database=xxxxx" --hive-import --create-hive-table -compress  -verbose
12/10/26 17:39:52 DEBUG tool.BaseSqoopTool: Enabled debug logging.
12/10/26 17:39:52 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override
12/10/26 17:39:52 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.
12/10/26 17:39:52 ERROR sqoop.ConnFactory: Error loading ManagerFactory information from file /usr/local/sqoop/conf/managers.d/mssqoop-sqlserver: java.io.IOException: the content of connector file must be in form of key=value
        at org.apache.sqoop.ConnFactory.addManagersFromFile(ConnFactory.java:219)
        at org.apache.sqoop.ConnFactory.loadManagersFromConfDir(ConnFactory.java:294)
        at org.apache.sqoop.ConnFactory.instantiateFactories(ConnFactory.java:85)
        at org.apache.sqoop.ConnFactory.<init>(ConnFactory.java:62)
        at com.cloudera.sqoop.ConnFactory.<init>(ConnFactory.java:36)
        at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:200)
        at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)
        at org.apache.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesTool.java:48)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
        at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)

12/10/26 17:39:52 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory
12/10/26 17:39:52 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.cloudera.sqoop.manager.DefaultManagerFactory
12/10/26 17:39:52 DEBUG manager.DefaultManagerFactory: Trying with scheme: jdbc:sqlserver:
12/10/26 17:39:52 INFO manager.SqlManager: Using default fetchSize of 1000
12/10/26 17:39:52 DEBUG sqoop.ConnFactory: Instantiated ConnManager org.apache.sqoop.manager.SQLServerManager@380e28b9
12/10/26 17:39:52 DEBUG manager.SqlManager: No connection paramenters specified. Using regular API for making connection.
12/10/26 17:39:53 INFO tool.CodeGenTool: Beginning code generation
12/10/26 17:39:53 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
12/10/26 17:39:53 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM [TABLENAME] AS t WHERE 1=0
12/10/26 17:39:53 DEBUG orm.ClassWriter: selected columns:
12/10/26 17:39:53 DEBUG orm.ClassWriter:   Keyword
12/10/26 17:39:53 DEBUG orm.ClassWriter:   Item
12/10/26 17:39:53 DEBUG orm.ClassWriter:   Description
12/10/26 17:39:53 DEBUG orm.ClassWriter: Writing source file: /tmp/sqoop-xxxxx/compile/3a8443bba92a6cc65a6eef5b0999e946/TABLENAME.java
12/10/26 17:39:53 DEBUG orm.ClassWriter: Table name: TABLENAME
12/10/26 17:39:53 DEBUG orm.ClassWriter: Columns: Keyword:-9, Item:-9, Description:-9,
12/10/26 17:39:53 DEBUG orm.ClassWriter: sourceFilename is TABLENAME.java
12/10/26 17:39:53 DEBUG orm.CompilationManager: Found existing /tmp/sqoop-xxxxx/compile/3a8443bba92a6cc65a6eef5b0999e946/
12/10/26 17:39:53 INFO orm.CompilationManager: HADOOP_HOME is /usr/local/hadoop/libexec/..
12/10/26 17:39:53 DEBUG orm.CompilationManager: Adding source file: /tmp/sqoop-xxxxx/compile/3a8443bba92a6cc65a6eef5b0999e946/TABLENAME.java
12/10/26 17:39:53 DEBUG orm.CompilationManager: Invoking javac with args:
12/10/26 17:39:53 DEBUG orm.CompilationManager:   -sourcepath
12/10/26 17:39:53 DEBUG orm.CompilationManager:   /tmp/sqoop-xxxxx/compile/3a8443bba92a6cc65a6eef5b0999e946/
12/10/26 17:39:53 DEBUG orm.CompilationManager:   -d
12/10/26 17:39:53 DEBUG orm.CompilationManager:   /tmp/sqoop-xxxxx/compile/3a8443bba92a6cc65a6eef5b0999e946/
12/10/26 17:39:53 DEBUG orm.CompilationManager:   -classpath
12/10/26 17:39:53 DEBUG orm.CompilationManager:   /usr/local/hadoop/libexec/../conf:/usr/lib/jvm/java-sun/lib/tools.jar:/usr/local/hadoop/libexec/..:/usr/local/hadoop/libexec/../hadoop-core-1.0.3.jar:/usr/local/hadoop/libexec/../lib/asm-3.2.jar:/usr/local/hadoop/libexec/../lib/aspectjrt-1.6.5.jar:/usr/local/hadoop/libexec/../lib/aspectjtools-1.6.5.jar:/usr/local/hadoop/libexec/../lib/avro-1.5.3.jar:/usr/local/hadoop/libexec/../lib/avro-ipc-1.5.3.jar:/usr/local/hadoop/libexec/../lib/avro-mapred-1.5.3.jar:/usr/local/hadoop/libexec/../lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/libexec/../lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop/libexec/../lib/commons-cli-1.2.jar:/usr/local/hadoop/libexec/../lib/commons-codec-1.4.jar:/usr/local/hadoop/libexec/../lib/commons-collections-3.2.1.jar:/usr/local/hadoop/libexec/../lib/commons-configuration-1.6.jar:/usr/local/hadoop/libexec/../lib/commons-daemon-1.0.1.jar:/usr/local/hadoop/libexec/../lib/commons-digester-1.8.jar:/usr/local/hadoop/libexec/../lib/commons-el-1.0.jar:/usr/local/hadoop/libexec/../lib/commons-httpclient-3.0.1.jar:/usr/local/hadoop/libexec/../lib/commons-io-2.1.jar:/usr/local/hadoop/libexec/../lib/commons-lang-2.4.jar:/usr/local/hadoop/libexec/../lib/commons-logging-1.1.1.jar:/usr/local/hadoop/libexec/../lib/commons-logging-api-1.0.4.jar:/usr/local/hadoop/libexec/../lib/commons-math-2.1.jar:/usr/local/hadoop/libexec/../lib/commons-net-1.4.1.jar:/usr/local/hadoop/libexec/../lib/core-3.1.1.jar:/usr/local/hadoop/libexec/../lib/hadoop-capacity-scheduler-1.0.3.jar:/usr/local/hadoop/libexec/../lib/hadoop-fairscheduler-1.0.3.jar:/usr/local/hadoop/libexec/../lib/hadoop-thriftfs-1.0.3.jar:/usr/local/hadoop/libexec/../lib/hsqldb-1.8.0.10.jar:/usr/local/hadoop/libexec/../lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/libexec/../lib/jackson-mapper-asl-1.8.8.jar:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB