Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> Export


+
Cyril Bogus 2013-04-26, 16:52
+
Jarek Jarcec Cecho 2013-04-26, 17:37
+
Cyril Bogus 2013-04-26, 16:53
+
Jarek Jarcec Cecho 2013-04-26, 17:38
+
Cyril Bogus 2013-04-26, 17:52
+
Cyril Bogus 2013-04-26, 18:57
+
Jarek Jarcec Cecho 2013-04-26, 19:05
Hi Jarek, Thank you so much for the replies.

I made some changes to my export queries. It seems that it did not like the
fact that I had setup update-key and columns.
When I did so the export actually started but now I am having a mapreduce
issue.

Here is the output I am getting with --verbose on. And attached is the
class generated with the export command.

Warning: /home/hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: $HADOOP_HOME is deprecated.

13/04/26 15:17:52 DEBUG tool.BaseSqoopTool: Enabled debug logging.
13/04/26 15:17:52 DEBUG util.ClassLoaderStack: Checking for existing class:
com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
13/04/26 15:17:52 DEBUG util.ClassLoaderStack: Class is already available.
Skipping jar /home/sqoop/lib/sqljdbc4.jar
13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Added factory
com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory in jar
/home/sqoop/lib/sqljdbc4.jar specified by
/home/sqoop/conf/managers.d/mssqoop-sqlserver
13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.cloudera.sqoop.manager.DefaultManagerFactory
13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
13/04/26 15:17:52 INFO SqlServer.MSSQLServerManagerFactory: Using
Microsoft's SQL Server - Hadoop Connector
13/04/26 15:17:52 INFO manager.SqlManager: Using default fetchSize of 1000
13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Instantiated ConnManager
com.microsoft.sqoop.SqlServer.MSSQLServerManager@4cb9e45a
13/04/26 15:17:52 INFO tool.CodeGenTool: Beginning code generation
13/04/26 15:17:53 DEBUG manager.SqlManager: No connection paramenters
specified. Using regular API for making connection.
13/04/26 15:17:53 DEBUG manager.SqlManager: Using fetchSize for next query:
1000
13/04/26 15:17:53 INFO manager.SqlManager: Executing SQL statement: SELECT
TOP 1 * FROM [kmeansclusterIds]
13/04/26 15:17:53 DEBUG manager.SqlManager: Using fetchSize for next query:
1000
13/04/26 15:17:53 INFO manager.SqlManager: Executing SQL statement: SELECT
TOP 1 * FROM [kmeansclusterIds]
13/04/26 15:17:53 DEBUG orm.ClassWriter: selected columns:
13/04/26 15:17:53 DEBUG orm.ClassWriter:   driver_license
13/04/26 15:17:53 DEBUG orm.ClassWriter:   clusterId
13/04/26 15:17:53 DEBUG orm.ClassWriter: Writing source file:
/tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/kmeansclusterIds.java
13/04/26 15:17:53 DEBUG orm.ClassWriter: Table name: kmeansclusterIds
13/04/26 15:17:53 DEBUG orm.ClassWriter: Columns: driver_license:12,
clusterId:4,
13/04/26 15:17:53 DEBUG orm.ClassWriter: sourceFilename is
kmeansclusterIds.java
13/04/26 15:17:53 DEBUG orm.CompilationManager: Found existing
/tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
13/04/26 15:17:53 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is
/home/hadoop/mapred
13/04/26 15:17:53 DEBUG orm.CompilationManager: Adding source file:
/tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/kmeansclusterIds.java
13/04/26 15:17:53 DEBUG orm.CompilationManager: Invoking javac with args:
13/04/26 15:17:53 DEBUG orm.CompilationManager:   -sourcepath
13/04/26 15:17:53 DEBUG orm.CompilationManager:
/tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
13/04/26 15:17:53 DEBUG orm.CompilationManager:   -d
13/04/26 15:17:53 DEBUG orm.CompilationManager:
/tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
13/04/26 15:17:53 DEBUG orm.CompilationManager:   -classpath
13/04/26 15:17:53 DEBUG orm.CompilationManager:
/home/hadoop/conf:/usr/lib/tools.jar:/home/hadoop:/home/hadoop/hadoop-core-1.0.4.jar:/home/hadoop/lib/antlr-2.7.7.jar:/home/hadoop/lib/antlr-3.2.jar:/home/hadoop/lib/antlr-runtime-3.2.jar:/home/hadoop/lib/asm-3.2.jar:/home/hadoop/lib/aspectjrt-1.6.5.jar:/home/hadoop/lib/aspectjtools-1.6.5.jar:/home/hadoop/lib/avro-1.4.0-cassandra-1.jar:/home/hadoop/lib/bson-2.5.jar:/home/hadoop/lib/cassandra-all-0.8.1.jar:/home/hadoop/lib/cassandra-thrift-0.8.1.jar:/home/hadoop/lib/cglib-nodep-2.2.jar:/home/hadoop/lib/commons-beanutils-1.7.0.jar:/home/hadoop/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/lib/commons-cli-1.2.jar:/home/hadoop/lib/commons-cli-2.0-mahout.jar:/home/hadoop/lib/commons-codec-1.4.jar:/home/hadoop/lib/commons-collections-3.2.1.jar:/home/hadoop/lib/commons-compress-1.2.jar:/home/hadoop/lib/commons-configuration-1.6.jar:/home/hadoop/lib/commons-daemon-1.0.1.jar:/home/hadoop/lib/commons-dbcp-1.4.jar:/home/hadoop/lib/commons-digester-1.8.jar:/home/hadoop/lib/commons-el-1.0.jar:/home/hadoop/lib/commons-httpclient-3.0.1.jar:/home/hadoop/lib/commons-io-2.0.1.jar:/home/hadoop/lib/commons-io-2.1.jar:/home/hadoop/lib/commons-lang-2.4.jar:/home/hadoop/lib/commons-lang-2.6.jar:/home/hadoop/lib/commons-logging-1.1.1.jar:/home/hadoop/lib/commons-logging-api-1.0.4.jar:/home/hadoop/lib/commons-math-2.1.jar:/home/hadoop/lib/commons-math-2.2.jar:/home/hadoop/lib/commons-net-1.4.1.jar:/home/hadoop/lib/commons-pool-1.5.6.jar:/home/hadoop/lib/concurrentlinkedhashmap-lru-1.1.jar:/home/hadoop/lib/core-3.1.1.jar:/home/hadoop/lib/easymock-3.0.jar:/home/hadoop/lib/guava-r09.jar:/home/hadoop/lib/hadoop-capacity-scheduler-1.0.4.jar:/home/hadoop/lib/hadoop-fairscheduler-1.0.4.jar:/home/hadoop/lib/hadoop-thriftfs-1.0.4.jar:/home/hadoop/lib/hector-core-0.8.0-2.jar:/home/hadoop/lib/high-scale-lib-1.1.2.jar:/home/hadoop/lib/hsqldb-1.8.0.10.jar:/home/hadoop/lib/httpclient-4.0.1.jar:/home/hadoop/lib/httpcore-4.0.1.jar:/home/hadoop/lib/icu4j-4.8.1.1.jar:/home/hadoop/lib/jackson-core-asl-1.8.2.jar:/home/hadoop/lib/jackson-core-asl-1.8.8.jar:/home/hadoop/lib/jackson-mapper-asl-1.8.2.jar:/home/hadoop/lib/jackson-mapper-asl-1.8.8.jar:/home/hadoop/lib/jakarta-regexp-1.4.jar:/home/hadoop/lib/jamm-0.2.2.jar:/home/hadoop/lib/jasper-compiler-5.5.12.jar:/ho
+
Jarek Jarcec Cecho 2013-04-28, 15:03
+
Cyril Bogus 2013-05-02, 16:43
+
Jarek Jarcec Cecho 2013-05-03, 04:00
+
Venkat Ranganathan 2013-05-04, 18:25