Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> Export


+
Cyril Bogus 2013-04-26, 16:52
+
Jarek Jarcec Cecho 2013-04-26, 17:37
+
Cyril Bogus 2013-04-26, 16:53
+
Jarek Jarcec Cecho 2013-04-26, 17:38
+
Cyril Bogus 2013-04-26, 17:52
+
Cyril Bogus 2013-04-26, 18:57
+
Jarek Jarcec Cecho 2013-04-26, 19:05
Hi Jarek, Thank you so much for the replies.

I made some changes to my export queries. It seems that it did not like the
fact that I had setup update-key and columns.
When I did so the export actually started but now I am having a mapreduce
issue.

Here is the output I am getting with --verbose on. And attached is the
class generated with the export command.

Warning: /home/hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: $HADOOP_HOME is deprecated.

13/04/26 15:17:52 DEBUG tool.BaseSqoopTool: Enabled debug logging.
13/04/26 15:17:52 DEBUG util.ClassLoaderStack: Checking for existing class:
com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
13/04/26 15:17:52 DEBUG util.ClassLoaderStack: Class is already available.
Skipping jar /home/sqoop/lib/sqljdbc4.jar
13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Added factory
com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory in jar
/home/sqoop/lib/sqljdbc4.jar specified by
/home/sqoop/conf/managers.d/mssqoop-sqlserver
13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.cloudera.sqoop.manager.DefaultManagerFactory
13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
13/04/26 15:17:52 INFO SqlServer.MSSQLServerManagerFactory: Using
Microsoft's SQL Server - Hadoop Connector
13/04/26 15:17:52 INFO manager.SqlManager: Using default fetchSize of 1000
13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Instantiated ConnManager
com.microsoft.sqoop.SqlServer.MSSQLServerManager@4cb9e45a
13/04/26 15:17:52 INFO tool.CodeGenTool: Beginning code generation
13/04/26 15:17:53 DEBUG manager.SqlManager: No connection paramenters
specified. Using regular API for making connection.
13/04/26 15:17:53 DEBUG manager.SqlManager: Using fetchSize for next query:
1000
13/04/26 15:17:53 INFO manager.SqlManager: Executing SQL statement: SELECT
TOP 1 * FROM [kmeansclusterIds]
13/04/26 15:17:53 DEBUG manager.SqlManager: Using fetchSize for next query:
1000
13/04/26 15:17:53 INFO manager.SqlManager: Executing SQL statement: SELECT
TOP 1 * FROM [kmeansclusterIds]
13/04/26 15:17:53 DEBUG orm.ClassWriter: selected columns:
13/04/26 15:17:53 DEBUG orm.ClassWriter:   driver_license
13/04/26 15:17:53 DEBUG orm.ClassWriter:   clusterId
13/04/26 15:17:53 DEBUG orm.ClassWriter: Writing source file:
/tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/kmeansclusterIds.java
13/04/26 15:17:53 DEBUG orm.ClassWriter: Table name: kmeansclusterIds
13/04/26 15:17:53 DEBUG orm.ClassWriter: Columns: driver_license:12,
clusterId:4,
13/04/26 15:17:53 DEBUG orm.ClassWriter: sourceFilename is
kmeansclusterIds.java
13/04/26 15:17:53 DEBUG orm.CompilationManager: Found existing
/tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
13/04/26 15:17:53 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is
/home/hadoop/mapred
13/04/26 15:17:53 DEBUG orm.CompilationManager: Adding source file:
/tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/kmeansclusterIds.java
13/04/26 15:17:53 DEBUG orm.CompilationManager: Invoking javac with args:
13/04/26 15:17:53 DEBUG orm.CompilationManager:   -sourcepath
13/04/26 15:17:53 DEBUG orm.CompilationManager:
/tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
13/04/26 15:17:53 DEBUG orm.CompilationManager:   -d
13/04/26 15:17:53 DEBUG orm.CompilationManager:
/tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
13/04/26 15:17:53 DEBUG orm.CompilationManager:   -classpath
13/04/26 15:17:53 DEBUG orm.CompilationManager:
/home/hadoop/conf:/usr/lib/tools.jar:/home/hadoop:/home/hadoop/hadoop-core-1.0.4.jar:/home/hadoop/lib/antlr-2.7.7.jar:/home/hadoop/lib/antlr-3.2.jar:/home/hadoop/lib/antlr-runtime-3.2.jar:/home/hadoop/lib/asm-3.2.jar:/home/hadoop/lib/aspectjrt-1.6.5.jar:/home/hadoop/lib/aspectjtools-1.6.5.jar:/home/hadoop/lib/avro-1.4.0-cassandra-1.jar:/home/hadoop/lib/bson-2.5.jar:/home/hadoop/lib/cassandra-all-0.8.1.jar:/home/hadoop/lib/cassandra-thrift-0.8.1.jar:/home/hadoop/lib/cglib-nodep-2.2.jar:/home/hadoop/lib/commons-beanutils-1.7.0.jar:/home/hadoop/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/lib/commons-cli-1.2.jar:/home/hadoop/lib/commons-cli-2.0-mahout.jar:/home/hadoop/lib/commons-codec-1.4.jar:/home/hadoop/lib/commons-collections-3.2.1.jar:/home/hadoop/lib/commons-compress-1.2.jar:/home/hadoop/lib/commons-configuration-1.6.jar:/home/hadoop/lib/commons-daemon-1.0.1.jar:/home/hadoop/lib/commons-dbcp-1.4.jar:/home/hadoop/lib/commons-digester-1.8.jar:/home/hadoop/lib/commons-el-1.0.jar:/home/hadoop/lib/commons-httpclient-3.0.1.jar:/home/hadoop/lib/commons-io-2.0.1.jar:/home/hadoop/lib/commons-io-2.1.jar:/home/hadoop/lib/commons-lang-2.4.jar:/home/hadoop/lib/commons-lang-2.6.jar:/home/hadoop/lib/commons-logging-1.1.1.jar:/home/hadoop/lib/commons-logging-api-1.0.4.jar:/home/hadoop/lib/commons-math-2.1.jar:/home/hadoop/lib/commons-math-2.2.jar:/home/hadoop/lib/commons-net-1.4.1.jar:/home/hadoop/lib/commons-pool-1.5.6.jar:/home/hadoop/lib/concurrentlinkedhashmap-lru-1.1.jar:/home/hadoop/lib/core-3.1.1.jar:/home/hadoop/lib/easymock-3.0.jar:/home/hadoop/lib/guava-r09.jar:/home/hadoop/lib/hadoop-capacity-scheduler-1.0.4.jar:/home/hadoop/lib/hadoop-fairscheduler-1.0.4.jar:/home/hadoop/lib/hadoop-thriftfs-1.0.4.jar:/home/hadoop/lib/hector-core-0.8.0-2.jar:/home/hadoop/lib/high-scale-lib-1.1.2.jar:/home/hadoop/lib/hsqldb-1.8.0.10.jar:/home/hadoop/lib/httpclient-4.0.1.jar:/home/hadoop/lib/httpcore-4.0.1.jar:/home/hadoop/lib/icu4j-4.8.1.1.jar:/home/hadoop/lib/jackson-core-asl-1.8.2.jar:/home/hadoop/lib/jackson-core-asl-1.8.8.jar:/home/hadoop/lib/jackson-mapper-asl-1.8.2.jar:/home/hadoop/lib/jackson-mapper-asl-1.8.8.jar:/home/hadoop/lib/jakarta-regexp-1.4.jar:/home/hadoop/lib/jamm-0.2.2.jar:/home/hadoop/lib/jasper-compiler-5.5.12.jar:/ho
+
Jarek Jarcec Cecho 2013-04-28, 15:03
+
Cyril Bogus 2013-05-02, 16:43
+
Jarek Jarcec Cecho 2013-05-03, 04:00
+
Venkat Ranganathan 2013-05-04, 18:25
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB