Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Export


Hi Cyril,
did you by any chance checked the map task logs as the exception is suggesting?

> java.io.IOException: Can't export data, please check task tracker logs

Jarcec

On Fri, Apr 26, 2013 at 03:21:21PM -0400, Cyril Bogus wrote:
> Hi Jarek, Thank you so much for the replies.
>
> I made some changes to my export queries. It seems that it did not like the
> fact that I had setup update-key and columns.
> When I did so the export actually started but now I am having a mapreduce
> issue.
>
> Here is the output I am getting with --verbose on. And attached is the
> class generated with the export command.
>
> Warning: /home/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Warning: $HADOOP_HOME is deprecated.
>
> 13/04/26 15:17:52 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> 13/04/26 15:17:52 DEBUG util.ClassLoaderStack: Checking for existing class:
> com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
> 13/04/26 15:17:52 DEBUG util.ClassLoaderStack: Class is already available.
> Skipping jar /home/sqoop/lib/sqljdbc4.jar
> 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Added factory
> com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory in jar
> /home/sqoop/lib/sqljdbc4.jar specified by
> /home/sqoop/conf/managers.d/mssqoop-sqlserver
> 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Loaded manager factory:
> com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
> 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Loaded manager factory:
> com.cloudera.sqoop.manager.DefaultManagerFactory
> 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
> 13/04/26 15:17:52 INFO SqlServer.MSSQLServerManagerFactory: Using
> Microsoft's SQL Server - Hadoop Connector
> 13/04/26 15:17:52 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> com.microsoft.sqoop.SqlServer.MSSQLServerManager@4cb9e45a
> 13/04/26 15:17:52 INFO tool.CodeGenTool: Beginning code generation
> 13/04/26 15:17:53 DEBUG manager.SqlManager: No connection paramenters
> specified. Using regular API for making connection.
> 13/04/26 15:17:53 DEBUG manager.SqlManager: Using fetchSize for next query:
> 1000
> 13/04/26 15:17:53 INFO manager.SqlManager: Executing SQL statement: SELECT
> TOP 1 * FROM [kmeansclusterIds]
> 13/04/26 15:17:53 DEBUG manager.SqlManager: Using fetchSize for next query:
> 1000
> 13/04/26 15:17:53 INFO manager.SqlManager: Executing SQL statement: SELECT
> TOP 1 * FROM [kmeansclusterIds]
> 13/04/26 15:17:53 DEBUG orm.ClassWriter: selected columns:
> 13/04/26 15:17:53 DEBUG orm.ClassWriter:   driver_license
> 13/04/26 15:17:53 DEBUG orm.ClassWriter:   clusterId
> 13/04/26 15:17:53 DEBUG orm.ClassWriter: Writing source file:
> /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/kmeansclusterIds.java
> 13/04/26 15:17:53 DEBUG orm.ClassWriter: Table name: kmeansclusterIds
> 13/04/26 15:17:53 DEBUG orm.ClassWriter: Columns: driver_license:12,
> clusterId:4,
> 13/04/26 15:17:53 DEBUG orm.ClassWriter: sourceFilename is
> kmeansclusterIds.java
> 13/04/26 15:17:53 DEBUG orm.CompilationManager: Found existing
> /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
> 13/04/26 15:17:53 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is
> /home/hadoop/mapred
> 13/04/26 15:17:53 DEBUG orm.CompilationManager: Adding source file:
> /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/kmeansclusterIds.java
> 13/04/26 15:17:53 DEBUG orm.CompilationManager: Invoking javac with args:
> 13/04/26 15:17:53 DEBUG orm.CompilationManager:   -sourcepath
> 13/04/26 15:17:53 DEBUG orm.CompilationManager:
> /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
> 13/04/26 15:17:53 DEBUG orm.CompilationManager:   -d
> 13/04/26 15:17:53 DEBUG orm.CompilationManager:
> /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB