Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - Export


Copy link to this message
-
Re: Export
Jarek Jarcec Cecho 2013-04-28, 15:03
Hi Cyril,
did you by any chance checked the map task logs as the exception is suggesting?

> java.io.IOException: Can't export data, please check task tracker logs

Jarcec

On Fri, Apr 26, 2013 at 03:21:21PM -0400, Cyril Bogus wrote:
> Hi Jarek, Thank you so much for the replies.
>
> I made some changes to my export queries. It seems that it did not like the
> fact that I had setup update-key and columns.
> When I did so the export actually started but now I am having a mapreduce
> issue.
>
> Here is the output I am getting with --verbose on. And attached is the
> class generated with the export command.
>
> Warning: /home/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Warning: $HADOOP_HOME is deprecated.
>
> 13/04/26 15:17:52 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> 13/04/26 15:17:52 DEBUG util.ClassLoaderStack: Checking for existing class:
> com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
> 13/04/26 15:17:52 DEBUG util.ClassLoaderStack: Class is already available.
> Skipping jar /home/sqoop/lib/sqljdbc4.jar
> 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Added factory
> com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory in jar
> /home/sqoop/lib/sqljdbc4.jar specified by
> /home/sqoop/conf/managers.d/mssqoop-sqlserver
> 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Loaded manager factory:
> com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
> 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Loaded manager factory:
> com.cloudera.sqoop.manager.DefaultManagerFactory
> 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
> 13/04/26 15:17:52 INFO SqlServer.MSSQLServerManagerFactory: Using
> Microsoft's SQL Server - Hadoop Connector
> 13/04/26 15:17:52 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> com.microsoft.sqoop.SqlServer.MSSQLServerManager@4cb9e45a
> 13/04/26 15:17:52 INFO tool.CodeGenTool: Beginning code generation
> 13/04/26 15:17:53 DEBUG manager.SqlManager: No connection paramenters
> specified. Using regular API for making connection.
> 13/04/26 15:17:53 DEBUG manager.SqlManager: Using fetchSize for next query:
> 1000
> 13/04/26 15:17:53 INFO manager.SqlManager: Executing SQL statement: SELECT
> TOP 1 * FROM [kmeansclusterIds]
> 13/04/26 15:17:53 DEBUG manager.SqlManager: Using fetchSize for next query:
> 1000
> 13/04/26 15:17:53 INFO manager.SqlManager: Executing SQL statement: SELECT
> TOP 1 * FROM [kmeansclusterIds]
> 13/04/26 15:17:53 DEBUG orm.ClassWriter: selected columns:
> 13/04/26 15:17:53 DEBUG orm.ClassWriter:   driver_license
> 13/04/26 15:17:53 DEBUG orm.ClassWriter:   clusterId
> 13/04/26 15:17:53 DEBUG orm.ClassWriter: Writing source file:
> /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/kmeansclusterIds.java
> 13/04/26 15:17:53 DEBUG orm.ClassWriter: Table name: kmeansclusterIds
> 13/04/26 15:17:53 DEBUG orm.ClassWriter: Columns: driver_license:12,
> clusterId:4,
> 13/04/26 15:17:53 DEBUG orm.ClassWriter: sourceFilename is
> kmeansclusterIds.java
> 13/04/26 15:17:53 DEBUG orm.CompilationManager: Found existing
> /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
> 13/04/26 15:17:53 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is
> /home/hadoop/mapred
> 13/04/26 15:17:53 DEBUG orm.CompilationManager: Adding source file:
> /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/kmeansclusterIds.java
> 13/04/26 15:17:53 DEBUG orm.CompilationManager: Invoking javac with args:
> 13/04/26 15:17:53 DEBUG orm.CompilationManager:   -sourcepath
> 13/04/26 15:17:53 DEBUG orm.CompilationManager:
> /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/
> 13/04/26 15:17:53 DEBUG orm.CompilationManager:   -d
> 13/04/26 15:17:53 DEBUG orm.CompilationManager:
> /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/