Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> Export


+
Cyril Bogus 2013-04-26, 16:52
+
Jarek Jarcec Cecho 2013-04-26, 17:37
+
Cyril Bogus 2013-04-26, 16:53
+
Jarek Jarcec Cecho 2013-04-26, 17:38
+
Cyril Bogus 2013-04-26, 17:52
+
Cyril Bogus 2013-04-26, 18:57
+
Jarek Jarcec Cecho 2013-04-26, 19:05
+
Cyril Bogus 2013-04-26, 19:21
+
Jarek Jarcec Cecho 2013-04-28, 15:03
+
Cyril Bogus 2013-05-02, 16:43
Hi Cyril,
I think that the exception is a bit misleading, you should check out map task logs, not task tracker logs. Would you mind sharing with us one failed map task log?

Jarcec

On Thu, May 02, 2013 at 12:43:40PM -0400, Cyril Bogus wrote:
> Yup the map task logs did not show any error. As if the error was suggested
> but not actually written in the file
>
>
> On Sun, Apr 28, 2013 at 11:03 AM, Jarek Jarcec Cecho <[EMAIL PROTECTED]>wrote:
>
> > Hi Cyril,
> > did you by any chance checked the map task logs as the exception is
> > suggesting?
> >
> > > java.io.IOException: Can't export data, please check task tracker logs
> >
> > Jarcec
> >
> > On Fri, Apr 26, 2013 at 03:21:21PM -0400, Cyril Bogus wrote:
> > > Hi Jarek, Thank you so much for the replies.
> > >
> > > I made some changes to my export queries. It seems that it did not like
> > the
> > > fact that I had setup update-key and columns.
> > > When I did so the export actually started but now I am having a mapreduce
> > > issue.
> > >
> > > Here is the output I am getting with --verbose on. And attached is the
> > > class generated with the export command.
> > >
> > > Warning: /home/hbase does not exist! HBase imports will fail.
> > > Please set $HBASE_HOME to the root of your HBase installation.
> > > Warning: $HADOOP_HOME is deprecated.
> > >
> > > 13/04/26 15:17:52 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> > > 13/04/26 15:17:52 DEBUG util.ClassLoaderStack: Checking for existing
> > class:
> > > com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
> > > 13/04/26 15:17:52 DEBUG util.ClassLoaderStack: Class is already
> > available.
> > > Skipping jar /home/sqoop/lib/sqljdbc4.jar
> > > 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Added factory
> > > com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory in jar
> > > /home/sqoop/lib/sqljdbc4.jar specified by
> > > /home/sqoop/conf/managers.d/mssqoop-sqlserver
> > > 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Loaded manager factory:
> > > com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
> > > 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Loaded manager factory:
> > > com.cloudera.sqoop.manager.DefaultManagerFactory
> > > 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> > > com.microsoft.sqoop.SqlServer.MSSQLServerManagerFactory
> > > 13/04/26 15:17:52 INFO SqlServer.MSSQLServerManagerFactory: Using
> > > Microsoft's SQL Server - Hadoop Connector
> > > 13/04/26 15:17:52 INFO manager.SqlManager: Using default fetchSize of
> > 1000
> > > 13/04/26 15:17:52 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> > > com.microsoft.sqoop.SqlServer.MSSQLServerManager@4cb9e45a
> > > 13/04/26 15:17:52 INFO tool.CodeGenTool: Beginning code generation
> > > 13/04/26 15:17:53 DEBUG manager.SqlManager: No connection paramenters
> > > specified. Using regular API for making connection.
> > > 13/04/26 15:17:53 DEBUG manager.SqlManager: Using fetchSize for next
> > query:
> > > 1000
> > > 13/04/26 15:17:53 INFO manager.SqlManager: Executing SQL statement:
> > SELECT
> > > TOP 1 * FROM [kmeansclusterIds]
> > > 13/04/26 15:17:53 DEBUG manager.SqlManager: Using fetchSize for next
> > query:
> > > 1000
> > > 13/04/26 15:17:53 INFO manager.SqlManager: Executing SQL statement:
> > SELECT
> > > TOP 1 * FROM [kmeansclusterIds]
> > > 13/04/26 15:17:53 DEBUG orm.ClassWriter: selected columns:
> > > 13/04/26 15:17:53 DEBUG orm.ClassWriter:   driver_license
> > > 13/04/26 15:17:53 DEBUG orm.ClassWriter:   clusterId
> > > 13/04/26 15:17:53 DEBUG orm.ClassWriter: Writing source file:
> > >
> > /tmp/sqoop-cyrille/compile/31f5d725de6c671fa550489f492e31a2/kmeansclusterIds.java
> > > 13/04/26 15:17:53 DEBUG orm.ClassWriter: Table name: kmeansclusterIds
> > > 13/04/26 15:17:53 DEBUG orm.ClassWriter: Columns: driver_license:12,
> > > clusterId:4,
> > > 13/04/26 15:17:53 DEBUG orm.ClassWriter: sourceFilename is
> > > kmeansclusterIds.java
> > > 13/04/26 15:17:53 DEBUG orm.CompilationManager: Found existing
+
Venkat Ranganathan 2013-05-04, 18:25
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB