Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop, mail # user - Export


+
Cyril Bogus 2013-04-26, 16:52
+
Jarek Jarcec Cecho 2013-04-26, 17:37
+
Cyril Bogus 2013-04-26, 16:53
+
Jarek Jarcec Cecho 2013-04-26, 17:38
+
Cyril Bogus 2013-04-26, 17:52
+
Cyril Bogus 2013-04-26, 18:57
Copy link to this message
-
Re: Export
Jarek Jarcec Cecho 2013-04-26, 19:05
Hi Cyril,
would you mind running your Sqoop command with argument --verbose? It should print out much more information. Please gather the generated class after Sqoop will end and sent it to the mailing list as well.

Jarcec

On Fri, Apr 26, 2013 at 01:52:29PM -0400, Cyril Bogus wrote:
> Here is the sqoop log
>
> 13/04/26 13:36:46 WARN tool.SqoopTool: $SQOOP_CONF_DIR has not been set in
> the environment. Cannot check for additional configuration.
> 13/04/26 13:36:46 WARN sqoop.ConnFactory: $SQOOP_CONF_DIR has not been set
> in the environment. Cannot check for additional configuration.
> 13/04/26 13:36:46 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/04/26 13:36:46 INFO tool.CodeGenTool: Beginning code generation
> 13/04/26 13:36:46 INFO manager.SqlManager: Executing SQL statement: SELECT
> t.* FROM [kmeansclusterIds] AS t WHERE 1=0
> 13/04/26 13:36:46 INFO orm.CompilationManager: $HADOOP_HOME is not set
> /tmp/sqoop-cyrille/compile/2a3ab7b9299edcac783039a7addc9666/kmeansclusterIds.java:73:
> cannot find symbol
> symbol  : variable driver_license
> location: class kmeansclusterIds
>     JdbcWritableBridge.writeString(driver_license, 2 + __off, 12, __dbStmt);
>                                    ^
> Note:
> /tmp/sqoop-cyrille/compile/2a3ab7b9299edcac783039a7addc9666/kmeansclusterIds.java
> uses or overrides a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> 1 error
> 13/04/26 13:36:47 ERROR tool.ExportTool: Encountered IOException running
> export job: java.io.IOException: Error returned by javac
>
> the kmeansClusterId class is set in a temp file so I cannot show what the
> class do beside the point of error as stated above.
>
> Thank you for your reply Jarek
>
>
> On Fri, Apr 26, 2013 at 1:38 PM, Jarek Jarcec Cecho <[EMAIL PROTECTED]>wrote:
>
> > Hi Cyril,
> > would you mind sharing entire Sqoop log and the generated java class?
> >
> > Jarcec
> >
> > On Fri, Apr 26, 2013 at 12:53:49PM -0400, Cyril Bogus wrote:
> > > UPDATE!!!
> > >
> > > Now I get the following error
> > >
> > >
> > /tmp/sqoop-cyril/compile/b156fd4f270274b11320d007472bbfe7/kmeansclusterIds.java:73:
> > > cannot find symbol
> > > symbol  : variable driver_license
> > > location: class kmeansclusterIds
> > >     JdbcWritableBridge.writeString(driver_license, 2 + __off, 12,
> > __dbStmt);
> > >                                    ^
> > > Note:
> > >
> > /tmp/sqoop-cyrille/compile/b156fd4f270274b11320d007472bbfe7/kmeansclusterIds.java
> > > uses or overrides a deprecated API.
> > > Note: Recompile with -Xlint:deprecation for details.
> > > 1 error
> > > 13/04/26 12:52:26 ERROR tool.ExportTool: Encountered IOException running
> > > export job: java.io.IOException: Error returned by javac
> > >
> > >
> > >
> > >
> > > On Fri, Apr 26, 2013 at 12:52 PM, Cyril Bogus <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > I am trying to do an export from HDFS to MSSQL using Sqoop
> > > >
> > > > my data is in the following format
> > > >
> > > > JTDKN3DU0B0261494,345
> > > > JTEBU14R840022700,340
> > > > JTEEP21A770208029,314
> > > > JTHBF5C24A5125359,348
> > > > jthbk1eg6a2395028,341
> > > > JTMBD31V565007305,355
> > > > KL1PM5C5XAK700838,352
> > > > KMHCG45C41U225885,352
> > > > KMHDC86EX9U037746,304
> > > > NM0LS6BN8CT123712,354
> > > >
> > > > my export statement is the following
> > > >
> > > > export
> > > > --connect
> > > > 'jdbc:sqlserver://server:port;username=sa;password=pass;database=db'
> > > > --table
> > > > kmeansclusterIds
> > > > --update-key
> > > > driver_license
> > > > --columns
> > > > clusterId
> > > > --update-mode
> > > > allowinsert
> > > > --export-dir
> > > > drivers/output.txt
> > > > --fields-terminated-by
> > > > ','
> > > > --lines-terminated-by
> > > > \n
> > > >
> > > > I created a table named kmeansclusterIds on the server.
> > > > I get the following error:
> > > >
> > > > Exception in thread "main" java.lang.NoSuchMethodError:
+
Cyril Bogus 2013-04-26, 19:21
+
Jarek Jarcec Cecho 2013-04-28, 15:03
+
Cyril Bogus 2013-05-02, 16:43
+
Jarek Jarcec Cecho 2013-05-03, 04:00
+
Venkat Ranganathan 2013-05-04, 18:25