Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - Export


Copy link to this message
-
Re: Export
Cyril Bogus 2013-04-26, 17:52
Here is the sqoop log

13/04/26 13:36:46 WARN tool.SqoopTool: $SQOOP_CONF_DIR has not been set in
the environment. Cannot check for additional configuration.
13/04/26 13:36:46 WARN sqoop.ConnFactory: $SQOOP_CONF_DIR has not been set
in the environment. Cannot check for additional configuration.
13/04/26 13:36:46 INFO manager.SqlManager: Using default fetchSize of 1000
13/04/26 13:36:46 INFO tool.CodeGenTool: Beginning code generation
13/04/26 13:36:46 INFO manager.SqlManager: Executing SQL statement: SELECT
t.* FROM [kmeansclusterIds] AS t WHERE 1=0
13/04/26 13:36:46 INFO orm.CompilationManager: $HADOOP_HOME is not set
/tmp/sqoop-cyrille/compile/2a3ab7b9299edcac783039a7addc9666/kmeansclusterIds.java:73:
cannot find symbol
symbol  : variable driver_license
location: class kmeansclusterIds
    JdbcWritableBridge.writeString(driver_license, 2 + __off, 12, __dbStmt);
                                   ^
Note:
/tmp/sqoop-cyrille/compile/2a3ab7b9299edcac783039a7addc9666/kmeansclusterIds.java
uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
1 error
13/04/26 13:36:47 ERROR tool.ExportTool: Encountered IOException running
export job: java.io.IOException: Error returned by javac

the kmeansClusterId class is set in a temp file so I cannot show what the
class do beside the point of error as stated above.

Thank you for your reply Jarek
On Fri, Apr 26, 2013 at 1:38 PM, Jarek Jarcec Cecho <[EMAIL PROTECTED]>wrote:

> Hi Cyril,
> would you mind sharing entire Sqoop log and the generated java class?
>
> Jarcec
>
> On Fri, Apr 26, 2013 at 12:53:49PM -0400, Cyril Bogus wrote:
> > UPDATE!!!
> >
> > Now I get the following error
> >
> >
> /tmp/sqoop-cyril/compile/b156fd4f270274b11320d007472bbfe7/kmeansclusterIds.java:73:
> > cannot find symbol
> > symbol  : variable driver_license
> > location: class kmeansclusterIds
> >     JdbcWritableBridge.writeString(driver_license, 2 + __off, 12,
> __dbStmt);
> >                                    ^
> > Note:
> >
> /tmp/sqoop-cyrille/compile/b156fd4f270274b11320d007472bbfe7/kmeansclusterIds.java
> > uses or overrides a deprecated API.
> > Note: Recompile with -Xlint:deprecation for details.
> > 1 error
> > 13/04/26 12:52:26 ERROR tool.ExportTool: Encountered IOException running
> > export job: java.io.IOException: Error returned by javac
> >
> >
> >
> >
> > On Fri, Apr 26, 2013 at 12:52 PM, Cyril Bogus <[EMAIL PROTECTED]>
> wrote:
> >
> > > Hi everyone,
> > >
> > > I am trying to do an export from HDFS to MSSQL using Sqoop
> > >
> > > my data is in the following format
> > >
> > > JTDKN3DU0B0261494,345
> > > JTEBU14R840022700,340
> > > JTEEP21A770208029,314
> > > JTHBF5C24A5125359,348
> > > jthbk1eg6a2395028,341
> > > JTMBD31V565007305,355
> > > KL1PM5C5XAK700838,352
> > > KMHCG45C41U225885,352
> > > KMHDC86EX9U037746,304
> > > NM0LS6BN8CT123712,354
> > >
> > > my export statement is the following
> > >
> > > export
> > > --connect
> > > 'jdbc:sqlserver://server:port;username=sa;password=pass;database=db'
> > > --table
> > > kmeansclusterIds
> > > --update-key
> > > driver_license
> > > --columns
> > > clusterId
> > > --update-mode
> > > allowinsert
> > > --export-dir
> > > drivers/output.txt
> > > --fields-terminated-by
> > > ','
> > > --lines-terminated-by
> > > \n
> > >
> > > I created a table named kmeansclusterIds on the server.
> > > I get the following error:
> > >
> > > Exception in thread "main" java.lang.NoSuchMethodError:
> > >
> com.cloudera.sqoop.manager.ExportJobContext.setConnManager(Lcom/cloudera/sqoop/manager/ConnManager;)V
> > >     at
> > >
> com.microsoft.sqoop.SqlServer.MSSQLServerManager.exportTable(MSSQLServerManager.java:151)
> > >     at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:78)
> > >     at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:97)
> > >     at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> > >     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)