Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop, mail # user - RE: sqoop export - parse exception


+
Peleg, Eyal 2013-06-09, 11:45
+
Peleg, Eyal 2013-06-09, 11:39
+
Jarek Jarcec Cecho 2013-06-09, 14:57
+
Peleg, Eyal 2013-06-09, 15:36
+
Jarek Jarcec Cecho 2013-06-09, 15:44
+
Peleg, Eyal 2013-06-09, 15:52
Copy link to this message
-
Re: sqoop export - parse exception
Jarek Jarcec Cecho 2013-06-09, 16:01
Hi Peleg,
this seems to me as a data corruption issue, would you mind sharing with us the table schema and example small input file that trigger the issue? I'm expecting that number of columns in the table and in the file will be different.

What Sqoop version are you using? We've done significant improvements in Sqoop 1.4.3 (for example SQOOP-720) that are simplifying triaging of such issues, so you might consider upgrade.

Jarcec

On Sun, Jun 09, 2013 at 03:52:46PM +0000, Peleg, Eyal wrote:
> First, thx for the quick response..
>
>
> The command:
> sqoop export ... --table testing --export-dir  /user/eyapeleg/test --input-fields-terminated-by '\t' --lines-terminated-by '\n' --verbose ...
>
>
> the exception:
> java.util.NoSuchElementException
>
>
> the log:
>
> 13/06/09 08:48:19 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
> 13/06/09 08:48:19 ERROR sqoop.ConnFactory: Error loading ManagerFactory information from file /usr/lib/sqoop/conf/managers.d/connectors: java.io.IOException: Could not load jar /usr/lib/ into JVM. (Could not find class com.cloudera.sqoop.manager.NetezzaManagerFactory.)
>         at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:92)
>         at com.cloudera.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:36)
>         at org.apache.sqoop.ConnFactory.addManagersFromFile(ConnFactory.java:159)
>         at org.apache.sqoop.ConnFactory.loadManagersFromConfDir(ConnFactory.java:218)
>         at org.apache.sqoop.ConnFactory.instantiateFactories(ConnFactory.java:83)
>         at org.apache.sqoop.ConnFactory.<init>(ConnFactory.java:60)
>         at com.cloudera.sqoop.ConnFactory.<init>(ConnFactory.java:36)
>         at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:202)
>         at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:86)
>         at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
>         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
>         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
>         at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
>         at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
> Caused by: java.lang.ClassNotFoundException: com.cloudera.sqoop.manager.NetezzaManagerFactory
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>         at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:627)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>         at java.lang.Class.forName0(Native Method)
>         at java.lang.Class.forName(Class.java:247)
>         at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:88)
>         ... 15 more
>
> 13/06/09 08:48:19 ERROR sqoop.ConnFactory: Could not load ManagerFactory com.cloudera.sqoop.manager.NetezzaManagerFactory (not found)
> 13/06/09 08:48:19 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/06/09 08:48:19 INFO tool.CodeGenTool: Beginning code generation
> 13/06/09 08:48:19 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM testing AS t WHERE 1=0
> 13/06/09 08:48:19 INFO orm.CompilationManager: HADOOP_HOME is /usr/lib/hadoop/libexec/..
> 13/06/09 08:48:19 INFO orm.CompilationManager: Found hadoop core jar at: /usr/lib/hadoop/libexec/../hadoop-core.jar
> Note: /tmp/sqoop-eyapeleg/compile/637c112af558b7f914cfbd4024cbdb82/testing.java uses or overrides a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> 13/06/09 08:48:21 ERROR orm.CompilationManager: Could not rename /tmp/sqoop-eyapeleg/compile/637c112af558b7f914cfbd4024cbdb82/testing.java to /home/eyapeleg/./testing.java
+
Peleg, Eyal 2013-06-09, 16:10
+
Jarek Jarcec Cecho 2013-06-09, 16:20
+
Peleg, Eyal 2013-06-09, 16:29
+
Jarek Jarcec Cecho 2013-06-09, 19:14