Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> sqoop export - parse exception


Copy link to this message
-
Re: sqoop export - parse exception
Hi Peleg,
this seems to me as a data corruption issue, would you mind sharing with us the table schema and example small input file that trigger the issue? I'm expecting that number of columns in the table and in the file will be different.

What Sqoop version are you using? We've done significant improvements in Sqoop 1.4.3 (for example SQOOP-720) that are simplifying triaging of such issues, so you might consider upgrade.

Jarcec

On Sun, Jun 09, 2013 at 03:52:46PM +0000, Peleg, Eyal wrote:
> First, thx for the quick response..
>
>
> The command:
> sqoop export ... --table testing --export-dir  /user/eyapeleg/test --input-fields-terminated-by '\t' --lines-terminated-by '\n' --verbose ...
>
>
> the exception:
> java.util.NoSuchElementException
>
>
> the log:
>
> 13/06/09 08:48:19 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
> 13/06/09 08:48:19 ERROR sqoop.ConnFactory: Error loading ManagerFactory information from file /usr/lib/sqoop/conf/managers.d/connectors: java.io.IOException: Could not load jar /usr/lib/ into JVM. (Could not find class com.cloudera.sqoop.manager.NetezzaManagerFactory.)
>         at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:92)
>         at com.cloudera.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:36)
>         at org.apache.sqoop.ConnFactory.addManagersFromFile(ConnFactory.java:159)
>         at org.apache.sqoop.ConnFactory.loadManagersFromConfDir(ConnFactory.java:218)
>         at org.apache.sqoop.ConnFactory.instantiateFactories(ConnFactory.java:83)
>         at org.apache.sqoop.ConnFactory.<init>(ConnFactory.java:60)
>         at com.cloudera.sqoop.ConnFactory.<init>(ConnFactory.java:36)
>         at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:202)
>         at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:86)
>         at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
>         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
>         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
>         at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
>         at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
> Caused by: java.lang.ClassNotFoundException: com.cloudera.sqoop.manager.NetezzaManagerFactory
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>         at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:627)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>         at java.lang.Class.forName0(Native Method)
>         at java.lang.Class.forName(Class.java:247)
>         at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:88)
>         ... 15 more
>
> 13/06/09 08:48:19 ERROR sqoop.ConnFactory: Could not load ManagerFactory com.cloudera.sqoop.manager.NetezzaManagerFactory (not found)
> 13/06/09 08:48:19 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/06/09 08:48:19 INFO tool.CodeGenTool: Beginning code generation
> 13/06/09 08:48:19 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM testing AS t WHERE 1=0
> 13/06/09 08:48:19 INFO orm.CompilationManager: HADOOP_HOME is /usr/lib/hadoop/libexec/..
> 13/06/09 08:48:19 INFO orm.CompilationManager: Found hadoop core jar at: /usr/lib/hadoop/libexec/../hadoop-core.jar
> Note: /tmp/sqoop-eyapeleg/compile/637c112af558b7f914cfbd4024cbdb82/testing.java uses or overrides a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> 13/06/09 08:48:21 ERROR orm.CompilationManager: Could not rename /tmp/sqoop-eyapeleg/compile/637c112af558b7f914cfbd4024cbdb82/testing.java to /home/eyapeleg/./testing.java
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB