Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop, mail # user - RE: sqoop export - parse exception


+
Peleg, Eyal 2013-06-09, 11:45
+
Peleg, Eyal 2013-06-09, 11:39
+
Jarek Jarcec Cecho 2013-06-09, 14:57
+
Peleg, Eyal 2013-06-09, 15:36
+
Jarek Jarcec Cecho 2013-06-09, 15:44
Copy link to this message
-
RE: sqoop export - parse exception
Peleg, Eyal 2013-06-09, 15:52
First, thx for the quick response..
The command:
sqoop export ... --table testing --export-dir  /user/eyapeleg/test --input-fields-terminated-by '\t' --lines-terminated-by '\n' --verbose ...
the exception:
java.util.NoSuchElementException
the log:

13/06/09 08:48:19 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
13/06/09 08:48:19 ERROR sqoop.ConnFactory: Error loading ManagerFactory information from file /usr/lib/sqoop/conf/managers.d/connectors: java.io.IOException: Could not load jar /usr/lib/ into JVM. (Could not find class com.cloudera.sqoop.manager.NetezzaManagerFactory.)
        at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:92)
        at com.cloudera.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:36)
        at org.apache.sqoop.ConnFactory.addManagersFromFile(ConnFactory.java:159)
        at org.apache.sqoop.ConnFactory.loadManagersFromConfDir(ConnFactory.java:218)
        at org.apache.sqoop.ConnFactory.instantiateFactories(ConnFactory.java:83)
        at org.apache.sqoop.ConnFactory.<init>(ConnFactory.java:60)
        at com.cloudera.sqoop.ConnFactory.<init>(ConnFactory.java:36)
        at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:202)
        at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:86)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
        at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
Caused by: java.lang.ClassNotFoundException: com.cloudera.sqoop.manager.NetezzaManagerFactory
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:627)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:247)
        at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:88)
        ... 15 more

13/06/09 08:48:19 ERROR sqoop.ConnFactory: Could not load ManagerFactory com.cloudera.sqoop.manager.NetezzaManagerFactory (not found)
13/06/09 08:48:19 INFO manager.SqlManager: Using default fetchSize of 1000
13/06/09 08:48:19 INFO tool.CodeGenTool: Beginning code generation
13/06/09 08:48:19 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM testing AS t WHERE 1=0
13/06/09 08:48:19 INFO orm.CompilationManager: HADOOP_HOME is /usr/lib/hadoop/libexec/..
13/06/09 08:48:19 INFO orm.CompilationManager: Found hadoop core jar at: /usr/lib/hadoop/libexec/../hadoop-core.jar
Note: /tmp/sqoop-eyapeleg/compile/637c112af558b7f914cfbd4024cbdb82/testing.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
13/06/09 08:48:21 ERROR orm.CompilationManager: Could not rename /tmp/sqoop-eyapeleg/compile/637c112af558b7f914cfbd4024cbdb82/testing.java to /home/eyapeleg/./testing.java
org.apache.commons.io.FileExistsException: Destination '/home/eyapeleg/./testing.java' already exists
        at org.apache.commons.io.FileUtils.moveFile(FileUtils.java:2378)
        at org.apache.sqoop.orm.CompilationManager.compile(CompilationManager.java:227)
        at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:83)
        at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:64)
        at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:97)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
        at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
13/06/09 08:48:21 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-eyapeleg/compile/637c112af558b7f914cfbd4024cbdb82/testing.jar
13/06/09 08:48:21 INFO mapreduce.ExportJobBase: Beginning export of testing
13/06/09 08:48:26 INFO input.FileInputFormat: Total input paths to process : 1
13/06/09 08:48:26 INFO input.FileInputFormat: Total input paths to process : 1
13/06/09 08:48:26 INFO mapred.JobClient: Running job: job_201305130941_2945
13/06/09 08:48:27 INFO mapred.JobClient:  map 0% reduce 0%
13/06/09 08:48:46 INFO mapred.JobClient: Task Id : attempt_201305130941_2945_m_000000_0, Status : FAILED
java.util.NoSuchElementException
        at java.util.AbstractList$Itr.next(AbstractList.java:350)
        at testing.__loadFromFields(testing.java:194)
        at testing.parse(testing.java:143)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:77)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:36)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:183)
        at org.apache.hadoop.mapred.MapTask.runNewMapper_aroundBody4(MapTask.java:813)
        at org.apache.hadoop.mapred.MapTask$AjcClosure5.run(MapTask.java:1)
        at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)
...
13/06/09 08:48:52 INFO mapred.JobClient: Task Id : attempt_201305130941_2945_m_000000_1, Status : FAILED
java.util.NoSuchElementException
        at java.util.AbstractList$Itr.next(AbstractList.java:350)
        at testing.__loadFromFields(testing.java:194)
        at testing.parse(testing.java:143)
    
+
Jarek Jarcec Cecho 2013-06-09, 16:01
+
Peleg, Eyal 2013-06-09, 16:10
+
Jarek Jarcec Cecho 2013-06-09, 16:20
+
Peleg, Eyal 2013-06-09, 16:29
+
Jarek Jarcec Cecho 2013-06-09, 19:14