Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop, mail # user - ERROR orm.ClassWriter: Cannot resolve SQL type 1111


+
Fatih Haltas 2013-07-22, 12:03
Copy link to this message
-
Re: ERROR orm.ClassWriter: Cannot resolve SQL type 1111
Jarek Jarcec Cecho 2013-07-22, 15:04
Hi Fatih,
per JDBC documentation [1] the code 1111 stands for type OTHER which basically means "unknown". As Sqoop do not know the type, it do not know how to transfer it to Hadoop. Would you mind sharing your table definition?

The possible workaround is to use query based import and cast the problematic columns to known and supported data types.

Jarcec

Links:
1: http://docs.oracle.com/javase/6/docs/api/constant-values.html#java.sql.Types.OTHER

On Mon, Jul 22, 2013 at 04:03:42PM +0400, Fatih Haltas wrote:
> Hi everyone,
>
> I am trying to import data from postgre to hdfs but unfortunately, I am
> taking this error. What should I do?
> I would be really obliged if you can help. I am struggling more than 3 days.
>
> -------------------------------------------
> Command that I used
> -------------------------------------------
> [hadoop@ADUAE042-LAP-V ~]$ sqoop import-all-tables --direct --connect
> jdbc:postgresql://192.168.194.158:5432/IMS --username pgsql -P  -- --schema
> LiveIPs
> --------------------------------------------
> Result
> ---------------------------------------
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Warning: $HADOOP_HOME is deprecated.
>
> 13/07/22 15:01:05 WARN tool.BaseSqoopTool: Setting your password on the
> command-line is insecure. Consider using -P instead.
> 13/07/22 15:01:06 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/07/22 15:01:06 INFO manager.PostgresqlManager: We will use schema LiveIPs
> 13/07/22 15:01:06 INFO tool.CodeGenTool: Beginning code generation
> 13/07/22 15:01:06 INFO manager.SqlManager: Executing SQL statement: SELECT
> t.* FROM "LiveIPs"."2013-04-01" AS t LIMIT 1
> 13/07/22 15:01:06 ERROR orm.ClassWriter: Cannot resolve SQL type 1111
> 13/07/22 15:01:06 ERROR orm.ClassWriter: Cannot resolve SQL type 1111
> 13/07/22 15:01:06 ERROR orm.ClassWriter: No Java type for SQL type 1111 for
> column ip
> 13/07/22 15:01:06 ERROR orm.ClassWriter: No Java type for SQL type 1111 for
> column ip
> 13/07/22 15:01:06 ERROR orm.ClassWriter: No Java type for SQL type 1111 for
> column ip
> 13/07/22 15:01:06 ERROR orm.ClassWriter: No Java type for SQL type 1111 for
> column ip
> 13/07/22 15:01:06 ERROR orm.ClassWriter: No Java type for SQL type 1111 for
> column ip
> 13/07/22 15:01:06 ERROR orm.ClassWriter: No Java type for SQL type 1111 for
> column ip
> 13/07/22 15:01:06 ERROR sqoop.Sqoop: Got exception running Sqoop:
> java.lang.NullPointerException
> java.lang.NullPointerException
> at org.apache.sqoop.orm.ClassWriter.parseNullVal(ClassWriter.java:912)
> at org.apache.sqoop.orm.ClassWriter.parseColumn(ClassWriter.java:937)
> at org.apache.sqoop.orm.ClassWriter.generateParser(ClassWriter.java:1011)
> at
> org.apache.sqoop.orm.ClassWriter.generateClassForColumns(ClassWriter.java:1342)
> at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1153)
> at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
> at
> org.apache.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesTool.java:64)
> at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
> at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
> at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
+
Fatih Haltas 2013-07-22, 15:11