Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - Sqoop issue related to Hadoop


Copy link to this message
-
Re: Sqoop issue related to Hadoop
Abraham Elmahrek 2013-08-28, 21:25
Hey Raj,

It seems like the number of fields you have in your data doesn't match the
number of fields in your RAJ.CUSTOMERS table.

Could you please add "--verbose" to the beginning of your argument list and
provide the entire contents here?

-Abe
On Wed, Aug 28, 2013 at 9:36 AM, Raj Hadoop <[EMAIL PROTECTED]> wrote:

> Hello all,
>
> I am getting an error while using sqoop export ( Load HDFS file to Oracle
> ). I am not sure the issue might be a Sqoop or Hadoop related one. So I am
> sending it to both the dist lists.
>
> *I am using -*
>
> sqoop export --connect jdbc:oracle:thin:@//dbserv:9876/OKI
> --table RAJ.CUSTOMERS --export-dir /user/hive/warehouse/web_cust
> --input-null-string '\\N' --input-null-non-string '\\N'  --username <>
> --password <> -m 1 --input-fields-terminated-by '\t'
>  *I am getting the following error -*
>
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> Warning: $HADOOP_HOME is deprecated.
> 13/08/28 09:42:36 WARN tool.BaseSqoopTool: Setting your password on the
> command-line is insecure. Consider using -P instead.
> 13/08/28 09:42:36 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/08/28 09:42:36 INFO tool.CodeGenTool: Beginning code generation
> 13/08/28 09:42:38 INFO manager.OracleManager: Time zone has been set to GMT
> 13/08/28 09:42:38 INFO manager.SqlManager: Executing SQL statement: SELECT
> t.* FROM RAJ.CUSTOMERS t WHERE 1=0
> 13/08/28 09:42:38 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is
> /software/hadoop/hadoop/hadoop-1.1.2
> Note:
> /tmp/sqoop-hadoop/compile/c1376f66d2151b48024c54305377c981/RAJ_CUSTOMERS.java
> uses or overrides a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> 13/08/28 09:42:40 INFO orm.CompilationManager: Writing jar file:
> /tmp/sqoop-hadoop/compile/c1376f66d2151b48024c54305377c981/RAJ.CUSTOMERS.jar
> 13/08/28 09:42:40 INFO mapreduce.ExportJobBase: Beginning export of
> RAJ.CUSTOMERS
> 13/08/28 09:42:41 INFO manager.OracleManager: Time zone has been set to GMT
> 13/08/28 09:42:43 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/08/28 09:42:43 INFO input.FileInputFormat: Total input paths to process
> : 1
> 13/08/28 09:42:43 INFO util.NativeCodeLoader: Loaded the native-hadoop
> library
> 13/08/28 09:42:43 WARN snappy.LoadSnappy: Snappy native library not loaded
> 13/08/28 09:42:43 INFO mapred.JobClient: Running job: job_201307041900_0463
> 13/08/28 09:42:44 INFO mapred.JobClient:  map 0% reduce 0%
> 13/08/28 09:42:56 INFO mapred.JobClient:  map 1% reduce 0%
> 13/08/28 09:43:00 INFO mapred.JobClient:  map 2% reduce 0%
> 13/08/28 09:43:03 INFO mapred.JobClient:  map 4% reduce 0%
> 13/08/28 09:43:10 INFO mapred.JobClient:  map 5% reduce 0%
> 13/08/28 09:43:13 INFO mapred.JobClient:  map 6% reduce 0%
> 13/08/28 09:43:17 INFO mapred.JobClient: Task Id :
> attempt_201307041900_0463_m_000000_0, Status : FAILED
> java.io.IOException: Can't export data, please check task tracker logs
>         at
> org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
>         at
> org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>         at
> org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
>         at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Caused by: java.util.NoSuchElementException
>         at java.util.ArrayList$Itr.next(ArrayList.java:794)