Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # dev - sqopp import issue


Copy link to this message
-
Re: sqopp import issue
Skvortsov Ivan 2013-10-16, 17:03
Hi Jarcec,

My name is Ivan)

I'm sorry about incomplete log. I found more detailed exception in logs:

ava.sql.SQLException: ORA-01555: snapshot too old: rollback segment number 363 with name "_SYSSMU363_3377139733$" too small

       at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:445)
       at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
       at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:879)
       at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:450)
       at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
       at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
       at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
       at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1119)
       at oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:373)
       at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277)
       at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:239)
       at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:483)
       at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:76)
       at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:85)
       at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:139)
       at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
       at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
       at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
       at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
       at java.security.AccessController.doPrivileged(Native Method)
       at javax.security.auth.Subject.doAs(Subject.java:396)
       at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
       at org.apache.hadoop.mapred.Child.main(Child.java:262)

I think it's related with undo log in oracle database. Do you have any recomendation on this case?

16.10.2013, 22:11, "Jarek Jarcec Cecho" <[EMAIL PROTECTED]>:
> Hi Yandex,
> what Sqoop version are you using?
>
> Would you mind sharing with us failed Map task log? It usually contains also the chained exceptions with more information about the failure.
>
> Jarcec
>
> On Mon, Oct 14, 2013 at 03:44:34PM +0700, Yandex Mail wrote:
>
>> О©╫Hi all,
>>
>> О©╫I have some issue with sqoop import can you help me with it?
>>
>> О©╫For this command:
>>
>> О©╫sqoop import --connect jdbc:oracle:thin:@//devdb:1521/DEV --username SYSTEM
>> О©╫--table DEV.TEST -P --split-by id --target-dir /user/oracle/sqoopImport/
>>
>> О©╫I got exception:
>>
>> О©╫INFO mapred.JobClient: Task Id : attempt_201309251246_0160_m_000000_2,
>> О©╫Status : FAILED
>>
>> О©╫java.io.IOException: SQLException in nextKeyValue
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at
>> О©╫org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.jav
>> О©╫a:266)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at
>> О©╫org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTas
>> О©╫k.java:483)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at
>> О©╫org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.
>> О©╫java:76)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at
>> О©╫org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(Wrapp
>> О©╫edMapper.java:85)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:139)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at
>> О©╫org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64
>> О©╫)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at java.security.AccessController.doPrivileged(Native Method)