Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # dev >> sqopp import issue


Copy link to this message
-
Re: sqopp import issue
Hi Jarcec,

My name is Ivan)

I'm sorry about incomplete log. I found more detailed exception in logs:

ava.sql.SQLException: ORA-01555: snapshot too old: rollback segment number 363 with name "_SYSSMU363_3377139733$" too small

       at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:445)
       at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
       at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:879)
       at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:450)
       at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
       at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
       at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
       at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1119)
       at oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:373)
       at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277)
       at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:239)
       at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:483)
       at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:76)
       at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:85)
       at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:139)
       at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
       at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
       at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
       at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
       at java.security.AccessController.doPrivileged(Native Method)
       at javax.security.auth.Subject.doAs(Subject.java:396)
       at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
       at org.apache.hadoop.mapred.Child.main(Child.java:262)

I think it's related with undo log in oracle database. Do you have any recomendation on this case?

16.10.2013, 22:11, "Jarek Jarcec Cecho" <[EMAIL PROTECTED]>:
> Hi Yandex,
> what Sqoop version are you using?
>
> Would you mind sharing with us failed Map task log? It usually contains also the chained exceptions with more information about the failure.
>
> Jarcec
>
> On Mon, Oct 14, 2013 at 03:44:34PM +0700, Yandex Mail wrote:
>
>> О©╫Hi all,
>>
>> О©╫I have some issue with sqoop import can you help me with it?
>>
>> О©╫For this command:
>>
>> О©╫sqoop import --connect jdbc:oracle:thin:@//devdb:1521/DEV --username SYSTEM
>> О©╫--table DEV.TEST -P --split-by id --target-dir /user/oracle/sqoopImport/
>>
>> О©╫I got exception:
>>
>> О©╫INFO mapred.JobClient: Task Id : attempt_201309251246_0160_m_000000_2,
>> О©╫Status : FAILED
>>
>> О©╫java.io.IOException: SQLException in nextKeyValue
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at
>> О©╫org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.jav
>> О©╫a:266)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at
>> О©╫org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTas
>> О©╫k.java:483)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at
>> О©╫org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.
>> О©╫java:76)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at
>> О©╫org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(Wrapp
>> О©╫edMapper.java:85)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:139)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at
>> О©╫org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64
>> О©╫)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
>>
>> О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫at java.security.AccessController.doPrivileged(Native Method)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB