Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Fwd: Sqoop export not working when using "update-key"


Copy link to this message
-
Re: Fwd: Sqoop export not working when using "update-key"
Hi Gwen, thank you for replying.

I went to the data node, the userlogs and all I found in syslog file is
what I already posted:
2014-07-17 10:19:09,280 INFO org.apache.hadoop.util.NativeCodeLoader:
Loaded the native-hadoop library
2014-07-17 10:19:09,700 INFO org.apache.hadoop.util.ProcessTree: setsid
exited with exit code 0
2014-07-17 10:19:09,706 INFO org.apache.hadoop.mapred.Task:  Using
ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@34c3a7c0
2014-07-17 10:19:10,266 INFO org.apache.sqoop.mapreduce.AutoProgressMapper:
Auto-progress thread is finished. keepGoing=false
2014-07-17 10:19:10,476 INFO org.apache.hadoop.mapred.TaskLogsTruncater:
Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2014-07-17 10:19:10,537 INFO org.apache.hadoop.io.nativeio.NativeIO:
Initialized cache for UID to User mapping with a cache timeout of 14400
seconds.
2014-07-17 10:19:10,537 INFO org.apache.hadoop.io.nativeio.NativeIO: Got
UserName elance for UID 666 from the native implementation
2014-07-17 10:19:10,539 ERROR
org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
as:elance cause:java.io.IOException: java.sql.SQLException: Missing IN or
OUT parameter at index:: 2
2014-07-17 10:19:10,540 WARN org.apache.hadoop.mapred.Child: Error running
child
java.io.IOException: java.sql.SQLException: Missing IN or OUT parameter at
index:: 2
 at
org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:184)
at
org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:651)
 at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:766)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
 at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
 at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.sql.SQLException: Missing IN or OUT parameter at index:: 2
 at
oracle.jdbc.driver.OraclePreparedStatement.processCompletedBindRow(OraclePreparedStatement.java:1844)
at
oracle.jdbc.driver.OraclePreparedStatement.addBatch(OraclePreparedStatement.java:10213)
 at
oracle.jdbc.driver.OraclePreparedStatementWrapper.addBatch(OraclePreparedStatementWrapper.java:1362)
at
org.apache.sqoop.mapreduce.UpdateOutputFormat$UpdateRecordWriter.getPreparedStatement(UpdateOutputFormat.java:174)
 at
org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.execUpdate(AsyncSqlRecordWriter.java:149)
at
org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:181)
 ... 8 more
2014-07-17 10:19:10,543 INFO org.apache.hadoop.mapred.Task: Runnning
cleanup for the task

There isn't more data than that.
Can you please check my sqoop command and validate that I'm using the
proper arguments? The argument "--columns" is used in export to tell sqoop
the order in which it should read the columns from the file right?
Does the last column need to have delimiter too?
The source file should be ok, have in mind that it works for insert but
fails when I add the parameter --update-key

Thanks
Leo
On Thu, Jul 17, 2014 at 1:52 PM, Gwen Shapira <[EMAIL PROTECTED]> wrote: