-
Re: Fwd: sqoop export - rpc failureabhijeet gaikwad 2012-03-30, 21:48
try the same value with this property :
sqoop.export.records.per.statement
default is 100.
This should work.
Thanks,
Abhijeet Gaikwad
On 30 Mar 2012 16:17, "Chalcy" <[EMAIL PROTECTED]> wrote:
>
> Hello,
>
> I am trying to do a sqoop export (data from hdfs hadoop to database). The
> table I am trying to export has 2 million rows. The table has 20 fields.
> The sqoop command is successful if I did 10 rows till 95 rows. When I try
> anything more than 95, the sqoop export fails with the following error.
>
>
> By googling I get that this a dbms limitation. Is there anyway to
> configure to fix this error? I am surprised that it works for few rows.
>
>
>
> Any help is appreciated.
>
>
> Thanks,
> CHalcy
>
>
>
> 12/03/29 09:00:59 INFO mapred.JobClient: Task Id :
> attempt_201203230811_0539_m_000000_0, Status : FAILED
>
> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
> stream is incorrect. Too many parameters were provided in this RPC request.
> The maximum is 2100.
>
> at
> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>
> at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
> tabular data stream (TDS) remote procedure call (RPC) protocol stream is
> incorrect.
>
> 12/03/29 09:01:05 INFO mapred.JobClient: Task Id :
> attempt_201203230811_0539_m_000000_1, Status : FAILED
>
> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
> stream is incorrect. Too many parameters were provided in this RPC request.
> The maximum is 2100.
>
> at
> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>
> at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
> tabular data stream (TDS) remote procedure call (RPC) protocol stream is
> incorrect.
>
> 12/03/29 09:01:10 INFO mapred.JobClient: Task Id :
> attempt_201203230811_0539_m_000000_2, Status : FAILED
>
> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
> stream is incorrect. Too many parameters were provided in this RPC request.
> The maximum is 2100.
>
> at
> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>
> at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
sqoop.export.records.per.statement
default is 100.
This should work.
Thanks,
Abhijeet Gaikwad
On 30 Mar 2012 16:17, "Chalcy" <[EMAIL PROTECTED]> wrote:
>
> Hello,
>
> I am trying to do a sqoop export (data from hdfs hadoop to database). The
> table I am trying to export has 2 million rows. The table has 20 fields.
> The sqoop command is successful if I did 10 rows till 95 rows. When I try
> anything more than 95, the sqoop export fails with the following error.
>
>
> By googling I get that this a dbms limitation. Is there anyway to
> configure to fix this error? I am surprised that it works for few rows.
>
>
>
> Any help is appreciated.
>
>
> Thanks,
> CHalcy
>
>
>
> 12/03/29 09:00:59 INFO mapred.JobClient: Task Id :
> attempt_201203230811_0539_m_000000_0, Status : FAILED
>
> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
> stream is incorrect. Too many parameters were provided in this RPC request.
> The maximum is 2100.
>
> at
> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>
> at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
> tabular data stream (TDS) remote procedure call (RPC) protocol stream is
> incorrect.
>
> 12/03/29 09:01:05 INFO mapred.JobClient: Task Id :
> attempt_201203230811_0539_m_000000_1, Status : FAILED
>
> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
> stream is incorrect. Too many parameters were provided in this RPC request.
> The maximum is 2100.
>
> at
> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>
> at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:396)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
>
> at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
> tabular data stream (TDS) remote procedure call (RPC) protocol stream is
> incorrect.
>
> 12/03/29 09:01:10 INFO mapred.JobClient: Task Id :
> attempt_201203230811_0539_m_000000_2, Status : FAILED
>
> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
> stream is incorrect. Too many parameters were provided in this RPC request.
> The maximum is 2100.
>
> at
> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>
> at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>
> at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
