Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> Fwd: sqoop export - rpc failure


+
Chalcy 2012-03-30, 10:46
Copy link to this message
-
Re: Fwd: sqoop export - rpc failure
try the same value with this property :
sqoop.export.records.per.statement
default is 100.

This should work.

Thanks,
Abhijeet Gaikwad
On 30 Mar 2012 16:17, "Chalcy" <[EMAIL PROTECTED]> wrote:

>
> Hello,
>
> I am trying to do a sqoop export (data from hdfs hadoop to database). The
> table I am trying to export has 2 million rows.  The table has 20 fields.
> The sqoop command is successful if I did 10 rows till 95 rows.  When I try
> anything more than 95, the sqoop export fails with the following error.
>
>
> By googling I get that this a dbms limitation. Is there anyway to
> configure to fix this error?  I am surprised that it works for few rows.
>
>
>
> Any help is appreciated.
>
>
> Thanks,
> CHalcy
>
>
>
> 12/03/29 09:00:59 INFO mapred.JobClient: Task Id :
> attempt_201203230811_0539_m_000000_0, Status : FAILED
>
> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
> stream is incorrect. Too many parameters were provided in this RPC request.
> The maximum is 2100.
>
>         at
> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>
>         at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
>         at java.security.AccessController.doPrivileged(Native Method)
>
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
>
>         at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
> tabular data stream (TDS) remote procedure call (RPC) protocol stream is
> incorrect.
>
> 12/03/29 09:01:05 INFO mapred.JobClient: Task Id :
> attempt_201203230811_0539_m_000000_1, Status : FAILED
>
> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
> stream is incorrect. Too many parameters were provided in this RPC request.
> The maximum is 2100.
>
>         at
> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>
>         at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>
>         at java.security.AccessController.doPrivileged(Native Method)
>
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
>
>         at org.apache.hadoop.mapred.Child.main(Child.java:264)
>
> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
> tabular data stream (TDS) remote procedure call (RPC) protocol stream is
> incorrect.
>
> 12/03/29 09:01:10 INFO mapred.JobClient: Task Id :
> attempt_201203230811_0539_m_000000_2, Status : FAILED
>
> java.io.IOException: com.microsoft.sqlserver.jdbc.SQLServerException: The
> incoming tabular data stream (TDS) remote procedure call (RPC) protocol
> stream is incorrect. Too many parameters were provided in this RPC request.
> The maximum is 2100.
>
>         at
> com.cloudera.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:189)
>
>         at
> org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:540)
>
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:649)
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
+
Chalcy 2012-04-09, 17:15
+
Chalcy 2012-03-29, 16:58
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB