Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> dynamic partition import


Copy link to this message
-
Re: dynamic partition import
can you check there is any firewall running on the system or if iptables is
running

This error  is usually because there is a firewall or iptables blocking the
connection

On Tue, May 29, 2012 at 3:27 PM, Nimra Choudhary <[EMAIL PROTECTED]>wrote:

>  *The only exception I can see was :*
>
> *12/05/29 15:03:22 WARN datanode.DataNode: DatanodeRegistration(
> 172.23.106.80:50010,
> storageID=DS-1416163861-172.23.106.80-50010-1335859555961, infoPort=50075,
> ipcPort=50020):Failed to transfer blk_3137767359939041043_493855 to
> 172.23.108.105:50010 got java.net.SocketException: Original Exception :
> java.io.IOException: An established connection was aborted by the software
> in your host machine*
>         *at sun.nio.ch.SocketDispatcher.write0(Native Method)*
>         *at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:51)*
>         *at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)*
>         *at sun.nio.ch.IOUtil.write(IOUtil.java:60)*
>         *at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:450)
> *
>         *at
> org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:55)
> *
>         *at
> org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
> *
>         *at
> org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:146)
> *
>         *at
> org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:107)
> *
>         *at
> java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)*
>         *at java.io.DataOutputStream.write(DataOutputStream.java:107)*
>         *at
> org.apache.hadoop.hdfs.server.datanode.BlockSender.sendChunks(BlockSender.java:319)
> *
>         *at
> org.apache.hadoop.hdfs.server.datanode.BlockSender.sendBlock(BlockSender.java:401)
> *
>         *at
> org.apache.hadoop.hdfs.server.datanode.DataNode$DataTransfer.run(DataNode.java:1319)
> *
>         *at java.lang.Thread.run(Thread.java:722)*
> *Caused by: java.io.IOException: An established connection was aborted by
> the software in your host machine*
>
> *Apart from this all log info like :*
>
> *12/05/29 15:05:14 INFO datanode.DataNode: PacketResponder 2 for block
> blk_-1151833161097637022_493865 terminating*
> *12/05/29 15:05:14 INFO datanode.DataNode: Receiving block
> blk_1737057988729853067_493866 src: /172.23.106.80:30093 dest: /
> 172.23.106.80:50010*
> *12/05/29 15:05:15 INFO DataNode.clienttrace: src: /172.23.106.80:30093,
> dest: /172.23.106.80:50010, bytes: 37572, op: HDFS_WRITE, cliID:
> DFSClient_141562960, offset: 0, srvID:
> DS-1416163861-172.23.106.80-50010-1335859555961, blockid:
> blk_1737057988729853067_493866, duration: 26623450*
> *12/05/29 15:05:15 INFO datanode.DataNode: PacketResponder 2 for block
> blk_1737057988729853067_493866 terminating*
> *12/05/29 15:05:15 INFO DataNode.clienttrace: src: /172.23.106.80:50010,
> dest: /172.23.106.80:30095, bytes: 37868, op: HDFS_READ, cliID:
> DFSClient_1094357381, offset: 0, srvID:
> DS-1416163861-172.23.106.80-50010-1335859555961, blockid:
> blk_1737057988729853067_493866, duration: 3302117*
> *12/05/29 15:05:15 INFO datanode.DataNode: Receiving block
> blk_-7108535084399259969_493867 src: /172.23.106.80:30096 dest: /
> 172.23.106.80:50010*
> *12/05/29 15:05:15 INFO DataNode.clienttrace: src: /172.23.106.80:30096,
> dest: /172.23.106.80:50010, bytes: 106, op: HDFS_WRITE, cliID:
> DFSClient_1094357381, offset: 0, srvID:
> DS-1416163861-172.23.106.80-50010-1335859555961, blockid:
> blk_-7108535084399259969_493867, duration: 10612496*
> *12/05/29 15:05:15 INFO datanode.DataNode: PacketResponder 2 for block
> blk_-7108535084399259969_493867 terminating*
> *12/05/29 15:05:15 INFO DataNode.clienttrace: src: /172.23.106.80:50010,
> dest: /172.23.106.80:30100, bytes: 258, op: HDFS_READ, cliID:
> DFSClient_1094357381, offset: 0, srvID:
> DS-1416163861-172.23.106.80-50010-1335859555961, blockid:
> blk_-1151833161097637022_493865, duration: 349632*
> *12/05/29 15:05:38 INFO DataNode.clienttrace: src: /172.23.106.80:50010,

Nitin Pawar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB