Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - dynamic partition import


Copy link to this message
-
Re: dynamic partition import
Nitin Pawar 2012-05-29, 10:03
can you check there is any firewall running on the system or if iptables is
running

This error  is usually because there is a firewall or iptables blocking the
connection

On Tue, May 29, 2012 at 3:27 PM, Nimra Choudhary <[EMAIL PROTECTED]>wrote:

>  *The only exception I can see was :*
>
> *12/05/29 15:03:22 WARN datanode.DataNode: DatanodeRegistration(
> 172.23.106.80:50010,
> storageID=DS-1416163861-172.23.106.80-50010-1335859555961, infoPort=50075,
> ipcPort=50020):Failed to transfer blk_3137767359939041043_493855 to
> 172.23.108.105:50010 got java.net.SocketException: Original Exception :
> java.io.IOException: An established connection was aborted by the software
> in your host machine*
>         *at sun.nio.ch.SocketDispatcher.write0(Native Method)*
>         *at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:51)*
>         *at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)*
>         *at sun.nio.ch.IOUtil.write(IOUtil.java:60)*
>         *at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:450)
> *
>         *at
> org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:55)
> *
>         *at
> org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
> *
>         *at
> org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:146)
> *
>         *at
> org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:107)
> *
>         *at
> java.io.BufferedOutputStream.write(BufferedOutputStream.java:122)*
>         *at java.io.DataOutputStream.write(DataOutputStream.java:107)*
>         *at
> org.apache.hadoop.hdfs.server.datanode.BlockSender.sendChunks(BlockSender.java:319)
> *
>         *at
> org.apache.hadoop.hdfs.server.datanode.BlockSender.sendBlock(BlockSender.java:401)
> *
>         *at
> org.apache.hadoop.hdfs.server.datanode.DataNode$DataTransfer.run(DataNode.java:1319)
> *
>         *at java.lang.Thread.run(Thread.java:722)*
> *Caused by: java.io.IOException: An established connection was aborted by
> the software in your host machine*
>
> *Apart from this all log info like :*
>
> *12/05/29 15:05:14 INFO datanode.DataNode: PacketResponder 2 for block
> blk_-1151833161097637022_493865 terminating*
> *12/05/29 15:05:14 INFO datanode.DataNode: Receiving block
> blk_1737057988729853067_493866 src: /172.23.106.80:30093 dest: /
> 172.23.106.80:50010*
> *12/05/29 15:05:15 INFO DataNode.clienttrace: src: /172.23.106.80:30093,
> dest: /172.23.106.80:50010, bytes: 37572, op: HDFS_WRITE, cliID:
> DFSClient_141562960, offset: 0, srvID:
> DS-1416163861-172.23.106.80-50010-1335859555961, blockid:
> blk_1737057988729853067_493866, duration: 26623450*
> *12/05/29 15:05:15 INFO datanode.DataNode: PacketResponder 2 for block
> blk_1737057988729853067_493866 terminating*
> *12/05/29 15:05:15 INFO DataNode.clienttrace: src: /172.23.106.80:50010,
> dest: /172.23.106.80:30095, bytes: 37868, op: HDFS_READ, cliID:
> DFSClient_1094357381, offset: 0, srvID:
> DS-1416163861-172.23.106.80-50010-1335859555961, blockid:
> blk_1737057988729853067_493866, duration: 3302117*
> *12/05/29 15:05:15 INFO datanode.DataNode: Receiving block
> blk_-7108535084399259969_493867 src: /172.23.106.80:30096 dest: /
> 172.23.106.80:50010*
> *12/05/29 15:05:15 INFO DataNode.clienttrace: src: /172.23.106.80:30096,
> dest: /172.23.106.80:50010, bytes: 106, op: HDFS_WRITE, cliID:
> DFSClient_1094357381, offset: 0, srvID:
> DS-1416163861-172.23.106.80-50010-1335859555961, blockid:
> blk_-7108535084399259969_493867, duration: 10612496*
> *12/05/29 15:05:15 INFO datanode.DataNode: PacketResponder 2 for block
> blk_-7108535084399259969_493867 terminating*
> *12/05/29 15:05:15 INFO DataNode.clienttrace: src: /172.23.106.80:50010,
> dest: /172.23.106.80:30100, bytes: 258, op: HDFS_READ, cliID:
> DFSClient_1094357381, offset: 0, srvID:
> DS-1416163861-172.23.106.80-50010-1335859555961, blockid:
> blk_-1151833161097637022_493865, duration: 349632*
> *12/05/29 15:05:38 INFO DataNode.clienttrace: src: /172.23.106.80:50010,

Nitin Pawar