|
|
-
Please help me with errors met in Flume 1.3GuoWei 2012-12-28, 09:46
Dear all,
In my project, I use flume 1.3 to collect log. But when I want to use HBaseSync to store data into HBASE. I got the following error message. 12/12/28 17:45:55 INFO zookeeper.ClientCnxn: Opening socket connection to server DataNode1/192.168.1.186:2181. Will not attempt to authenticate using SASL (unknown error) 12/12/28 17:45:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.jav a:350) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to server DataNode2/192.168.1.187:2181. Will not attempt to authenticate using SASL (unknown error) 12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.jav a:350) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to server NameNode/192.168.1.185:2181. Will not attempt to authenticate using SASL (unknown error) 12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.jav a:350) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to server DataNode1/192.168.1.186:2181. Will not attempt to authenticate using SASL (unknown error) And my configuration is: host1.sources = r1 host1.sinks = sink1 host1.channels = c1 # Describe/configure the source host1.sources.r1.type = netcat host1.sources.r1.bind = 0.0.0.0 host1.sources.r1.port = 44444 # Use a channel which buffers events in memory host1.channels.c1.type = memory host1.channels.c1.capacity = 1000 host1.channels.c1.transactionCapacity = 100 host1.sources.r1.channels = c1 #e the AsyncHBaseSink host1.sinks.sink1.type = org.apache.flume.sink.hbase.AsyncHBaseSink #Use the HBaseSink #host1.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink host1.sinks.sink1.channel = c1 host1.sinks.sink1.table = cobub_razor_clientdata host1.sinks.sink1.columnFamily = clientdata #host1.sinks.sink1.column = charges host1.sinks.sink1.batchSize = 5000 #Use the SimpleAsyncHbaseEventSerializer that comes with Flume host1.sinks.sink1.serializer org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer #Use the SimpleHbaseEventSerializer that comes with Flume #host1.sinks.sink1.serializer org.apache.flume.sink.hbase.SimpleHbaseEventSerializer host1.sinks.sink1.serializer.incrementColumn = icol host1.channels.c1.type=memory Thanks for your help. Best Regards / 商祺 郭伟 Guo Wei ----------------------------------------------------- 南京西桥科技有限公司 Western Bridge Tech Ltd., Nanjing 南京市玄武区花园路8号一号楼511 No. 511, Building 1, No. 8, Hua Yuan Road Xuanwu District, Nanjing, PR China Email: [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]> Tel: +86 25 8528 4900 (Operator) Mobile: +86 138 1589 8257 Fax: +86 25 8528 4980 Web: http://www.wbkit.com <http://www.wbkit.com/> ----------------------------------------------------- WesternBridge Tech: Professional software service provider. Professional is MANNER as well CAPABILITY. |