|
|
+
GuoWei 2012-12-28, 09:46
+
Azuryy Yu 2012-12-28, 23:11
-
Re: Please help me with errors met in Flume 1.3GuoWei 2012-12-29, 01:32
Thanks Azuryy. I will try .
From: Azuryy Yu <[EMAIL PROTECTED]> Reply-To: <[EMAIL PROTECTED]> Date: Sat, 29 Dec 2012 07:11:39 +0800 To: <[EMAIL PROTECTED]> Subject: Re: Please help me with errors met in Flume 1.3 please keep hbase and zk the same version under hbase and flume. then it works. On Dec 28, 2012 5:48 PM, "GuoWei" <[EMAIL PROTECTED]> wrote: > Dear all, > > In my project, I use flume 1.3 to collect log. But when I want to use > HBaseSync to store data into HBASE. I got the following error message. > > 12/12/28 17:45:55 INFO zookeeper.ClientCnxn: Opening socket connection to > server DataNode1/192.168.1.186:2181 <http://192.168.1.186:2181> . Will not > attempt to authenticate using SASL (unknown error) > 12/12/28 17:45:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) > at > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java: > 350) > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) > 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to > server DataNode2/192.168.1.187:2181 <http://192.168.1.187:2181> . Will not > attempt to authenticate using SASL (unknown error) > 12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) > at > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java: > 350) > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) > 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to > server NameNode/192.168.1.185:2181 <http://192.168.1.185:2181> . Will not > attempt to authenticate using SASL (unknown error) > 12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) > at > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java: > 350) > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) > 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to > server DataNode1/192.168.1.186:2181 <http://192.168.1.186:2181> . Will not > attempt to authenticate using SASL (unknown error) > > And my configuration is: > > host1.sources = r1 > host1.sinks = sink1 > host1.channels = c1 > > # Describe/configure the source > host1.sources.r1.type = netcat > host1.sources.r1.bind = 0.0.0.0 > host1.sources.r1.port = 44444 > # Use a channel which buffers events in memory > host1.channels.c1.type = memory > host1.channels.c1.capacity = 1000 > host1.channels.c1.transactionCapacity = 100 > > host1.sources.r1.channels = c1 > > #e the AsyncHBaseSink > host1.sinks.sink1.type = org.apache.flume.sink.hbase.AsyncHBaseSink > > #Use the HBaseSink > #host1.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink > host1.sinks.sink1.channel = c1 > host1.sinks.sink1.table = cobub_razor_clientdata > host1.sinks.sink1.columnFamily = clientdata > > #host1.sinks.sink1.column = charges > host1.sinks.sink1.batchSize = 5000 > > #Use the SimpleAsyncHbaseEventSerializer that comes with Flume > host1.sinks.sink1.serializer > org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer > > #Use the SimpleHbaseEventSerializer that comes with Flume > #host1.sinks.sink1.serializer > org.apache.flume.sink.hbase.SimpleHbaseEventSerializer |