Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Please help me with errors met in Flume 1.3


+
GuoWei 2012-12-28, 09:46
Copy link to this message
-
Re: Please help me with errors met in Flume 1.3
please  keep hbase and zk the same version under hbase and flume. then it
works.
On Dec 28, 2012 5:48 PM, "GuoWei" <[EMAIL PROTECTED]> wrote:

> Dear all,
>
> In my project, I use flume 1.3 to collect log. But when I want to use
> HBaseSync to store data into HBASE. I got the following error message.
>
> 12/12/28 17:45:55 INFO zookeeper.ClientCnxn: Opening socket connection to
> server DataNode1/192.168.1.186:2181. Will not attempt to authenticate
> using SASL (unknown error)
> 12/12/28 17:45:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
> server DataNode2/192.168.1.187:2181. Will not attempt to authenticate
> using SASL (unknown error)
> 12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
> server NameNode/192.168.1.185:2181. Will not attempt to authenticate
> using SASL (unknown error)
> 12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
> server DataNode1/192.168.1.186:2181. Will not attempt to authenticate
> using SASL (unknown error)
>
> And my configuration is:
>
> host1.sources = r1
> host1.sinks = sink1
> host1.channels = c1
>
> # Describe/configure the source
> host1.sources.r1.type = netcat
> host1.sources.r1.bind = 0.0.0.0
> host1.sources.r1.port = 44444
> # Use a channel which buffers events in memory
> host1.channels.c1.type = memory
> host1.channels.c1.capacity = 1000
> host1.channels.c1.transactionCapacity = 100
>
> host1.sources.r1.channels = c1
>
> #e the AsyncHBaseSink
> host1.sinks.sink1.type = org.apache.flume.sink.hbase.AsyncHBaseSink
>
> #Use the HBaseSink
> #host1.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink
> host1.sinks.sink1.channel = c1
> host1.sinks.sink1.table = cobub_razor_clientdata
> host1.sinks.sink1.columnFamily = clientdata
>
> #host1.sinks.sink1.column = charges
> host1.sinks.sink1.batchSize = 5000
>
> #Use the SimpleAsyncHbaseEventSerializer that comes with Flume
> host1.sinks.sink1.serializer > org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer
>
> #Use the SimpleHbaseEventSerializer that comes with Flume
> #host1.sinks.sink1.serializer > org.apache.flume.sink.hbase.SimpleHbaseEventSerializer
>
> host1.sinks.sink1.serializer.incrementColumn = icol
> host1.channels.c1.type=memory
>
>
> Thanks  for your help.
>
> *Best Regards / **商祺**
> *郭伟 Guo Wei
> -----------------------------------------------------
> 南京西桥科技有限公司
> Western Bridge Tech Ltd.,  Nanjing
>
> 南京市玄武区花园路8号一号楼511
> No. 511, Building 1, No. 8, Hua Yuan Road
>
> Xuanwu District, Nanjing, PR China
+
GuoWei 2012-12-29, 01:32