Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Please help me with errors met in Flume 1.3


Copy link to this message
-
Re: Please help me with errors met in Flume 1.3
please  keep hbase and zk the same version under hbase and flume. then it
works.
On Dec 28, 2012 5:48 PM, "GuoWei" <[EMAIL PROTECTED]> wrote:

> Dear all,
>
> In my project, I use flume 1.3 to collect log. But when I want to use
> HBaseSync to store data into HBASE. I got the following error message.
>
> 12/12/28 17:45:55 INFO zookeeper.ClientCnxn: Opening socket connection to
> server DataNode1/192.168.1.186:2181. Will not attempt to authenticate
> using SASL (unknown error)
> 12/12/28 17:45:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
> server DataNode2/192.168.1.187:2181. Will not attempt to authenticate
> using SASL (unknown error)
> 12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
> server NameNode/192.168.1.185:2181. Will not attempt to authenticate
> using SASL (unknown error)
> 12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> 12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
> server DataNode1/192.168.1.186:2181. Will not attempt to authenticate
> using SASL (unknown error)
>
> And my configuration is:
>
> host1.sources = r1
> host1.sinks = sink1
> host1.channels = c1
>
> # Describe/configure the source
> host1.sources.r1.type = netcat
> host1.sources.r1.bind = 0.0.0.0
> host1.sources.r1.port = 44444
> # Use a channel which buffers events in memory
> host1.channels.c1.type = memory
> host1.channels.c1.capacity = 1000
> host1.channels.c1.transactionCapacity = 100
>
> host1.sources.r1.channels = c1
>
> #e the AsyncHBaseSink
> host1.sinks.sink1.type = org.apache.flume.sink.hbase.AsyncHBaseSink
>
> #Use the HBaseSink
> #host1.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink
> host1.sinks.sink1.channel = c1
> host1.sinks.sink1.table = cobub_razor_clientdata
> host1.sinks.sink1.columnFamily = clientdata
>
> #host1.sinks.sink1.column = charges
> host1.sinks.sink1.batchSize = 5000
>
> #Use the SimpleAsyncHbaseEventSerializer that comes with Flume
> host1.sinks.sink1.serializer > org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer
>
> #Use the SimpleHbaseEventSerializer that comes with Flume
> #host1.sinks.sink1.serializer > org.apache.flume.sink.hbase.SimpleHbaseEventSerializer
>
> host1.sinks.sink1.serializer.incrementColumn = icol
> host1.channels.c1.type=memory
>
>
> Thanks  for your help.
>
> *Best Regards / **商祺**
> *郭伟 Guo Wei
> -----------------------------------------------------
> 南京西桥科技有限公司
> Western Bridge Tech Ltd.,  Nanjing
>
> 南京市玄武区花园路8号一号楼511
> No. 511, Building 1, No. 8, Hua Yuan Road
>
> Xuanwu District, Nanjing, PR China
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB