Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Please help me with errors met in Flume 1.3


Copy link to this message
-
Please help me with errors met in Flume 1.3
Dear all,

In my project, I use flume 1.3 to collect log. But when I want to use
HBaseSync to store data into HBASE. I got the following error message.

12/12/28 17:45:55 INFO zookeeper.ClientCnxn: Opening socket connection to
server DataNode1/192.168.1.186:2181. Will not attempt to authenticate using
SASL (unknown error)
12/12/28 17:45:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.jav
a:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
server DataNode2/192.168.1.187:2181. Will not attempt to authenticate using
SASL (unknown error)
12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.jav
a:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
server NameNode/192.168.1.185:2181. Will not attempt to authenticate using
SASL (unknown error)
12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.jav
a:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
server DataNode1/192.168.1.186:2181. Will not attempt to authenticate using
SASL (unknown error)

And my configuration is:

host1.sources = r1
host1.sinks = sink1
host1.channels = c1

# Describe/configure the source
host1.sources.r1.type = netcat
host1.sources.r1.bind = 0.0.0.0
host1.sources.r1.port = 44444
# Use a channel which buffers events in memory
host1.channels.c1.type = memory
host1.channels.c1.capacity = 1000
host1.channels.c1.transactionCapacity = 100

host1.sources.r1.channels = c1

#e the AsyncHBaseSink
host1.sinks.sink1.type = org.apache.flume.sink.hbase.AsyncHBaseSink

#Use the HBaseSink
#host1.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink
host1.sinks.sink1.channel = c1
host1.sinks.sink1.table = cobub_razor_clientdata
host1.sinks.sink1.columnFamily = clientdata

#host1.sinks.sink1.column = charges
host1.sinks.sink1.batchSize = 5000

#Use the SimpleAsyncHbaseEventSerializer that comes with Flume
host1.sinks.sink1.serializer org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer

#Use the SimpleHbaseEventSerializer that comes with Flume
#host1.sinks.sink1.serializer org.apache.flume.sink.hbase.SimpleHbaseEventSerializer

host1.sinks.sink1.serializer.incrementColumn = icol
host1.channels.c1.type=memory
                  

Thanks  for your help.
Best Regards / 商祺
郭伟 Guo Wei
-----------------------------------------------------
南京西桥科技有限公司
Western Bridge Tech Ltd.,  Nanjing
南京市玄武区花园路8号一号楼511
No. 511, Building 1, No. 8, Hua Yuan Road
Xuanwu District, Nanjing, PR China
Email: [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
Tel: +86 25 8528 4900 (Operator)
Mobile: +86 138 1589 8257
Fax: +86 25 8528 4980
Web: http://www.wbkit.com <http://www.wbkit.com/>
-----------------------------------------------------
WesternBridge Tech: Professional software service provider. Professional is
MANNER as well CAPABILITY.