Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Please help me with errors met in Flume 1.3


Copy link to this message
-
Please help me with errors met in Flume 1.3
Dear all,

In my project, I use flume 1.3 to collect log. But when I want to use
HBaseSync to store data into HBASE. I got the following error message.

12/12/28 17:45:55 INFO zookeeper.ClientCnxn: Opening socket connection to
server DataNode1/192.168.1.186:2181. Will not attempt to authenticate using
SASL (unknown error)
12/12/28 17:45:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.jav
a:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
server DataNode2/192.168.1.187:2181. Will not attempt to authenticate using
SASL (unknown error)
12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.jav
a:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
server NameNode/192.168.1.185:2181. Will not attempt to authenticate using
SASL (unknown error)
12/12/28 17:45:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.jav
a:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
12/12/28 17:45:56 INFO zookeeper.ClientCnxn: Opening socket connection to
server DataNode1/192.168.1.186:2181. Will not attempt to authenticate using
SASL (unknown error)

And my configuration is:

host1.sources = r1
host1.sinks = sink1
host1.channels = c1

# Describe/configure the source
host1.sources.r1.type = netcat
host1.sources.r1.bind = 0.0.0.0
host1.sources.r1.port = 44444
# Use a channel which buffers events in memory
host1.channels.c1.type = memory
host1.channels.c1.capacity = 1000
host1.channels.c1.transactionCapacity = 100

host1.sources.r1.channels = c1

#e the AsyncHBaseSink
host1.sinks.sink1.type = org.apache.flume.sink.hbase.AsyncHBaseSink

#Use the HBaseSink
#host1.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink
host1.sinks.sink1.channel = c1
host1.sinks.sink1.table = cobub_razor_clientdata
host1.sinks.sink1.columnFamily = clientdata

#host1.sinks.sink1.column = charges
host1.sinks.sink1.batchSize = 5000

#Use the SimpleAsyncHbaseEventSerializer that comes with Flume
host1.sinks.sink1.serializer org.apache.flume.sink.hbase.SimpleAsyncHbaseEventSerializer

#Use the SimpleHbaseEventSerializer that comes with Flume
#host1.sinks.sink1.serializer org.apache.flume.sink.hbase.SimpleHbaseEventSerializer

host1.sinks.sink1.serializer.incrementColumn = icol
host1.channels.c1.type=memory
                  

Thanks  for your help.
Best Regards / 商祺
郭伟 Guo Wei
-----------------------------------------------------
南京西桥科技有限公司
Western Bridge Tech Ltd.,  Nanjing
南京市玄武区花园路8号一号楼511
No. 511, Building 1, No. 8, Hua Yuan Road
Xuanwu District, Nanjing, PR China
Email: [EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>
Tel: +86 25 8528 4900 (Operator)
Mobile: +86 138 1589 8257
Fax: +86 25 8528 4980
Web: http://www.wbkit.com <http://www.wbkit.com/>
-----------------------------------------------------
WesternBridge Tech: Professional software service provider. Professional is
MANNER as well CAPABILITY.
+
Azuryy Yu 2012-12-28, 23:11
+
GuoWei 2012-12-29, 01:32
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB