Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Chukwa >> mail # user >> agent.log  I/O exception (java.net.SocketTimeoutException) caught when processing request: Read timed out


Copy link to this message
-
RE: agent.log I/O exception (java.net.SocketTimeoutException) caught when processing request: Read timed out
I had checked these before posting, the problem was in the “initial_adaptors” file, I had copied

“add FileTailer FooData /tmp/foo 0” from the Chukwa agent documentation, it didn’t work. I had

to change to  “add filetailer.FileTailingAdaptor FooData /tmp/foo 0” to make it work. I found the

exception in “agent.log” and fixed the problem.

 

However, localhost:4080/hicc took over 3 hours to load, the hicc.log had this exception, any clues?

 

Thanks,

Suresh

 

2012-09-17 18:04:25,698 ERROR 2124414527@qtp-1510130526-7-EventThread ZooKeeperWatcher - ZK is null on connection event -- see stack trace for the stack trace when constructor was called on this zkw

java.lang.Exception: ZKW CONSTRUCTOR STACK TRACE FOR DEBUGGING

        at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:142)

        at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:126)

        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1307)

        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:579)

        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:570)

        at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:187)

        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:195)

        at org.apache.hadoop.hbase.client.HTableFactory.createHTableInterface(HTableFactory.java:36)

        at org.apache.hadoop.hbase.client.HTablePool.createHTable(HTablePool.java:268)

        at org.apache.hadoop.hbase.client.HTablePool.findOrCreateTable(HTablePool.java:198)

        at org.apache.hadoop.hbase.client.HTablePool.getTable(HTablePool.java:173)

        at org.apache.hadoop.chukwa.datastore.ChukwaHBaseStore.getClusterNames(ChukwaHBaseStore.java:231)

        at org.apache.hadoop.chukwa.hicc.ClusterConfig.<init>(ClusterConfig.java:63)

        at org.apache.jsp.index_jsp._jspService(org.apache.jsp.index_jsp:99)

        at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:109)

        at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)

        at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:389)

        at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:486)

        at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:380)

        at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)

        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)

        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)

        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)

        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)

        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)

        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)

        at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:327)

        at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:126)

        at org.mortbay.jetty.servlet.DefaultServlet.doGet(DefaultServlet.java:503)

        at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)

        at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)

        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)

        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)

        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)

        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)

        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)

        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)

        at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)

        at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)

        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)

        at org.mortbay.jetty.Server.handle(Server.java:326)

        at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)

        at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) 2012-09-17 18:04:25,700 ERROR 2124414527@qtp-1510130526-7-EventThread ClientCnxn - Error while calling watcher

java.lang.NullPointerException: ZK is null

        at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:338)

        at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:275)

        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)

        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)

        at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)

        at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)

        at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)

        at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)

        at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

2012-09-17 18:04:28,694 INFO 2124414527@qtp-1510130526-7 RecoverableZooKeeper - The identifier of this process is 18719@localhost

2012-09-17 18:05:14,141 INFO 1790591505@qtp-1510130526-5 /hicc - jsp: init

2012-09-17 19:45:27,547 INFO 1983406566@qtp-1510130526-10 ChukwaConfiguration - chukwaConf is /opt/chukwa/etc/chukwa

2012-09-17 19:45:28,125 INFO 1983406566@qtp-1510130526-10 ChukwaConfiguration - chukwaConf is /opt/chukwa/etc/chukwa

2012-09-17 19:45:28,421 ERROR 1983406566@qtp-1510130526-10 WidgetB
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB