Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Chukwa, mail # user - agent.log  I/O exception (java.net.SocketTimeoutException) caught when processing request: Read timed out


Copy link to this message
-
RE: agent.log I/O exception (java.net.SocketTimeoutException) caught when processing request: Read timed out
Kumar, Suresh 2012-09-18, 17:45
I had checked these before posting, the problem was in the “initial_adaptors” file, I had copied

“add FileTailer FooData /tmp/foo 0” from the Chukwa agent documentation, it didn’t work. I had

to change to  “add filetailer.FileTailingAdaptor FooData /tmp/foo 0” to make it work. I found the

exception in “agent.log” and fixed the problem.

 

However, localhost:4080/hicc took over 3 hours to load, the hicc.log had this exception, any clues?

 

Thanks,

Suresh

 

2012-09-17 18:04:25,698 ERROR 2124414527@qtp-1510130526-7-EventThread ZooKeeperWatcher - ZK is null on connection event -- see stack trace for the stack trace when constructor was called on this zkw

java.lang.Exception: ZKW CONSTRUCTOR STACK TRACE FOR DEBUGGING

        at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:142)

        at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:126)

        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1307)

        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:579)

        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:570)

        at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:187)

        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:195)

        at org.apache.hadoop.hbase.client.HTableFactory.createHTableInterface(HTableFactory.java:36)

        at org.apache.hadoop.hbase.client.HTablePool.createHTable(HTablePool.java:268)

        at org.apache.hadoop.hbase.client.HTablePool.findOrCreateTable(HTablePool.java:198)

        at org.apache.hadoop.hbase.client.HTablePool.getTable(HTablePool.java:173)

        at org.apache.hadoop.chukwa.datastore.ChukwaHBaseStore.getClusterNames(ChukwaHBaseStore.java:231)

        at org.apache.hadoop.chukwa.hicc.ClusterConfig.<init>(ClusterConfig.java:63)

        at org.apache.jsp.index_jsp._jspService(org.apache.jsp.index_jsp:99)

        at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:109)

        at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)

        at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:389)

        at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:486)

        at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:380)

        at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)

        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)

        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)

        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)

        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)

        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)

        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)

        at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:327)

        at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:126)

        at org.mortbay.jetty.servlet.DefaultServlet.doGet(DefaultServlet.java:503)

        at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)

        at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)

        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)

        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)

        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)

        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)

        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)

        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)

        at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)

        at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)

        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)

        at org.mortbay.jetty.Server.handle(Server.java:326)

        at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)

        at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) 2012-09-17 18:04:25,700 ERROR 2124414527@qtp-1510130526-7-EventThread ClientCnxn - Error while calling watcher

java.lang.NullPointerException: ZK is null

        at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:338)

        at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:275)

        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)

        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)

        at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)

        at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)

        at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)

        at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)

        at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

2012-09-17 18:04:28,694 INFO 2124414527@qtp-1510130526-7 RecoverableZooKeeper - The identifier of this process is 18719@localhost

2012-09-17 18:05:14,141 INFO 1790591505@qtp-1510130526-5 /hicc - jsp: init

2012-09-17 19:45:27,547 INFO 1983406566@qtp-1510130526-10 ChukwaConfiguration - chukwaConf is /opt/chukwa/etc/chukwa

2012-09-17 19:45:28,125 INFO 1983406566@qtp-1510130526-10 ChukwaConfiguration - chukwaConf is /opt/chukwa/etc/chukwa

2012-09-17 19:45:28,421 ERROR 1983406566@qtp-1510130526-10 WidgetB