Chukwa, mail # user - Re: Unable to start hicc

Unable to start hicc

Prakhar Srivastava 2012-05-17, 06:13

Hi,
I am using chukwa version 0.5.0 stable release.
I tried to start hicc using bin/chukwa hicc but unable to start it because
of the following errors:

May 17, 2012 11:28:45 AM com.sun.jersey.spi.inject.Errors
processErrorMessages
SEVERE: The following errors and warnings have been detected with resource
and/or provider classes:
  SEVERE: Method, public java.util.List
org.apache.hadoop.chukwa.rest.resource.ClientTrace.getTrace(), annotated
with GET of resource, class
org.apache.hadoop.chukwa.rest.resource.ClientTrace, is not recognized as
valid resource method.
  SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.UserBean
org.apache.hadoop.chukwa.rest.resource.UserResource.getProfile(java.lang.String),
annotated with GET of resource, class
org.apache.hadoop.chukwa.rest.resource.UserResource, is not recognized as
valid resource method.
  SEVERE: Method, public java.lang.String
org.apache.hadoop.chukwa.rest.resource.UserResource.getUserList(),
annotated with GET of resource, class
org.apache.hadoop.chukwa.rest.resource.UserResource, is not recognized as
valid resource method.
  SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ReturnCodeBean
org.apache.hadoop.chukwa.rest.resource.UserResource.setProfile(org.apache.hadoop.chukwa.rest.bean.UserBean),
annotated with PUT of resource, class
org.apache.hadoop.chukwa.rest.resource.UserResource, is not recognized as
valid resource method.
  SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.WidgetBean
org.apache.hadoop.chukwa.rest.resource.WidgetResource.getProfile(java.lang.String),
annotated with GET of resource, class
org.apache.hadoop.chukwa.rest.resource.WidgetResource, is not recognized as
valid resource method.
  SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.CatalogBean
org.apache.hadoop.chukwa.rest.resource.WidgetResource.getWidgetCatalog(),
annotated with GET of resource, class
org.apache.hadoop.chukwa.rest.resource.WidgetResource, is not recognized as
valid resource method.
  SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ReturnCodeBean
org.apache.hadoop.chukwa.rest.resource.WidgetResource.saveWidget(org.apache.hadoop.chukwa.rest.bean.WidgetBean),
annotated with PUT of resource, class
org.apache.hadoop.chukwa.rest.resource.WidgetResource, is not recognized as
valid resource method.
  SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ReturnCodeBean
org.apache.hadoop.chukwa.rest.resource.ViewResource.deleteView(javax.servlet.http.HttpServletRequest,java.lang.String,java.lang.String),
annotated with DELETE of resource, class
org.apache.hadoop.chukwa.rest.resource.ViewResource, is not recognized as
valid resource method.
  SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ViewBean
org.apache.hadoop.chukwa.rest.resource.ViewResource.getView(javax.servlet.http.HttpServletRequest,java.lang.String),
annotated with GET of resource, class
org.apache.hadoop.chukwa.rest.resource.ViewResource, is not recognized as
valid resource method.
  SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ReturnCodeBean
org.apache.hadoop.chukwa.rest.resource.ViewResource.changeViewPermission(javax.servlet.http.HttpServletRequest,java.lang.String,java.lang.String,java.lang.String),
annotated with POST of resource, class
org.apache.hadoop.chukwa.rest.resource.ViewResource, is not recognized as
valid resource method.
  SEVERE: Method, public java.lang.String
org.apache.hadoop.chukwa.rest.resource.ViewResource.getUserViewList(javax.servlet.http.HttpServletRequest),
annotated with GET of resource, class
org.apache.hadoop.chukwa.rest.resource.ViewResource, is not recognized as
valid resource method.
  SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ReturnCodeBean
org.apache.hadoop.chukwa.rest.resource.ViewResource.setView(javax.servlet.http.HttpServletRequest,org.apache.hadoop.chukwa.rest.bean.ViewBean),
annotated with PUT of resource, class
org.apache.hadoop.chukwa.rest.resource.ViewResource, is not recognized as
valid resource method.
  SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ReturnCodeBean
org.apache.hadoop.chukwa.rest.resource.ViewResource.changeView(javax.servlet.http.HttpServletRequest,java.lang.String,java.lang.String,java.lang.String),
annotated with POST of resource, class
org.apache.hadoop.chukwa.rest.resource.ViewResource, is not recognized as
valid resource method.
  SEVERE: Method, public java.lang.String
org.apache.hadoop.chukwa.hicc.rest.MetricsController.getSeries(javax.servlet.http.HttpServletRequest,java.lang.String,java.lang.String,java.lang.String,java.lang.String,java.lang.String,java.lang.String),
annotated with GET of resource, class
org.apache.hadoop.chukwa.hicc.rest.MetricsController, is not recognized as
valid resource method.
  SEVERE: Method, public java.lang.String
org.apache.hadoop.chukwa.hicc.rest.MetricsController.getSeriesBySessionAttribute(javax.servlet.http.HttpServletRequest,java.lang.String,java.lang.String,java.lang.String,java.lang.String,java.lang.String),
annotated with GET of resource, class
org.apache.hadoop.chukwa.hicc.rest.MetricsController, is not recognized as
valid resource method.
  SEVERE: Method, public java.lang.String
org.apache.hadoop.chukwa.hicc.rest.MetricsController.getTables(), annotated
with GET of resource, class
org.apache.hadoop.chukwa.hicc.rest.MetricsController, is not recognized as
valid resource method.
  SEVERE: Method, public java.lang.String
org.apache.hadoop.chukwa.hicc.rest.MetricsController.getFamilies(java.lang.String),
annotated with GET of resource, class
org.apache.hadoop.chukwa.hicc.rest.MetricsController, is not recognized as
valid resource method.
  SEVERE: Method, public java.lang.String
org.apache.hadoop.chukwa.hicc.rest.MetricsController.getColumnNames(javax.servlet.http.HttpServletRequest,java.lang.String,java.lang.String,java.lang.String,java.lang.String,boolean),
annotated with GET of resource, class
org.apache.hadoop.chukwa.hicc.rest.MetricsController, is not recognized as
valid resource metho

Re: Unable to start hicc

Eric Yang 2012-05-19, 23:54

Hi Prakhar,

Could you check if there is two version of Jersey in the
share/chukwa/lib directory?
It looks like version conflict between HBase dependent Jersey and
Chukwa dependent Jersey to cause this issue on certain jvm.

What version of jdk and OS are you using?

regards,
Eric

On Wed, May 16, 2012 at 11:13 PM, Prakhar Srivastava
<[EMAIL PROTECTED]> wrote:
> Hi,
> I am using chukwa version 0.5.0 stable release.
> I tried to start hicc using bin/chukwa hicc but unable to start it because
> of the following errors:
>
> May 17, 2012 11:28:45 AM com.sun.jersey.spi.inject.Errors
> processErrorMessages
> SEVERE: The following errors and warnings have been detected with resource
> and/or provider classes:
> SEVERE: Method, public java.util.List
> org.apache.hadoop.chukwa.rest.resource.ClientTrace.getTrace(), annotated
> with GET of resource, class
> org.apache.hadoop.chukwa.rest.resource.ClientTrace, is not recognized as
> valid resource method.
> SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.UserBean
> org.apache.hadoop.chukwa.rest.resource.UserResource.getProfile(java.lang.String),
> annotated with GET of resource, class
> org.apache.hadoop.chukwa.rest.resource.UserResource, is not recognized as
> valid resource method.
> SEVERE: Method, public java.lang.String
> org.apache.hadoop.chukwa.rest.resource.UserResource.getUserList(), annotated
> with GET of resource, class
> org.apache.hadoop.chukwa.rest.resource.UserResource, is not recognized as
> valid resource method.
> SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ReturnCodeBean
> org.apache.hadoop.chukwa.rest.resource.UserResource.setProfile(org.apache.hadoop.chukwa.rest.bean.UserBean),
> annotated with PUT of resource, class
> org.apache.hadoop.chukwa.rest.resource.UserResource, is not recognized as
> valid resource method.
> SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.WidgetBean
> org.apache.hadoop.chukwa.rest.resource.WidgetResource.getProfile(java.lang.String),
> annotated with GET of resource, class
> org.apache.hadoop.chukwa.rest.resource.WidgetResource, is not recognized as
> valid resource method.
> SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.CatalogBean
> org.apache.hadoop.chukwa.rest.resource.WidgetResource.getWidgetCatalog(),
> annotated with GET of resource, class
> org.apache.hadoop.chukwa.rest.resource.WidgetResource, is not recognized as
> valid resource method.
> SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ReturnCodeBean
> org.apache.hadoop.chukwa.rest.resource.WidgetResource.saveWidget(org.apache.hadoop.chukwa.rest.bean.WidgetBean),
> annotated with PUT of resource, class
> org.apache.hadoop.chukwa.rest.resource.WidgetResource, is not recognized as
> valid resource method.
> SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ReturnCodeBean
> org.apache.hadoop.chukwa.rest.resource.ViewResource.deleteView(javax.servlet.http.HttpServletRequest,java.lang.String,java.lang.String),
> annotated with DELETE of resource, class
> org.apache.hadoop.chukwa.rest.resource.ViewResource, is not recognized as
> valid resource method.
> SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ViewBean
> org.apache.hadoop.chukwa.rest.resource.ViewResource.getView(javax.servlet.http.HttpServletRequest,java.lang.String),
> annotated with GET of resource, class
> org.apache.hadoop.chukwa.rest.resource.ViewResource, is not recognized as
> valid resource method.
> SEVERE: Method, public org.apache.hadoop.chukwa.rest.bean.ReturnCodeBean
> org.apache.hadoop.chukwa.rest.resource.ViewResource.changeViewPermission(javax.servlet.http.HttpServletRequest,java.lang.String,java.lang.String,java.lang.String),
> annotated with POST of resource, class
> org.apache.hadoop.chukwa.rest.resource.ViewResource, is not recognized as
> valid resource method.
> SEVERE: Method, public java.lang.String
> org.apache.hadoop.chukwa.rest.resource.ViewResource.getUserViewList(javax.servlet.http.HttpServletRequest),

Re: Unable to start hicc

Prakhar Srivastava 2012-05-21, 07:41

Hi Eric,

After struggling through the above error for an hour or two. I found out
that there was a conflict between jersey available through jersey bundle
and one that is available through hbase-0.92.0. So i had to add some
exclusions in the pom.xml which resolved the above issue. I have raised a
jira issue and suggests including the exclusions in the pom.xml. Lets me
know if will have any regressions.
CHUKWA-643 - Hicc builds with conflicting jar
dependencies<https://issues.apache.org/jira/browse/CHUKWA-643>
However, I am still facing the exception below in using hicc. The HICC
dashboard components loads fine but there are no values/populated charts. I
am only able to see the Job summary (Hadoop jobs run since last X time).

2012-05-21 12:50:53,190 INFO 1638726193@qtp-494299142-4 ChukwaConfiguration
- chukwaConf is /usr/local/chukwa-incubating-0.5.0/etc/chukwa
2012-05-21 12:50:53,449 INFO 1790591505@qtp-494299142-7 ChukwaConfiguration
- chukwaConf is /usr/local/chukwa-incubating-0.5.0/etc/chukwa
2012-05-21 12:50:53,573 ERROR 1790591505@qtp-494299142-7 WidgetBean -
java.lang.NullPointerException
at org.apache.hadoop.chukwa.rest.bean.WidgetBean.<init>(WidgetBean.java:55)
at
org.apache.hadoop.chukwa.datastore.WidgetStore.cacheWidgets(WidgetStore.java:98)
at org.apache.hadoop.chukwa.datastore.WidgetStore.list(WidgetStore.java:121)
at org.apache.hadoop.chukwa.rest.bean.WidgetBean.update(WidgetBean.java:158)
at org.apache.hadoop.chukwa.rest.bean.ColumnBean.update(ColumnBean.java:63)
at org.apache.hadoop.chukwa.rest.bean.PagesBean.update(PagesBean.java:83)
at org.apache.hadoop.chukwa.rest.bean.ViewBean.update(ViewBean.java:127)
at org.apache.hadoop.chukwa.datastore.ViewStore.load(ViewStore.java:92)
at org.apache.hadoop.chukwa.datastore.ViewStore.<init>(ViewStore.java:61)
at
org.apache.hadoop.chukwa.rest.resource.ViewResource.getView(ViewResource.java:52)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
at
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
at
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at
com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at
com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
at
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
at
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
at
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
at
com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
at
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
at
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:708)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

2012-05-21 12:50:53,575 ERROR 1790591505@qtp-494299142-7 WidgetStore -
java.text.ParseException: java.lang.NullPointerException
at org.apache.hadoop.chukwa.rest.bean.WidgetBean.<init>(WidgetBean.java:55)
at
org.apache.hadoop.chukwa.datastore.WidgetStore.cacheWidgets(WidgetStore.java:98)
at org.apache.hadoop.chukwa.datastore.WidgetStore.list(WidgetStore.java:121)
at org.apache.hadoop.chukwa.rest.bean.WidgetBean.update(WidgetBean.java:158)
at org.apache.hadoop.chukwa.rest.bean.ColumnBean.update(ColumnBean.java:63)
at org.apache.hadoop.chukwa.rest.bean.PagesBean.update(PagesBean.java:83)
at org.apache.hadoop.chukwa.rest.bean.ViewBean.update(ViewBean.java:127)
at org.apache.hadoop.chukwa.datastore.ViewStore.load(ViewStore.java:92)
at org.apache.hadoop.chukwa.datastore.ViewStore.<init>(ViewStore.java:61)
at
org.apache.hadoop.chukwa.rest.resource.ViewResource.getView(ViewResource.java:52)
at sun.reflect.NativeMethodAcc

Re: Unable to start hicc

Eric Yang 2012-05-22, 04:51

Base on the stacktrace, it looks like the descriptor file reading from
hdfs contains invalid json.
Does hicc running user have access to read/write from
hdfs://host:port/chukwa/hicc?
What does the directory looks like in hdfs? In addition, what is the
hdfs version? Does it match
hadoop jar file in chukwa lib? Is HADOOP_CONF_DIR in the classpath?

regards,
Eric

On Mon, May 21, 2012 at 12:41 AM, Prakhar Srivastava
<[EMAIL PROTECTED]> wrote:
> Hi Eric,
>
> After struggling through the above error for an hour or two. I found out
> that there was a conflict between jersey available through jersey bundle and
> one that is available through hbase-0.92.0. So i had to add some exclusions
> in the pom.xml which resolved the above issue. I have raised a jira issue
> and suggests including the exclusions in the pom.xml. Lets me know if will
> have any regressions.
> CHUKWA-643 - Hicc builds with conflicting jar dependencies
>
>
> However, I am still facing the exception below in using hicc. The HICC
> dashboard components loads fine but there are no values/populated charts. I
> am only able to see the Job summary (Hadoop jobs run since last X time).
>
> 2012-05-21 12:50:53,190 INFO 1638726193@qtp-494299142-4 ChukwaConfiguration
> - chukwaConf is /usr/local/chukwa-incubating-0.5.0/etc/chukwa
> 2012-05-21 12:50:53,449 INFO 1790591505@qtp-494299142-7 ChukwaConfiguration
> - chukwaConf is /usr/local/chukwa-incubating-0.5.0/etc/chukwa
> 2012-05-21 12:50:53,573 ERROR 1790591505@qtp-494299142-7 WidgetBean -
> java.lang.NullPointerException
> at org.apache.hadoop.chukwa.rest.bean.WidgetBean.<init>(WidgetBean.java:55)
> at
> org.apache.hadoop.chukwa.datastore.WidgetStore.cacheWidgets(WidgetStore.java:98)
> at org.apache.hadoop.chukwa.datastore.WidgetStore.list(WidgetStore.java:121)
> at org.apache.hadoop.chukwa.rest.bean.WidgetBean.update(WidgetBean.java:158)
> at org.apache.hadoop.chukwa.rest.bean.ColumnBean.update(ColumnBean.java:63)
> at org.apache.hadoop.chukwa.rest.bean.PagesBean.update(PagesBean.java:83)
> at org.apache.hadoop.chukwa.rest.bean.ViewBean.update(ViewBean.java:127)
> at org.apache.hadoop.chukwa.datastore.ViewStore.load(ViewStore.java:92)
> at org.apache.hadoop.chukwa.datastore.ViewStore.<init>(ViewStore.java:61)
> at
> org.apache.hadoop.chukwa.rest.resource.ViewResource.getView(ViewResource.java:52)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
> at
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
> at
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
> at
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
> at
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
> at
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
> at
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
> at
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
> at
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)

Re: Unable to start hicc

Prakhar Srivastava 2012-05-22, 15:24

Hi Eric,
Thanks for the response.

The hicc running user is the hadoop user. So read/write permissions are
fine. I anyways changed hicc permissions to 777.
*The hicc directory looks like:*
*Name*
*Type*
*Size*
*Replication*
*Block Size*
*Modification Time*
*Permission*
*Owner*
*Group*
*views<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews&namenodeInfoPort=50070>
*
*dir*
**
**
**
*2012-05-15 17:11*
*rwxrwxrwx*
*hadoop*
*supergroup*
*widgets<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets&namenodeInfoPort=50070>
*
*dir*
**
**
**
*2012-05-15 17:11*
*rwxrwxrwx*
*hadoop*
*supergroup
*

*The views directory*
*Name*
*Type*
*Size*
*Replication*
*Block Size*
*Modification Time*
*Permission*
*Owner*
*Group*
*public<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic&namenodeInfoPort=50070>
*
*dir*
**
**
**
*2012-05-15 17:11*
*rwxrwxrwx*
*hadoop*
*supergroup*
*users<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fusers&namenodeInfoPort=50070>
*
*dir*
**
**
**
*2012-05-15 17:11*
*rwxrwxrwx*
*hadoop*
*supergroup
*
*the public directory*
*Name*
*Type*
*Size*
*Replication*
*Block Size*
*Modification Time*
*Permission*
*Owner*
*Group*
*default.view<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fdefault.view&namenodeInfoPort=50070>
*
*file*
*29.66 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*newview.tpl<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fnewview.tpl&namenodeInfoPort=50070>
*
*file*
*0.23 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*view.permission<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fview.permission&namenodeInfoPort=50070>
*
*file*
*0.04 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*workspace_view_list.cache<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fworkspace_view_list.cache&namenodeInfoPort=50070>
*
*file*
*0.1 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup
*

*and the widget directory*
*cluster_metrics.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fcluster_metrics.descriptor&namenodeInfoPort=50070>
*
*file*
*3.54 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*cluster_selector.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fcluster_selector.descriptor&namenodeInfoPort=50070>
*
*file*
*0.32 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*debug.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fdebug.descriptor&namenodeInfoPort=50070>
*
*file*
*0.25 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*dfs_datanode.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fdfs_datanode.descriptor&namenodeInfoPort=50070>
*
*file*
*4.78 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*dfs_fsnamesystem.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fdfs_fsnamesystem.descriptor&namenodeInfoPort=50070>
*
*file*
*2.36 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*dfs_namenode.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fdfs_namenode.descriptor&namenodeInfoPort=50070>
*
*file*
*3.53 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*disabled<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fdisabled&namenodeInfoPort=50070>
*
*file*
*0 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*event_viewer.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fevent_viewer.descriptor&namenodeInfoPort=50070>
*
*file*
*0.43 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*graph_explorer.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fgraph_explorer.descriptor&namenodeInfoPort=50070>
*
*file*
*0.79 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*hadoop_mapred.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fhadoop_mapred.descriptor&namenodeInfoPort=50070>
*
*file*
*2.34 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*host_selector.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fhost_selector.descriptor&namenodeInfoPort=50070>
*
*file*
*0.45 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*system_metrics.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fsystem_metrics.descriptor&namenodeInfoPort=50070>
*
*file*
*5.34 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*time.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Ftime.descriptor&namenodeInfoPort=50070>
*
*file*
*0.54 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*
*utilization.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Futilization.descriptor&namenodeInfoPort=50070>
*
*file*
*1.15 KB*
*3*
*64 MB*
*2012-05-15 17:11*
*rw-rw-rw-*
*hadoop*
*supergroup*

The HDFS version is 1.0.0. It exactly matches the hadoop jar file version
in share/chukwa/lib.

The HADOOP_CONF_DIR is defined in chukwa-env.sh

Thanks,
Prakhar

On Tue, May 22, 2012 at 10:21 AM, Eric Yang <[EMAIL PROTECTED]> wrote:

Re: Unable to start hicc

Eric Yang 2012-05-22, 15:31

Hi Prakhar,

Try to remove the disabled directory from widget directory and restart hicc. It looks like the widgetbean is throwing null pointer exception when attempt to serialized the disabled directory. I remember to put a fix for this in trunk, but it may not have been in 0.5.

Sent from my iPhone

On May 22, 2012, at 8:24 AM, Prakhar Srivastava <[EMAIL PROTECTED]> wrote:

> Hi Eric,
> Thanks for the response.
>
> The hicc running user is the hadoop user. So read/write permissions are fine. I anyways changed hicc permissions to 777.
> The hicc directory looks like:
> Name
> Type
> Size
> Replication
> Block Size
> Modification Time
> Permission
> Owner
> Group
> views
> dir
>
>
>
> 2012-05-15 17:11
> rwxrwxrwx
> hadoop
> supergroup
> widgets
> dir
>
>
>
> 2012-05-15 17:11
> rwxrwxrwx
> hadoop
> supergroup
>
>
> The views directory
> Name
> Type
> Size
> Replication
> Block Size
> Modification Time
> Permission
> Owner
> Group
> public
> dir
>
>
>
> 2012-05-15 17:11
> rwxrwxrwx
> hadoop
> supergroup
> users
> dir
>
>
>
> 2012-05-15 17:11
> rwxrwxrwx
> hadoop
> supergroup
>
> the public directory
> Name
> Type
> Size
> Replication
> Block Size
> Modification Time
> Permission
> Owner
> Group
> default.view
> file
> 29.66 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> newview.tpl
> file
> 0.23 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> view.permission
> file
> 0.04 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> workspace_view_list.cache
> file
> 0.1 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
>
>
>
>
> and the widget directory
> cluster_metrics.descriptor
> file
> 3.54 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> cluster_selector.descriptor
> file
> 0.32 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> debug.descriptor
> file
> 0.25 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> dfs_datanode.descriptor
> file
> 4.78 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> dfs_fsnamesystem.descriptor
> file
> 2.36 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> dfs_namenode.descriptor
> file
> 3.53 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> disabled
> file
> 0 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> event_viewer.descriptor
> file
> 0.43 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> graph_explorer.descriptor
> file
> 0.79 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> hadoop_mapred.descriptor
> file
> 2.34 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> host_selector.descriptor
> file
> 0.45 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> system_metrics.descriptor
> file
> 5.34 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> time.descriptor
> file
> 0.54 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
> utilization.descriptor
> file
> 1.15 KB
> 3
> 64 MB
> 2012-05-15 17:11
> rw-rw-rw-
> hadoop
> supergroup
>
>
> The HDFS version is 1.0.0. It exactly matches the hadoop jar file version in share/chukwa/lib.
>
> The HADOOP_CONF_DIR is defined in chukwa-env.sh
>
> Thanks,
> Prakhar
>
> On Tue, May 22, 2012 at 10:21 AM, Eric Yang <[EMAIL PROTECTED]> wrote:
> Base on the stacktrace, it looks like the descriptor file reading from
> hdfs contains invalid json.
> Does hicc running user have access to read/write from
> hdfs://host:port/chukwa/hicc?
> What does the directory looks like in hdfs? In addition, what is the
> hdfs version? Does it match
> hadoop jar file in chukwa lib? Is HADOOP_CONF_DIR in the classpath?
>
> regards,
> Eric
>
> On Mon, May 21, 2012 at 12:41 AM, Prakhar Srivastava
> <[EMAIL PROTECTED]> wrote:
> > Hi Eric,
> >
> > After struggling through the above error for an hour or two. I found out
>

Re: Unable to start hicc

Prakhar Srivastava 2012-05-23, 06:22

Hi Eric,
I removed the disabled directory. I also had to modify the
utilization.descriptor file because of some mismatched parenthesis.

Now, the HICC dashboard loads fine. However, the charts are not getting
populated. Only the Job summary widget lists the recently run jobs which
concludes that HICC is able to talk to HBase. I can view the contents in
the HBase tables like ClusterSummary using the HBase shell.

Can you suggest how can I debug this since I am not getting any exceptions
in the HICC logs.

Thanks,
Prakhar

On Tue, May 22, 2012 at 9:01 PM, Eric Yang <[EMAIL PROTECTED]> wrote:

> Hi Prakhar,
>
> Try to remove the disabled directory from widget directory and restart
> hicc. It looks like the widgetbean is throwing null pointer exception when
> attempt to serialized the disabled directory. I remember to put a fix for
> this in trunk, but it may not have been in 0.5.
>
> Sent from my iPhone
>
> On May 22, 2012, at 8:24 AM, Prakhar Srivastava <[EMAIL PROTECTED]>
> wrote:
>
> Hi Eric,
> Thanks for the response.
>
> The hicc running user is the hadoop user. So read/write permissions are
> fine. I anyways changed hicc permissions to 777.
> *The hicc directory looks like:*
> *Name*
> *Type*
> *Size*
> *Replication*
> *Block Size*
> *Modification Time*
> *Permission*
> *Owner*
> *Group*
> *views<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews&namenodeInfoPort=50070>
> *
> *dir*
> **
> **
> **
> *2012-05-15 17:11*
> *rwxrwxrwx*
> *hadoop*
> *supergroup*
> *widgets<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets&namenodeInfoPort=50070>
> *
> *dir*
> **
> **
> **
> *2012-05-15 17:11*
> *rwxrwxrwx*
> *hadoop*
> *supergroup
> *
>
> *The views directory*
> *Name*
> *Type*
> *Size*
> *Replication*
> *Block Size*
> *Modification Time*
> *Permission*
> *Owner*
> *Group*
> *public<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic&namenodeInfoPort=50070>
> *
> *dir*
> **
> **
> **
> *2012-05-15 17:11*
> *rwxrwxrwx*
> *hadoop*
> *supergroup*
> *users<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fusers&namenodeInfoPort=50070>
> *
> *dir*
> **
> **
> **
> *2012-05-15 17:11*
> *rwxrwxrwx*
> *hadoop*
> *supergroup
> *
> *the public directory*
> *Name*
> *Type*
> *Size*
> *Replication*
> *Block Size*
> *Modification Time*
> *Permission*
> *Owner*
> *Group*
> *default.view<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fdefault.view&namenodeInfoPort=50070>
> *
> *file*
> *29.66 KB*
> *3*
> *64 MB*
> *2012-05-15 17:11*
> *rw-rw-rw-*
> *hadoop*
> *supergroup*
> *newview.tpl<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fnewview.tpl&namenodeInfoPort=50070>
> *
> *file*
> *0.23 KB*
> *3*
> *64 MB*
> *2012-05-15 17:11*
> *rw-rw-rw-*
> *hadoop*
> *supergroup*
> *view.permission<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fview.permission&namenodeInfoPort=50070>
> *
> *file*
> *0.04 KB*
> *3*
> *64 MB*
> *2012-05-15 17:11*
> *rw-rw-rw-*
> *hadoop*
> *supergroup*
> *workspace_view_list.cache<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fworkspace_view_list.cache&namenodeInfoPort=50070>
> *
> *file*
> *0.1 KB*
> *3*
> *64 MB*
> *2012-05-15 17:11*
> *rw-rw-rw-*
> *hadoop*
> *supergroup
> *
>
>
>
> *and the widget directory*
> *cluster_metrics.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fcluster_metrics.descriptor&namenodeInfoPort=50070>
> *
> *file*
> *3.54 KB*
> *3*
> *64 MB*
> *2012-05-15 17:11*
> *rw-rw-rw-*
> *hadoop*
> *supergroup*
> *cluster_selector.descriptor<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets%2Fcluster_selector.descriptor&namenodeInfoPort=50070>
> *
> *file*
> *0.32 KB*

Re: Unable to start hicc

Eric Yang 2012-05-23, 06:33

Hi Prakhar,

If you have data in cluster summary, this means the system is working as
expected and data analytics script is aggregating fine. Could it be
timezone issue? Chukwa expects the server to run on UTC time zone to
prevent day light saving time to have over lapping data. Javascript layer
translates UTC time to local timezone. If the server is running in a
different timezone, it could offset the UI display time by n number of
hours. You can try to look at data from last 7 days to see if any data is
getting populated? You can also use graph explorer to browse the data in
HBase. Hope this helps.

regards,
Eric

On Tue, May 22, 2012 at 11:22 PM, Prakhar Srivastava
<[EMAIL PROTECTED]>wrote:

> Hi Eric,
> I removed the disabled directory. I also had to modify the
> utilization.descriptor file because of some mismatched parenthesis.
>
> Now, the HICC dashboard loads fine. However, the charts are not getting
> populated. Only the Job summary widget lists the recently run jobs which
> concludes that HICC is able to talk to HBase. I can view the contents in
> the HBase tables like ClusterSummary using the HBase shell.
>
> Can you suggest how can I debug this since I am not getting any exceptions
> in the HICC logs.
>
> Thanks,
> Prakhar
>
>
> On Tue, May 22, 2012 at 9:01 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
>
>> Hi Prakhar,
>>
>> Try to remove the disabled directory from widget directory and restart
>> hicc. It looks like the widgetbean is throwing null pointer exception when
>> attempt to serialized the disabled directory. I remember to put a fix for
>> this in trunk, but it may not have been in 0.5.
>>
>> Sent from my iPhone
>>
>> On May 22, 2012, at 8:24 AM, Prakhar Srivastava <[EMAIL PROTECTED]>
>> wrote:
>>
>> Hi Eric,
>> Thanks for the response.
>>
>> The hicc running user is the hadoop user. So read/write permissions are
>> fine. I anyways changed hicc permissions to 777.
>> *The hicc directory looks like:*
>> *Name*
>> *Type*
>> *Size*
>> *Replication*
>> *Block Size*
>> *Modification Time*
>> *Permission*
>> *Owner*
>> *Group*
>> *views<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews&namenodeInfoPort=50070>
>> *
>> *dir*
>> **
>> **
>> **
>> *2012-05-15 17:11*
>> *rwxrwxrwx*
>> *hadoop*
>> *supergroup*
>> *widgets<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets&namenodeInfoPort=50070>
>> *
>> *dir*
>> **
>> **
>> **
>> *2012-05-15 17:11*
>> *rwxrwxrwx*
>> *hadoop*
>> *supergroup
>> *
>>
>> *The views directory*
>> *Name*
>> *Type*
>> *Size*
>> *Replication*
>> *Block Size*
>> *Modification Time*
>> *Permission*
>> *Owner*
>> *Group*
>> *public<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic&namenodeInfoPort=50070>
>> *
>> *dir*
>> **
>> **
>> **
>> *2012-05-15 17:11*
>> *rwxrwxrwx*
>> *hadoop*
>> *supergroup*
>> *users<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fusers&namenodeInfoPort=50070>
>> *
>> *dir*
>> **
>> **
>> **
>> *2012-05-15 17:11*
>> *rwxrwxrwx*
>> *hadoop*
>> *supergroup
>> *
>> *the public directory*
>> *Name*
>> *Type*
>> *Size*
>> *Replication*
>> *Block Size*
>> *Modification Time*
>> *Permission*
>> *Owner*
>> *Group*
>> *default.view<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fdefault.view&namenodeInfoPort=50070>
>> *
>> *file*
>> *29.66 KB*
>> *3*
>> *64 MB*
>> *2012-05-15 17:11*
>> *rw-rw-rw-*
>> *hadoop*
>> *supergroup*
>> *newview.tpl<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fnewview.tpl&namenodeInfoPort=50070>
>> *
>> *file*
>> *0.23 KB*
>> *3*
>> *64 MB*
>> *2012-05-15 17:11*
>> *rw-rw-rw-*
>> *hadoop*
>> *supergroup*
>> *view.permission<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fview.permission&namenodeInfoPort=50070>
>> *
>> *file*
>> *0.04 KB*
>

Re: Unable to start hicc

Prakhar Srivastava 2012-05-23, 06:49

Hi Eric,
While I check on your points,I found that the Cluster selector drop down
show no cluster. The drop down menu is empty. Could this be an issue???

Thanks,
Prakhar

On Wed, May 23, 2012 at 12:03 PM, Eric Yang <[EMAIL PROTECTED]> wrote:

> Hi Prakhar,
>
> If you have data in cluster summary, this means the system is working as
> expected and data analytics script is aggregating fine. Could it be
> timezone issue? Chukwa expects the server to run on UTC time zone to
> prevent day light saving time to have over lapping data. Javascript layer
> translates UTC time to local timezone. If the server is running in a
> different timezone, it could offset the UI display time by n number of
> hours. You can try to look at data from last 7 days to see if any data is
> getting populated? You can also use graph explorer to browse the data in
> HBase. Hope this helps.
>
> regards,
> Eric
>
>
> On Tue, May 22, 2012 at 11:22 PM, Prakhar Srivastava <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Eric,
>> I removed the disabled directory. I also had to modify the
>> utilization.descriptor file because of some mismatched parenthesis.
>>
>> Now, the HICC dashboard loads fine. However, the charts are not getting
>> populated. Only the Job summary widget lists the recently run jobs which
>> concludes that HICC is able to talk to HBase. I can view the contents in
>> the HBase tables like ClusterSummary using the HBase shell.
>>
>> Can you suggest how can I debug this since I am not getting any
>> exceptions in the HICC logs.
>>
>> Thanks,
>> Prakhar
>>
>>
>> On Tue, May 22, 2012 at 9:01 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
>>
>>> Hi Prakhar,
>>>
>>> Try to remove the disabled directory from widget directory and restart
>>> hicc. It looks like the widgetbean is throwing null pointer exception when
>>> attempt to serialized the disabled directory. I remember to put a fix for
>>> this in trunk, but it may not have been in 0.5.
>>>
>>> Sent from my iPhone
>>>
>>> On May 22, 2012, at 8:24 AM, Prakhar Srivastava <[EMAIL PROTECTED]>
>>> wrote:
>>>
>>> Hi Eric,
>>> Thanks for the response.
>>>
>>> The hicc running user is the hadoop user. So read/write permissions are
>>> fine. I anyways changed hicc permissions to 777.
>>> *The hicc directory looks like:*
>>> *Name*
>>> *Type*
>>> *Size*
>>> *Replication*
>>> *Block Size*
>>> *Modification Time*
>>> *Permission*
>>> *Owner*
>>> *Group*
>>> *views<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews&namenodeInfoPort=50070>
>>> *
>>> *dir*
>>> **
>>> **
>>> **
>>> *2012-05-15 17:11*
>>> *rwxrwxrwx*
>>> *hadoop*
>>> *supergroup*
>>> *widgets<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets&namenodeInfoPort=50070>
>>> *
>>> *dir*
>>> **
>>> **
>>> **
>>> *2012-05-15 17:11*
>>> *rwxrwxrwx*
>>> *hadoop*
>>> *supergroup
>>> *
>>>
>>> *The views directory*
>>> *Name*
>>> *Type*
>>> *Size*
>>> *Replication*
>>> *Block Size*
>>> *Modification Time*
>>> *Permission*
>>> *Owner*
>>> *Group*
>>> *public<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic&namenodeInfoPort=50070>
>>> *
>>> *dir*
>>> **
>>> **
>>> **
>>> *2012-05-15 17:11*
>>> *rwxrwxrwx*
>>> *hadoop*
>>> *supergroup*
>>> *users<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fusers&namenodeInfoPort=50070>
>>> *
>>> *dir*
>>> **
>>> **
>>> **
>>> *2012-05-15 17:11*
>>> *rwxrwxrwx*
>>> *hadoop*
>>> *supergroup
>>> *
>>> *the public directory*
>>> *Name*
>>> *Type*
>>> *Size*
>>> *Replication*
>>> *Block Size*
>>> *Modification Time*
>>> *Permission*
>>> *Owner*
>>> *Group*
>>> *default.view<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fdefault.view&namenodeInfoPort=50070>
>>> *
>>> *file*
>>> *29.66 KB*
>>> *3*
>>> *64 MB*
>>> *2012-05-15 17:11*
>>> *rw-rw-rw-*
>>> *hadoop*
>>> *supergroup*
>>> *newview.tpl<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic%2Fnewview.tpl&namenodeInfoPort=50070>

Re: Unable to start hicc

Eric Yang 2012-05-24, 06:17

Yes, this means the ClusterSummary table has not been populated. You need
to run Apache Pig with ClusterSummary.pig script to aggregate the data.
Without doing that, you can try to use Graph Explorer to see what is
collected as raw data on HBase.

regards,
Eric

On Tue, May 22, 2012 at 11:49 PM, Prakhar Srivastava
<[EMAIL PROTECTED]>wrote:

> Hi Eric,
> While I check on your points,I found that the Cluster selector drop down
> show no cluster. The drop down menu is empty. Could this be an issue???
>
> Thanks,
> Prakhar
>
> On Wed, May 23, 2012 at 12:03 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
>
>> Hi Prakhar,
>>
>> If you have data in cluster summary, this means the system is working as
>> expected and data analytics script is aggregating fine. Could it be
>> timezone issue? Chukwa expects the server to run on UTC time zone to
>> prevent day light saving time to have over lapping data. Javascript layer
>> translates UTC time to local timezone. If the server is running in a
>> different timezone, it could offset the UI display time by n number of
>> hours. You can try to look at data from last 7 days to see if any data is
>> getting populated? You can also use graph explorer to browse the data in
>> HBase. Hope this helps.
>>
>> regards,
>> Eric
>>
>>
>> On Tue, May 22, 2012 at 11:22 PM, Prakhar Srivastava <
>> [EMAIL PROTECTED]> wrote:
>>
>>> Hi Eric,
>>> I removed the disabled directory. I also had to modify the
>>> utilization.descriptor file because of some mismatched parenthesis.
>>>
>>> Now, the HICC dashboard loads fine. However, the charts are not getting
>>> populated. Only the Job summary widget lists the recently run jobs which
>>> concludes that HICC is able to talk to HBase. I can view the contents in
>>> the HBase tables like ClusterSummary using the HBase shell.
>>>
>>> Can you suggest how can I debug this since I am not getting any
>>> exceptions in the HICC logs.
>>>
>>> Thanks,
>>> Prakhar
>>>
>>>
>>> On Tue, May 22, 2012 at 9:01 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
>>>
>>>> Hi Prakhar,
>>>>
>>>> Try to remove the disabled directory from widget directory and restart
>>>> hicc. It looks like the widgetbean is throwing null pointer exception when
>>>> attempt to serialized the disabled directory. I remember to put a fix for
>>>> this in trunk, but it may not have been in 0.5.
>>>>
>>>> Sent from my iPhone
>>>>
>>>> On May 22, 2012, at 8:24 AM, Prakhar Srivastava <[EMAIL PROTECTED]>
>>>> wrote:
>>>>
>>>> Hi Eric,
>>>> Thanks for the response.
>>>>
>>>> The hicc running user is the hadoop user. So read/write permissions are
>>>> fine. I anyways changed hicc permissions to 777.
>>>> *The hicc directory looks like:*
>>>> *Name*
>>>> *Type*
>>>> *Size*
>>>> *Replication*
>>>> *Block Size*
>>>> *Modification Time*
>>>> *Permission*
>>>> *Owner*
>>>> *Group*
>>>> *views<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews&namenodeInfoPort=50070>
>>>> *
>>>> *dir*
>>>> **
>>>> **
>>>> **
>>>> *2012-05-15 17:11*
>>>> *rwxrwxrwx*
>>>> *hadoop*
>>>> *supergroup*
>>>> *widgets<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets&namenodeInfoPort=50070>
>>>> *
>>>> *dir*
>>>> **
>>>> **
>>>> **
>>>> *2012-05-15 17:11*
>>>> *rwxrwxrwx*
>>>> *hadoop*
>>>> *supergroup
>>>> *
>>>>
>>>> *The views directory*
>>>> *Name*
>>>> *Type*
>>>> *Size*
>>>> *Replication*
>>>> *Block Size*
>>>> *Modification Time*
>>>> *Permission*
>>>> *Owner*
>>>> *Group*
>>>> *public<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fpublic&namenodeInfoPort=50070>
>>>> *
>>>> *dir*
>>>> **
>>>> **
>>>> **
>>>> *2012-05-15 17:11*
>>>> *rwxrwxrwx*
>>>> *hadoop*
>>>> *supergroup*
>>>> *users<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews%2Fusers&namenodeInfoPort=50070>
>>>> *
>>>> *dir*
>>>> **
>>>> **
>>>> **
>>>> *2012-05-15 17:11*
>>>> *rwxrwxrwx*
>>>> *hadoop*
>>>> *supergroup
>>>> *

Re: Unable to start hicc

Prakhar Srivastava 2012-05-24, 12:21

Hi Eric,

The ClusterSummary table is already populated. I have once previously run
the Pig Job and it has successfully populated the ClusterSummary table.

The problem was with the HICC application not being able to load the
cluster name. I did a small workaround to find if it was the problem. I
modified the cluster variable in the index.jsp in the running HICC
application to the cluster name provided in the chukwa agent configuration.
This time, all the charts got populated. I am still not sure where does
HICC pick up the cluster name on first run.

Regards,
Prakhar

On Thu, May 24, 2012 at 11:47 AM, Eric Yang <[EMAIL PROTECTED]> wrote:

> Yes, this means the ClusterSummary table has not been populated. You need
> to run Apache Pig with ClusterSummary.pig script to aggregate the data.
> Without doing that, you can try to use Graph Explorer to see what is
> collected as raw data on HBase.
>
> regards,
> Eric
>
>
> On Tue, May 22, 2012 at 11:49 PM, Prakhar Srivastava <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Eric,
>> While I check on your points,I found that the Cluster selector drop down
>> show no cluster. The drop down menu is empty. Could this be an issue???
>>
>> Thanks,
>> Prakhar
>>
>> On Wed, May 23, 2012 at 12:03 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
>>
>>> Hi Prakhar,
>>>
>>> If you have data in cluster summary, this means the system is working as
>>> expected and data analytics script is aggregating fine. Could it be
>>> timezone issue? Chukwa expects the server to run on UTC time zone to
>>> prevent day light saving time to have over lapping data. Javascript layer
>>> translates UTC time to local timezone. If the server is running in a
>>> different timezone, it could offset the UI display time by n number of
>>> hours. You can try to look at data from last 7 days to see if any data is
>>> getting populated? You can also use graph explorer to browse the data in
>>> HBase. Hope this helps.
>>>
>>> regards,
>>> Eric
>>>
>>>
>>> On Tue, May 22, 2012 at 11:22 PM, Prakhar Srivastava <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Hi Eric,
>>>> I removed the disabled directory. I also had to modify the
>>>> utilization.descriptor file because of some mismatched parenthesis.
>>>>
>>>> Now, the HICC dashboard loads fine. However, the charts are not getting
>>>> populated. Only the Job summary widget lists the recently run jobs which
>>>> concludes that HICC is able to talk to HBase. I can view the contents in
>>>> the HBase tables like ClusterSummary using the HBase shell.
>>>>
>>>> Can you suggest how can I debug this since I am not getting any
>>>> exceptions in the HICC logs.
>>>>
>>>> Thanks,
>>>> Prakhar
>>>>
>>>>
>>>> On Tue, May 22, 2012 at 9:01 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
>>>>
>>>>> Hi Prakhar,
>>>>>
>>>>> Try to remove the disabled directory from widget directory and restart
>>>>> hicc. It looks like the widgetbean is throwing null pointer exception when
>>>>> attempt to serialized the disabled directory. I remember to put a fix for
>>>>> this in trunk, but it may not have been in 0.5.
>>>>>
>>>>> Sent from my iPhone
>>>>>
>>>>> On May 22, 2012, at 8:24 AM, Prakhar Srivastava <[EMAIL PROTECTED]>
>>>>> wrote:
>>>>>
>>>>> Hi Eric,
>>>>> Thanks for the response.
>>>>>
>>>>> The hicc running user is the hadoop user. So read/write permissions
>>>>> are fine. I anyways changed hicc permissions to 777.
>>>>> *The hicc directory looks like:*
>>>>> *Name*
>>>>> *Type*
>>>>> *Size*
>>>>> *Replication*
>>>>> *Block Size*
>>>>> *Modification Time*
>>>>> *Permission*
>>>>> *Owner*
>>>>> *Group*
>>>>> *views<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fviews&namenodeInfoPort=50070>
>>>>> *
>>>>> *dir*
>>>>> **
>>>>> **
>>>>> **
>>>>> *2012-05-15 17:11*
>>>>> *rwxrwxrwx*
>>>>> *hadoop*
>>>>> *supergroup*
>>>>> *widgets<http://binn1.clickablecorp.com:50075/browseDirectory.jsp?dir=%2Fchukwa%2Fhicc%2Fwidgets&namenodeInfoPort=50070>
>>>>> *
>>>>> *dir*
>>>>> **
>>>>> **

Re: Unable to start hicc

Eric Yang 2012-05-25, 19:27

Cluster name is found from table: SystemMetrics column family: system
column: ctag
The data is populated by Chukwa agent. In the Chukwa agent configuration,
we put extra tag cluster="demo" for the default configuration.

It may be possible that SystemMetrics table doesn't have column family:
system?

regards,
Eric

On Thu, May 24, 2012 at 5:21 AM, Prakhar Srivastava
<[EMAIL PROTECTED]>wrote:

> Hi Eric,
>
> The ClusterSummary table is already populated. I have once previously run
> the Pig Job and it has successfully populated the ClusterSummary table.
>
> The problem was with the HICC application not being able to load the
> cluster name. I did a small workaround to find if it was the problem. I
> modified the cluster variable in the index.jsp in the running HICC
> application to the cluster name provided in the chukwa agent configuration.
> This time, all the charts got populated. I am still not sure where does
> HICC pick up the cluster name on first run.
>
> Regards,
> Prakhar
>
>
> On Thu, May 24, 2012 at 11:47 AM, Eric Yang <[EMAIL PROTECTED]> wrote:
>
>> Yes, this means the ClusterSummary table has not been populated. You
>> need to run Apache Pig with ClusterSummary.pig script to aggregate the
>> data. Without doing that, you can try to use Graph Explorer to see what is
>> collected as raw data on HBase.
>>
>> regards,
>> Eric
>>
>>
>> On Tue, May 22, 2012 at 11:49 PM, Prakhar Srivastava <
>> [EMAIL PROTECTED]> wrote:
>>
>>> Hi Eric,
>>> While I check on your points,I found that the Cluster selector drop down
>>> show no cluster. The drop down menu is empty. Could this be an issue???
>>>
>>> Thanks,
>>> Prakhar
>>>
>>> On Wed, May 23, 2012 at 12:03 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
>>>
>>>> Hi Prakhar,
>>>>
>>>> If you have data in cluster summary, this means the system is working
>>>> as expected and data analytics script is aggregating fine. Could it be
>>>> timezone issue? Chukwa expects the server to run on UTC time zone to
>>>> prevent day light saving time to have over lapping data. Javascript layer
>>>> translates UTC time to local timezone. If the server is running in a
>>>> different timezone, it could offset the UI display time by n number of
>>>> hours. You can try to look at data from last 7 days to see if any data is
>>>> getting populated? You can also use graph explorer to browse the data in
>>>> HBase. Hope this helps.
>>>>
>>>> regards,
>>>> Eric
>>>>
>>>>
>>>> On Tue, May 22, 2012 at 11:22 PM, Prakhar Srivastava <
>>>> [EMAIL PROTECTED]> wrote:
>>>>
>>>>> Hi Eric,
>>>>> I removed the disabled directory. I also had to modify the
>>>>> utilization.descriptor file because of some mismatched parenthesis.
>>>>>
>>>>> Now, the HICC dashboard loads fine. However, the charts are not
>>>>> getting populated. Only the Job summary widget lists the recently run jobs
>>>>> which concludes that HICC is able to talk to HBase. I can view the contents
>>>>> in the HBase tables like ClusterSummary using the HBase shell.
>>>>>
>>>>> Can you suggest how can I debug this since I am not getting any
>>>>> exceptions in the HICC logs.
>>>>>
>>>>> Thanks,
>>>>> Prakhar
>>>>>
>>>>>
>>>>> On Tue, May 22, 2012 at 9:01 PM, Eric Yang <[EMAIL PROTECTED]> wrote:
>>>>>
>>>>>> Hi Prakhar,
>>>>>>
>>>>>> Try to remove the disabled directory from widget directory and
>>>>>> restart hicc. It looks like the widgetbean is throwing null pointer
>>>>>> exception when attempt to serialized the disabled directory. I remember to
>>>>>> put a fix for this in trunk, but it may not have been in 0.5.
>>>>>>
>>>>>> Sent from my iPhone
>>>>>>
>>>>>> On May 22, 2012, at 8:24 AM, Prakhar Srivastava <
>>>>>> [EMAIL PROTECTED]> wrote:
>>>>>>
>>>>>> Hi Eric,
>>>>>> Thanks for the response.
>>>>>>
>>>>>> The hicc running user is the hadoop user. So read/write permissions
>>>>>> are fine. I anyways changed hicc permissions to 777.
>>>>>> *The hicc directory looks like:*
>>>>>> *Name*
>>>>>> *Type*
>>>>>> *Size*
>>>>>> *Replication*