Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Chukwa, mail # user - How to begin with Chukwa


Copy link to this message
-
Re: How to begin with Chukwa
Bill Graham 2011-11-10, 22:08
Unfortunately, the conf/collectors config file is used in different ways
(with different expected formats) by the agent and the collector. See this
discussion:

http://lucene.472066.n3.nabble.com/Chukwa-setup-issues-tt2764763.html#a2765143

If you try to run both processes frmo the same configs, you'll run into
issues.
On Thu, Nov 10, 2011 at 1:51 PM, TARIQ <[EMAIL PROTECTED]> wrote:

> Here is the collector.log file -
>
> 2011-11-11 03:20:37,394 INFO main ChukwaConfiguration - chukwaConf is
> /home/prashant/chukwa-0.4.0/bin/../conf
> 2011-11-11 03:20:38,960 INFO main root - initing servletCollector
> 2011-11-11 03:20:38,967 INFO main PipelineStageWriter - using
> pipelined writers, pipe length is 2
> 2011-11-11 03:20:38,972 INFO Thread-6 SocketTeeWriter - listen thread
> started
> 2011-11-11 03:20:38,979 INFO main SeqFileWriter - rotateInterval is 300000
> 2011-11-11 03:20:38,979 INFO main SeqFileWriter - outputDir is
> /chukwa/logs/
> 2011-11-11 03:20:38,979 INFO main SeqFileWriter - fsname is
> hdfs://localhost:9000/
> 2011-11-11 03:20:38,979 INFO main SeqFileWriter - filesystem type from
> core-default.xml is org.apache.hadoop.hdfs.DistributedFileSystem
> 2011-11-11 03:20:39,205 ERROR main SeqFileWriter - can't connect to
> HDFS, trying default file system instead (likely to be local)
> java.lang.NoClassDefFoundError:
> org/apache/commons/configuration/Configuration
>         at
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<init>(DefaultMetricsSystem.java:37)
>
>         at
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<clinit>(DefaultMetricsSystem.java:34)
>
>         at
> org.apache.hadoop.security.UgiInstrumentation.create(UgiInstrumentation.java:51)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:196)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:159)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:216)
>
>         at
> org.apache.hadoop.security.KerberosName.<clinit>(KerberosName.java:83)
>         at
> org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:189)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:159)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:216)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:409)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:395)
>
>         at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1418)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1319)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
>         at
> org.apache.hadoop.chukwa.datacollection.writer.SeqFileWriter.init(SeqFileWriter.java:123)
>
>         at
> org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter.init(PipelineStageWriter.java:88)
>
>         at
> org.apache.hadoop.chukwa.datacollection.collector.servlet.ServletCollector.init(ServletCollector.java:112)
>
>         at
> org.mortbay.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:433)
>         at
> org.mortbay.jetty.servlet.ServletHolder.doStart(ServletHolder.java:256)
>         at
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:39)
>         at
> org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:616)
>
>         at
> org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
>         at
> org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:513)
>         at
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:39)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
>         at org.mortbay.jetty.Server.doStart(Server.java:222)