Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Chukwa >> mail # user >> How to begin with Chukwa


Copy link to this message
-
Re: How to begin with Chukwa
Unfortunately, the conf/collectors config file is used in different ways
(with different expected formats) by the agent and the collector. See this
discussion:

http://lucene.472066.n3.nabble.com/Chukwa-setup-issues-tt2764763.html#a2765143

If you try to run both processes frmo the same configs, you'll run into
issues.
On Thu, Nov 10, 2011 at 1:51 PM, TARIQ <[EMAIL PROTECTED]> wrote:

> Here is the collector.log file -
>
> 2011-11-11 03:20:37,394 INFO main ChukwaConfiguration - chukwaConf is
> /home/prashant/chukwa-0.4.0/bin/../conf
> 2011-11-11 03:20:38,960 INFO main root - initing servletCollector
> 2011-11-11 03:20:38,967 INFO main PipelineStageWriter - using
> pipelined writers, pipe length is 2
> 2011-11-11 03:20:38,972 INFO Thread-6 SocketTeeWriter - listen thread
> started
> 2011-11-11 03:20:38,979 INFO main SeqFileWriter - rotateInterval is 300000
> 2011-11-11 03:20:38,979 INFO main SeqFileWriter - outputDir is
> /chukwa/logs/
> 2011-11-11 03:20:38,979 INFO main SeqFileWriter - fsname is
> hdfs://localhost:9000/
> 2011-11-11 03:20:38,979 INFO main SeqFileWriter - filesystem type from
> core-default.xml is org.apache.hadoop.hdfs.DistributedFileSystem
> 2011-11-11 03:20:39,205 ERROR main SeqFileWriter - can't connect to
> HDFS, trying default file system instead (likely to be local)
> java.lang.NoClassDefFoundError:
> org/apache/commons/configuration/Configuration
>         at
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<init>(DefaultMetricsSystem.java:37)
>
>         at
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<clinit>(DefaultMetricsSystem.java:34)
>
>         at
> org.apache.hadoop.security.UgiInstrumentation.create(UgiInstrumentation.java:51)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:196)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:159)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:216)
>
>         at
> org.apache.hadoop.security.KerberosName.<clinit>(KerberosName.java:83)
>         at
> org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:189)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:159)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:216)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:409)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:395)
>
>         at
> org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1418)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1319)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
>         at
> org.apache.hadoop.chukwa.datacollection.writer.SeqFileWriter.init(SeqFileWriter.java:123)
>
>         at
> org.apache.hadoop.chukwa.datacollection.writer.PipelineStageWriter.init(PipelineStageWriter.java:88)
>
>         at
> org.apache.hadoop.chukwa.datacollection.collector.servlet.ServletCollector.init(ServletCollector.java:112)
>
>         at
> org.mortbay.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:433)
>         at
> org.mortbay.jetty.servlet.ServletHolder.doStart(ServletHolder.java:256)
>         at
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:39)
>         at
> org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:616)
>
>         at
> org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
>         at
> org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:513)
>         at
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:39)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
>         at org.mortbay.jetty.Server.doStart(Server.java:222)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB