Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Chukwa >> mail # user >> chukwa and Hadoop v0.19.x


+
Min Zhou 2010-10-24, 14:08
+
Eric Yang 2010-10-24, 17:34
+
Min Zhou 2010-10-25, 06:19
+
Eric Yang 2010-10-25, 16:43
+
Min Zhou 2010-11-04, 07:36
+
Eric Yang 2010-11-04, 23:12
Copy link to this message
-
Re: chukwa and Hadoop v0.19.x
Bah. It's unfortunate that dependency crept in. It's certainly not key
functionality; it ought to be safe to comment all those references
out.

--Ari

On Thu, Nov 4, 2010 at 12:36 AM, Min Zhou <[EMAIL PROTECTED]> wrote:
> Hi Eric,
>
> Unfortunately, We assure Chukwa 0.4.0 is not  compatible with Hadoop
> 0.19.x now.
> All agent will throw exception like below:
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/hadoop/metrics/util/MetricsRegistry
>   at org.apache.hadoop.chukwa.datacollection.agent.metrics.AgentMetrics.<init>(AgentMetrics.java:32)
>   at org.apache.hadoop.chukwa.datacollection.agent.metrics.AgentMetrics.<clinit>(AgentMetrics.java:30)
>   at org.apache.hadoop.chukwa.datacollection.agent.ChukwaAgent.<clinit>(ChukwaAgent.java:63)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.metrics.util.MetricsRegistry
>   at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:276)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
>   at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
>
> The class "MetricsRegistry" is not defined in Hadoop 0.19.x. Actually,
> it's introduced in Hadoop 0.20.0.
>
> There are a lot of refers to this this class in chukwa:
>
> AgentActivityMBean.java (2 matches)
> 25: import org.apache.hadoop.metrics.util.MetricsRegistry;
> 30: public AgentActivityMBean(final MetricsRegistry mr, final String
> serviceName) {
> AgentMetrics.java (3 matches)
> 26: import org.apache.hadoop.metrics.util.MetricsRegistry;
> 32: public MetricsRegistry registry = new MetricsRegistry();
> ChunkQueueActivityMBean.java (2 matches)
> 25: import org.apache.hadoop.metrics.util.MetricsRegistry;
> 30: public ChunkQueueActivityMBean(final MetricsRegistry mr, final
> String serviceName) {
> ChunkQueueMetrics.java (3 matches)
> 27: import org.apache.hadoop.metrics.util.MetricsRegistry;
> 32: public MetricsRegistry registry = new MetricsRegistry();
> sender
> metrics
> HttpSenderActivityMBean.java (2 matches)
> 25: import org.apache.hadoop.metrics.util.MetricsRegistry;
> 32: public HttpSenderActivityMBean(final MetricsRegistry mr, final
> String serviceName) {
> HttpSenderMetrics.java (3 matches)
> 25: import org.apache.hadoop.metrics.util.MetricsRegistry;
> 30: public MetricsRegistry registry = new MetricsRegistry();
>
> Regards,
> Min
>
> On Tue, Oct 26, 2010 at 12:43 AM, Eric Yang <[EMAIL PROTECTED]> wrote:
>> Everything works.  You don’t lose any function.
>>
>> Regards,
>> Eric
>>
>>
>> On 10/24/10 11:19 PM, "Min Zhou" <[EMAIL PROTECTED]> wrote:
>>
>> On Mon, Oct 25, 2010 at 1:34 AM, Eric Yang <[EMAIL PROTECTED]> wrote:
>>> Hi Min,
>>>
>>> It works.  Chukwa 0.4.0 is compatible to Hadoop 0.18.x.  However, we
>>> really like people to move to Hadoop 0.20 so we can remove some legacy
>>> code for supporting older version of Hadoop.
>>
>> I know it will work. Is there any function lost if we deploy it under
>> hadoop 0.19.2 rather than 0.20.2?
>>
>> Thanks,
>> Min
>>
>>
>>> regards,
>>> Eric
>>>
>>> On Sun, Oct 24, 2010 at 7:08 AM, Min Zhou <[EMAIL PROTECTED]> wrote:
>>>> Hi guys,
>>>>
>>>> From the document of Chukwa 0.4.0,  it mentions that "Note that these
>>>> directions require Hadoop 0.20.0+. Earlier versions of Hadoop do not
>>>> have the hooks that Chukwa requires in order to grab MapReduce job
>>>> logs."  Can anyone tell me the reason why chukwa requires 0.20.0+, we
>>>> know job logs and metrics are also supported by hadoop 0.19.x.
>>>>
>>>> If we deploy chukwa 0.4.0 on a hadoop cluster under the version of
>>>> 0.19.2.  What will happens?
>>>>
>>>>
>>>> Thanks,
>>>> Min
>>>>
>>>>
>>>> --
>>>> My research interests are distributed systems, parallel computing and
>>>> bytecode based virtual machine.

Ari Rabkin [EMAIL PROTECTED]
UC Berkeley Computer Science Department
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB