Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # dev >> ClassNotFoundException: org.apache.commons.io.FileUtils


+
Ted Yu 2012-05-18, 03:01
+
Todd Lipcon 2012-05-18, 03:06
+
Ted Yu 2012-05-18, 03:11
+
Ted Yu 2012-05-18, 04:37
Copy link to this message
-
Re: ClassNotFoundException: org.apache.commons.io.FileUtils
Looks like this is caused by HADOOP-6963, which introduced commons-io
2.1 in ivy.xml but forgot to update the hadoop-core-pom-template.xml.
The old version (1.3.2) of the commons-io is probably an existing
transient dependency. Please file a blocker/critical bug for
1.0.4/1.1.0. The workaround would be explicitly include commons-io 2.1
in downstream projects, but it's not the right thing to do.

__Luke

On Thu, May 17, 2012 at 9:37 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> I changed hadoop version to 1.0.2 and the test passed.
>
> I would tend to say 1.0.3 had a regression in this regard.
>
> Cheers
>
> On Thu, May 17, 2012 at 8:11 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
>> Correction to my first email:
>> I refreshed my HBase 0.92 workspace and I could see the same test failure.
>>
>> Under ~/.m2/repository/org/apache/commons/commons-io, I still see 1.3.2
>>
>> I ran 'mvn dependency:tree' under 0.92 and don't see commons-io in the
>> output.
>>
>> Do we need to include commons-io explicitly in our pom.xml ?
>>
>> For Todd's question:
>>
>> LM-SJN-00713032:205-hadoop zhihyu$ svn info
>> Path: .
>> URL: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1
>> Repository Root: https://svn.apache.org/repos/asf
>> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
>> Revision: 1339961
>> Node Kind: directory
>> Schedule: normal
>> Last Changed Author: mattf
>> Last Changed Rev: 1339945
>> Last Changed Date: 2012-05-17 18:25:57 -0700 (Thu, 17 May 2012)
>>
>> The line I referenced in my first email came from ivy/libraries.properties
>>
>>
>> On Thu, May 17, 2012 at 8:06 PM, Todd Lipcon <[EMAIL PROTECTED]> wrote:
>>
>>> I believe we upgraded to commons-io 3.0 in 1.0.3. Did you check the 1.0.3
>>> pom?
>>>
>>> -Todd
>>>
>>> On Thu, May 17, 2012 at 8:01 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>>> > Hi,
>>> > HBase 0.92 upgraded hadoop to 1.0.3 today.
>>> > We started seeing some test failures which we didn't see before. e.g.:
>>> >
>>> https://builds.apache.org/view/G-L/view/HBase/job/HBase-0.92/410/testReport/org.apache.hadoop.hbase.mapred/TestTableMapReduce/testMultiRegionTable/
>>> > Here is the interesting part:
>>> >
>>> > Caused by: java.lang.ClassNotFoundException:
>>> org.apache.commons.io.FileUtils
>>> >        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>>> >        at java.security.AccessController.doPrivileged(Native Method)
>>> >        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>> >        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>>> >        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> >        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>>> >        ... 15 more
>>> >
>>> > In hadoop 1.0, I see:
>>> > commons-io.version=2.1
>>> >
>>> > HBase doesn't specify commons-io version.
>>> >
>>> > When I run the same test on MacBook, I don't see the test fail.
>>> >
>>> > commons-io in local mvn repo is 1.3.2
>>> >
>>> > If someone can give me hint on why the unit test failed, that would be
>>> > great.
>>>
>>>
>>>
>>> --
>>> Todd Lipcon
>>> Software Engineer, Cloudera
>>>
>>
>>
+
Ted Yu 2012-05-20, 01:25
+
Ted Yu 2012-05-20, 01:35
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB