Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Hadoop XML Error


Copy link to this message
-
Re: Hadoop XML Error
This is due to the security API not being available.  You are crossing from
a cluster with security to one without and that is causing confusion.
 Presumably your client assumes that it is available and your hadoop library
doesn't provide it.

Check your class path very carefully looking for version assumptions and
confusions.

On Mon, Feb 7, 2011 at 11:43 AM, Korb, Michael [USA]
<[EMAIL PROTECTED]>wrote:

> We're migrating from CDH3b3 to a recent build of 0.20-append published by
> Ryan Rawson. This isn't something covered by normal upgrade scripts. I've
> tried several commands with different protocols and port numbers, but now
> keep getting the same error:
>
> 11/02/07 14:35:06 INFO tools.DistCp: srcPaths=[hftp://mc00001:50070/]
> 11/02/07 14:35:06 INFO tools.DistCp: destPath=hdfs://mc00000:55310/
> Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.hadoop.mapred.JobConf.getCredentials()Lorg/apache/hadoop/security/Credentials;
>        at org.apache.hadoop.tools.DistCp.checkSrcPath(DistCp.java:632)
>        at org.apache.hadoop.tools.DistCp.copy(DistCp.java:656)
>        at org.apache.hadoop.tools.DistCp.run(DistCp.java:881)
>        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
>        at org.apache.hadoop.tools.DistCp.main(DistCp.java:908)
>
> Has anyone seen this before? What might be causing it?
>
> Thanks,
> Mike
>
>
> ________________________________________
> From: Xavier Stevens [[EMAIL PROTECTED]]
> Sent: Monday, February 07, 2011 1:47 PM
> To: [EMAIL PROTECTED]
> Subject: Re: Hadoop XML Error
>
> You don't need to distcp to upgrade a cluster.  You just need to go
> through the upgrade process.  Bumping from 0.20.2 to 0.20.3 you might
> not even need to do anything other than stop the cluster processes, and
> then restart them using the 0.20.3 install.
>
> Here's a link to the upgrade and rollback docs:
>
> http://hadoop.apache.org/common/docs/r0.20.0/hdfs_user_guide.html#Upgrade+and+Rollback
>
>
> -Xavier
>
>
> On 2/7/11 10:22 AM, Korb, Michael [USA] wrote:
> > Xavier,
> >
> > Yes, I'm trying to upgrade from 0.20.2 to 0.20.3. Both are running on the
> same cluster. I'm trying to distcp everything from the 0.20.2 instance over
> to the 0.20.3 instance, without any luck yet.
> >
> > Mike
> > ________________________________________
> > From: Xavier Stevens [[EMAIL PROTECTED]]
> > Sent: Monday, February 07, 2011 1:20 PM
> > To: [EMAIL PROTECTED]
> > Subject: Re: Hadoop XML Error
> >
> > Mike,
> >
> > Are you just trying to upgrade then?  I've never heard of anyone trying
> > to run two versions of hadoop on the same cluster.  I'm don't think
> > that's even possible, but maybe someone else knows.
> >
> > -Xavier
> >
> >
> > On 2/7/11 10:03 AM, Korb, Michael [USA] wrote:
> >> Xavier,
> >>
> >> Both instances of Hadoop are running on the same cluster. I tried the
> command "sudo -u hdfs ./hadoop distcp -update hftp://mc00001:50070/
> hdfs://mc00000:55310" from the hadoop2 bin directory (the 0.20.3 install) on
> mc00000 (the port 55310 is specified in core-site.xml). Now I'm getting
> this:
> >>
> >> 11/02/07 13:03:14 INFO tools.DistCp: srcPaths=[hftp://mc00001:50070/]
> >> 11/02/07 13:03:14 INFO tools.DistCp: destPath=hdfs://mc00000:55310
> >> Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.hadoop.mapred.JobConf.getCredentials()Lorg/apache/hadoop/security/Credentials;
> >>       at org.apache.hadoop.tools.DistCp.checkSrcPath(DistCp.java:632)
> >>       at org.apache.hadoop.tools.DistCp.copy(DistCp.java:656)
> >>       at org.apache.hadoop.tools.DistCp.run(DistCp.java:881)
> >>       at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>       at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >>       at org.apache.hadoop.tools.DistCp.main(DistCp.java:908)
> >>
> >> Thanks,
> >> Mike
> >> ________________________________________
> >> From: Xavier Stevens [[EMAIL PROTECTED]]