Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Error occurs on TestAllTables using Hadoop-2.1.0-beta jar files


Copy link to this message
-
Re: Error occurs on TestAllTables using Hadoop-2.1.0-beta jar files
Hi Jarcec,

Hadoop-2.10-beta upgraded protobuf to 2.5 from 2.4.1, but the version of
protobuf  in my env is still 2.4.1, so the sqoop unit tests failed on my
env. After I upgraded my protobuf to 2.5, all sqoop unit tests passed. So I
closed SQOOP-1195 and added comment on it. Hope others who encounter
similar issues could benefit from it.

For your another comment 'create a JIRA to upgrade the dependency on hadoop
2 to 2.1.0-beta', I opened SQOOP-1197 for it, and attached a patch on it.
Could you please help review it?

Thanks!
2013/9/9 Jarek Jarcec Cecho <[EMAIL PROTECTED]>

> Thank you Sam!
>
> Jarcec
>
> On Mon, Sep 09, 2013 at 01:33:59PM +0800, sam liu wrote:
> > Hi Jarek,
> >
> > I opened jira SQOOP-1195(UnsupportedOperationException occurs on
> > TestAllTables of Sqoop-1.4.3 with Hadoop-2.1.0-beta jar
> > files)<https://issues.apache.org/jira/browse/SQOOP-1195>for this
> > issue.
> >
> > Thanks!
> >
> >
> > 2013/9/8 Jarek Jarcec Cecho <[EMAIL PROTECTED]>
> >
> > > Hi Sam,
> > > thank you very much for trying this out! Hadoop 2.1.0 do not necessary
> > > have to be API compatible with the 2.0.0. I would suggest you to
> create a
> > > JIRA to upgrade the dependency on hadoop 2 to 2.1.0-beta and solve the
> > > failing test cases there.
> > >
> > > Jarcec
> > >
> > > On Fri, Sep 06, 2013 at 05:39:16PM +0800, sam liu wrote:
> > > > Hi,
> > > >
> > > > For Sqoop-1.4.3 project, I updated build.xml and ivy.xml file to try
> to
> > > run
> > > > build/UT with Hadoop-2.1.0-beta jar files. The compile could be
> > > successful.
> > > > However, encounter following error when run UT. Any comments? Thanks!
> > > >
> > > >  <system-err><![CDATA[[Server@260f260f]: [Thread[HSQLDB Server
> > > > @260f260f,5,main]]: run()/openServerSocket():
> > > > java.net.BindException: Address already in use
> > > >         at java.net.PlainSocketImpl.socketBind(Native Method)
> > > >         at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:413)
> > > >         at java.net.ServerSocket.bind(ServerSocket.java:339)
> > > >         at java.net.ServerSocket.<init>(ServerSocket.java:205)
> > > >         at java.net.ServerSocket.<init>(ServerSocket.java:117)
> > > >         at org.hsqldb.HsqlSocketFactory.createServerSocket(Unknown
> > > Source)
> > > >         at org.hsqldb.Server.openServerSocket(Unknown Source)
> > > >         at org.hsqldb.Server.run(Unknown Source)
> > > >         at org.hsqldb.Server.access$000(Unknown Source)
> > > >         at org.hsqldb.Server$ServerThread.run(Unknown Source)
> > > > Note:
> > > >
> > >
> /home/hadoop/sqoop/build/test/data/sqoop-hadoop/compile/cd361bd4917aa57041c693c16e0b1ff0/IMPORT_TABLE_1.java
> > > > uses or overrides a deprecated API.
> > > > Note: Recompile with -Xlint:deprecation for details.
> > > > java.lang.UnsupportedOperationException: This is supposed to be
> > > overridden
> > > > by subclasses.
> > > >         at
> > > >
> > >
> com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
> > > >         at
> > > >
> > >
> org.apache.hadoop.yarn.proto.YarnProtos$URLProto.hashCode(YarnProtos.java:5487)
> > > >         at
> > > >
> > >
> org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.hashCode(YarnProtos.java:6167)
> > > >         at
> > > >
> > >
> org.apache.hadoop.yarn.api.records.impl.pb.LocalResourcePBImpl.hashCode(LocalResourcePBImpl.java:62)
> > > >         at java.util.HashMap.hash(HashMap.java:132)
> > > >         at java.util.HashMap.putImpl(HashMap.java:695)
> > > >         at java.util.HashMap.put(HashMap.java:680)
> > > >         at
> > > >
> > >
> org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:139)
> > > >         at
> > > >
> > >
> org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:155)
> > > >         at
> > > >
> > >
> org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:634)
> > > >         at
> > > >
> > >
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:415)
Sam Liu
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB