Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Issue against Hadoop-2.0.4-alpha


Copy link to this message
-
Re: Issue against Hadoop-2.0.4-alpha
Hi Sam,
thank you very much for following up with all those details. The classpath that you've sent earlier seems correct as it contain expected HDFS jars. Please don't hesitate and open the SQOOP-541 stating additional details about your use case!

Jarcec

On Thu, Jul 25, 2013 at 11:07:22AM +0800, sam liu wrote:
> Hi Jarek,
>
> I think it might looks more like a bug, because my hadoop-2.0.5-alpha
> binary and sqoop-1.4.3.bin__hadoop-2.0.0-alpha are all downloaded from
> Apache community, and I set up Hadoop and Sqoop related parameters. I can
> ran hadoop jobs on the cluster, but I still could encounter such issue when
> run sqoop import command.
>
> Further more, I believe my Hadoop env works well. I tried this in a way:
> updated hadoop-common project class FileSystem.java and recompile the
> project to generate a new hadoop-common-2.0.3-alpha.jar. And then, replace
> the original share/hadoop/common/hadoop-common-2.0.3-alpha.jar in the
> hadoop-2.0.5-alpha binary with the new generated one. After that, I ran
> sqoop import tool again, and find my code changes works as expected.
>
> I found a existing jira https://issues.apache.org/jira/browse/SQOOP-541. Do
> you agree to reopen it?
>
> Thanks!
>
>
>
> 2013/7/24 sam liu <[EMAIL PROTECTED]>
>
> > Hi Jarek,
> >
> > This issue still exists, and below is the output of jinfo:
> >
> >
> > Attaching to process ID 11998, please wait...
> > Debugger attached successfully.
> > Client compiler detected.
> > JVM version is 20.6-b01
> > Java System Properties:
> >
> > java.runtime.name = Java(TM) SE Runtime Environment
> > sun.boot.library.path = /opt/jdk1.6.0_31/jre/lib/i386
> > java.vm.version = 20.6-b01
> > hadoop.root.logger = INFO,console
> > java.vm.vendor = Sun Microsystems Inc.
> > java.vendor.url = http://java.sun.com/
> > path.separator = :
> > java.vm.name = Java HotSpot(TM) Client VM
> > file.encoding.pkg = sun.io
> > sun.java.launcher = SUN_STANDARD
> > user.country = US
> > sun.os.patch.level = unknown
> > java.vm.specification.name = Java Virtual Machine Specification
> > user.dir = /home/sqoop-1.4.3.bin__hadoop-2.0.0-alpha/bin
> > java.runtime.version = 1.6.0_31-b04
> > java.awt.graphicsenv = sun.awt.X11GraphicsEnvironment
> > java.endorsed.dirs = /opt/jdk1.6.0_31/jre/lib/endorsed
> > os.arch = i386
> > java.io.tmpdir = /tmp
> > line.separator > >
> > hadoop.log.file = hadoop.log
> > java.vm.specification.vendor = Sun Microsystems Inc.
> > os.name = Linux
> > hadoop.id.str = root
> > sun.jnu.encoding = UTF-8
> > java.library.path = /home/hadoop-2.0.3-alpha/lib/native
> > hadoop.home.dir = /home/hadoop-2.0.3-alpha
> > java.specification.name = Java Platform API Specification
> > java.class.version = 50.0
> > java.net.preferIPv4Stack = true
> > sun.management.compiler = HotSpot Client Compiler
> > os.version = 2.6.18-164.el5
> > user.home = /root
> > user.timezone = America/Los_Angeles
> > java.awt.printerjob = sun.print.PSPrinterJob
> > file.encoding = UTF-8
> > java.specification.version = 1.6
> > java.class.path > > /home/hadoop-2.0.3-alpha/etc/hadoop:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/commons-cli-1.2.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/avro-1.5.3.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jline-0.9.94.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jersey-server-1.8.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/commons-net-3.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/zookeeper-3.4.2.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/paranamer-2.3.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/snappy-java-1.0.3.2.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jetty-6.1.26.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jetty-util-6.1.26.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jsp-api-2.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/commons-el-1.0.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/guava-11.0.2.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/netty-3.2.4.Final.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/activation-1.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/hadoop-auth-2.0.3-alpha.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/servlet-api-2.5.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jersey-json-1.8.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/commons-io-2.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/commons-math-2.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/hadoop-annotations-2.0.3-alpha.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/protobuf-java-2.4.0a.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/asm-3.2.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/slf4j-api-1.6.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jettison-1.1.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/jsch-0.1.42.jar:/home/hadoop-2.0.3-alpha/share/hadoop/common/lib/commons-lang-2.5.jar:/home/hadoop-2.0.3-alpha/share/hadoop/commo