Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - Issue against Hadoop-2.0.4-alpha


Copy link to this message
-
Re: Issue against Hadoop-2.0.4-alpha
Jarek Jarcec Cecho 2013-07-26, 20:28
Thank you Sam!

We are currently working on next release (1.4.4) and we do have already release candidate ready [1]. The release is still under vote, so it's not official Sqoop release, but nevertheless, do you think that you could try reproducing the issue with this release?

Jarcec

Links:
1: http://people.apache.org/~jarcec/sqoop-1.4.4-rc0/

On Fri, Jul 26, 2013 at 03:26:13PM +0800, sam liu wrote:
> Hi Jarek,
>
> I opened a new jira https://issues.apache.org/jira/browse/SQOOP-1151, as I
> can not reopen SQOOP-541. And I set it as a Blocker issue, because we can
> use Sqoop tools on Hadoop-2.x cluster now. Please feel free to downgrade
> its severity if need.
>
> Also hope this issue could be resolved soon, as it's really important to
> us.
>
> Thanks very much!
>
>
> 2013/7/25 Jarek Jarcec Cecho <[EMAIL PROTECTED]>
>
> > Hi Sam,
> > thank you very much for following up with all those details. The classpath
> > that you've sent earlier seems correct as it contain expected HDFS jars.
> > Please don't hesitate and open the SQOOP-541 stating additional details
> > about your use case!
> >
> > Jarcec
> >
> > On Thu, Jul 25, 2013 at 11:07:22AM +0800, sam liu wrote:
> > > Hi Jarek,
> > >
> > > I think it might looks more like a bug, because my hadoop-2.0.5-alpha
> > > binary and sqoop-1.4.3.bin__hadoop-2.0.0-alpha are all downloaded from
> > > Apache community, and I set up Hadoop and Sqoop related parameters. I can
> > > ran hadoop jobs on the cluster, but I still could encounter such issue
> > when
> > > run sqoop import command.
> > >
> > > Further more, I believe my Hadoop env works well. I tried this in a way:
> > > updated hadoop-common project class FileSystem.java and recompile the
> > > project to generate a new hadoop-common-2.0.3-alpha.jar. And then,
> > replace
> > > the original share/hadoop/common/hadoop-common-2.0.3-alpha.jar in the
> > > hadoop-2.0.5-alpha binary with the new generated one. After that, I ran
> > > sqoop import tool again, and find my code changes works as expected.
> > >
> > > I found a existing jira https://issues.apache.org/jira/browse/SQOOP-541.
> > Do
> > > you agree to reopen it?
> > >
> > > Thanks!
> > >
> > >
> > >
> > > 2013/7/24 sam liu <[EMAIL PROTECTED]>
> > >
> > > > Hi Jarek,
> > > >
> > > > This issue still exists, and below is the output of jinfo:
> > > >
> > > >
> > > > Attaching to process ID 11998, please wait...
> > > > Debugger attached successfully.
> > > > Client compiler detected.
> > > > JVM version is 20.6-b01
> > > > Java System Properties:
> > > >
> > > > java.runtime.name = Java(TM) SE Runtime Environment
> > > > sun.boot.library.path = /opt/jdk1.6.0_31/jre/lib/i386
> > > > java.vm.version = 20.6-b01
> > > > hadoop.root.logger = INFO,console
> > > > java.vm.vendor = Sun Microsystems Inc.
> > > > java.vendor.url = http://java.sun.com/
> > > > path.separator = :
> > > > java.vm.name = Java HotSpot(TM) Client VM
> > > > file.encoding.pkg = sun.io
> > > > sun.java.launcher = SUN_STANDARD
> > > > user.country = US
> > > > sun.os.patch.level = unknown
> > > > java.vm.specification.name = Java Virtual Machine Specification
> > > > user.dir = /home/sqoop-1.4.3.bin__hadoop-2.0.0-alpha/bin
> > > > java.runtime.version = 1.6.0_31-b04
> > > > java.awt.graphicsenv = sun.awt.X11GraphicsEnvironment
> > > > java.endorsed.dirs = /opt/jdk1.6.0_31/jre/lib/endorsed
> > > > os.arch = i386
> > > > java.io.tmpdir = /tmp
> > > > line.separator > > > >
> > > > hadoop.log.file = hadoop.log
> > > > java.vm.specification.vendor = Sun Microsystems Inc.
> > > > os.name = Linux
> > > > hadoop.id.str = root
> > > > sun.jnu.encoding = UTF-8
> > > > java.library.path = /home/hadoop-2.0.3-alpha/lib/native
> > > > hadoop.home.dir = /home/hadoop-2.0.3-alpha
> > > > java.specification.name = Java Platform API Specification
> > > > java.class.version = 50.0
> > > > java.net.preferIPv4Stack = true
> > > > sun.management.compiler = HotSpot Client Compiler
> > > > os.version = 2.6.18-164.el5
> > > > user.home = /root