Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> Sqoop is at stuck


+
hakki buyukcengiz 2013-04-24, 06:58
+
Jarek Jarcec Cecho 2013-04-24, 15:11
+
hakki buyukcengiz 2013-04-24, 15:14
+
Jarek Jarcec Cecho 2013-04-24, 15:47
Copy link to this message
-
Re: Sqoop is at stuck
The information referenced by Jarcec is something that will be valuable.
But one thing to check is whether you have issues with random generation
that is used internally by the JDBC driver.   You want to  modify
mapred.child.java.opts in mapred-site.xml and add
-Djava.security.egd=file:/dev/./urandom.   That is one common issue with
the use SecureRandom
Thanks

Venkat
On Wed, Apr 24, 2013 at 8:47 AM, Jarek Jarcec Cecho <[EMAIL PROTECTED]>wrote:

> Hi sir,
> jstack is a standard java tool for exploring running thread of any Java
> application. Please take a look on the official documentation for more
> information [1].
>
> In a nutshell:
> 1) Reproduce your issue
> 2) Get Sqoop PID (process id)
> 3) jstack $PID > sqoop.jstack
> 4) Send the sqoop.jstack to the mailing list
>
> Jarcec
>
> Links:
> 1: http://docs.oracle.com/javase/6/docs/technotes/tools/share/jstack.html
>
> On Wed, Apr 24, 2013 at 06:14:42PM +0300, hakki buyukcengiz wrote:
> > Hi Jarek,
> >
> > What do you mean with jstack? What i had sent was the terminal output of
> > sqoop.
> >
> > Sent from Android
> > 24 Nis 2013 17:12 tarihinde "Jarek Jarcec Cecho" <[EMAIL PROTECTED]>
> yazdı:
> >
> > > Hi Hakki,
> > > would you mind sharing jstack of the stuck process?
> > >
> > > Jarcec
> > >
> > > On Wed, Apr 24, 2013 at 09:58:56AM +0300, hakki buyukcengiz wrote:
> > > > Hi,
> > > >
> > > > I had running sqoop export commands like:
> > > >
> > > > sqoop export --connect 'jdbc:oracle:thin:@<ip>:<port>:<service>'
> > > --username
> > > > DUMMY --password 'DUMMY' --table TEST_STG --export-dir
> > > > /user/export_import/SQOOP --fields-terminated-by '\t'
> > > --lines-terminated-by
> > > > '\n'
> > > >
> > > > This command had run successfully but suddenly it become falling into
> > > > stuck. When I start, it prints the normal message like this:
> > > >
> > > > [root@devnode1 ~]# sqoop export --connect
> > > > 'jdbc:oracle:thin:@<ip>:<port>:<service>'
> > > > --username DUMMY --password 'DUMMY' --table TEST_STG --export-dir
> > > > /user/export_import/SQOOP --fields-terminated-by '\t'
> > > --lines-terminated-by
> > > > '\n'
> > > > 13/04/24 09:46:19 WARN tool.BaseSqoopTool: Setting your password on
> the
> > > > command-line is insecure. Consider using -P instead.
> > > > 13/04/24 09:46:19 INFO manager.SqlManager: Using default fetchSize of
> > > 1000
> > > > 13/04/24 09:46:19 INFO tool.CodeGenTool: Beginning code generation
> > > > 13/04/24 09:46:31 INFO manager.OracleManager: Time zone has been set
> to
> > > GMT
> > > > 13/04/24 09:46:31 INFO manager.SqlManager: Executing SQL statement:
> > > SELECT
> > > > t.* FROM TEST_STG t WHERE 1=0
> > > > 13/04/24 09:46:31 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is
> > > >
> > >
> /opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/bin/../lib/hadoop-0.20-mapreduce
> > > > 13/04/24 09:46:31 INFO orm.CompilationManager: Found hadoop core jar
> at:
> > > >
> > >
> /opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/bin/../lib/hadoop-0.20-mapreduce/hadoop-2.0.0-mr1-cdh4.2.0-core.jar
> > > > Note:
> > > >
> /tmp/sqoop-root/compile/13ac98badc5d4c43ab02815245c500e8/TEST_STG.java
> > > uses
> > > > or overrides a deprecated API.
> > > > Note: Recompile with -Xlint:deprecation for details.
> > > > 13/04/24 09:46:33 INFO orm.CompilationManager: Writing jar file:
> > > > /tmp/sqoop-root/compile/13ac98badc5d4c43ab02815245c500e8/TEST_STG.jar
> > > > 13/04/24 09:46:33 INFO mapreduce.ExportJobBase: Beginning export of
> > > > TEST_STG_HAKKI_4
> > > > 13/04/24 09:46:34 INFO manager.OracleManager: Time zone has been set
> to
> > > GMT
> > > >
> > > >
> > > > And after this point sqoop gives no further message. It inserts no
> record
> > > > to the db too.
> > > > What can be the reason for this?
> > > >
> > > > Thanks,
> > > >
> > > > --
> > > > Hakki Buyukcengiz
> > > > TR
> > >
>
+
hakki buyukcengiz 2013-04-26, 07:38
+
Felix GV 2013-04-26, 13:46
+
Jarek Jarcec Cecho 2013-04-26, 17:42
+
hakki buyukcengiz 2013-04-27, 18:54
+
Felix GV 2013-04-27, 20:28