Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # user >> Sqoop is at stuck


+
hakki buyukcengiz 2013-04-24, 06:58
Copy link to this message
-
Re: Sqoop is at stuck
Hi Hakki,
would you mind sharing jstack of the stuck process?

Jarcec

On Wed, Apr 24, 2013 at 09:58:56AM +0300, hakki buyukcengiz wrote:
> Hi,
>
> I had running sqoop export commands like:
>
> sqoop export --connect 'jdbc:oracle:thin:@<ip>:<port>:<service>' --username
> DUMMY --password 'DUMMY' --table TEST_STG --export-dir
> /user/export_import/SQOOP --fields-terminated-by '\t' --lines-terminated-by
> '\n'
>
> This command had run successfully but suddenly it become falling into
> stuck. When I start, it prints the normal message like this:
>
> [root@devnode1 ~]# sqoop export --connect
> 'jdbc:oracle:thin:@<ip>:<port>:<service>'
> --username DUMMY --password 'DUMMY' --table TEST_STG --export-dir
> /user/export_import/SQOOP --fields-terminated-by '\t' --lines-terminated-by
> '\n'
> 13/04/24 09:46:19 WARN tool.BaseSqoopTool: Setting your password on the
> command-line is insecure. Consider using -P instead.
> 13/04/24 09:46:19 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/04/24 09:46:19 INFO tool.CodeGenTool: Beginning code generation
> 13/04/24 09:46:31 INFO manager.OracleManager: Time zone has been set to GMT
> 13/04/24 09:46:31 INFO manager.SqlManager: Executing SQL statement: SELECT
> t.* FROM TEST_STG t WHERE 1=0
> 13/04/24 09:46:31 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is
> /opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/bin/../lib/hadoop-0.20-mapreduce
> 13/04/24 09:46:31 INFO orm.CompilationManager: Found hadoop core jar at:
> /opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/bin/../lib/hadoop-0.20-mapreduce/hadoop-2.0.0-mr1-cdh4.2.0-core.jar
> Note:
> /tmp/sqoop-root/compile/13ac98badc5d4c43ab02815245c500e8/TEST_STG.java uses
> or overrides a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> 13/04/24 09:46:33 INFO orm.CompilationManager: Writing jar file:
> /tmp/sqoop-root/compile/13ac98badc5d4c43ab02815245c500e8/TEST_STG.jar
> 13/04/24 09:46:33 INFO mapreduce.ExportJobBase: Beginning export of
> TEST_STG_HAKKI_4
> 13/04/24 09:46:34 INFO manager.OracleManager: Time zone has been set to GMT
>
>
> And after this point sqoop gives no further message. It inserts no record
> to the db too.
> What can be the reason for this?
>
> Thanks,
>
> --
> Hakki Buyukcengiz
> TR
+
hakki buyukcengiz 2013-04-24, 15:14
+
Jarek Jarcec Cecho 2013-04-24, 15:47
+
Venkat Ranganathan 2013-04-24, 19:15
+
hakki buyukcengiz 2013-04-26, 07:38
+
Felix GV 2013-04-26, 13:46
+
Jarek Jarcec Cecho 2013-04-26, 17:42
+
hakki buyukcengiz 2013-04-27, 18:54
+
Felix GV 2013-04-27, 20:28
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB