Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - Sqoop hangs


Copy link to this message
-
Re: Sqoop hangs
Abraham Elmahrek 2013-10-18, 18:02
Firas,

Happy to hear things are working.

-Abe
On Fri, Oct 18, 2013 at 5:37 AM, Firas Khasawneh <[EMAIL PROTECTED]>wrote:

>  Hi Abraham,****
>
> ** **
>
> I am not sure what happened but my machine restarted because of a patch
> update last night. After I rebooted my virtual box and restarted hadoop and
> sqoop, everything worked just fine including import into hdfs and hive.***
> *
>
> Regarding using –verbose flag, it really did not make a difference. Also
> nothing was displayed in the logs (actually there are no logs I can see for
> sqoop). Regarding hadoop, this is the binary distribution that I just
> untarred in a directory, I don’t see any separate****
>
> Mapreduce directory.****
>
> ** **
>
> Thanks,
> Firas ****
>
> ** **
>
> ** **
>
> *From:* Abraham Elmahrek [mailto:[EMAIL PROTECTED]]
> *Sent:* Thursday, October 17, 2013 10:22 PM
>
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Sqoop hangs****
>
> ** **
>
> Firas,****
>
> ** **
>
> That setting should point to the location of your hadoop mapreduce
> installation (ie. /usr/lib/hadoop-0.20-mapreduce).****
>
> ** **
>
> Sqoop uses MapReduce to distribute the transfer of data. This means that a
> MapReduce job will be created and several tasks to perform the work. Could
> you please inspect your job tracker and task logs? Also, remember to run
> your sqoop job with the "verbose" (--verbose) command to get the most out
> of logging.****
>
> ** **
>
> If you're still having difficulty, please provide your sqoop log, job
> tracker log, and relevant task logs.****
>
> ** **
>
> -Abe****
>
> ** **
>
> On Thu, Oct 17, 2013 at 1:09 PM, Firas Khasawneh <[EMAIL PROTECTED]>
> wrote:****
>
>  Hi Abraham,****
>
>  ****
>
> I am using hadoop 1.2.1. In my path, the only doubt, I have is the setting
> of HADOOP_MAPRED_HOME. I tried to set it to hadoop home, to /tmp and to a
> directory that does not exist. I am still not getting any errors. It just
> hangs and never come back.****
>
>  ****
>
> Thanks,****
>
> Firas ****
>
>  ****
>
> *From:* Firas Khasawneh
> *Sent:* Thursday, October 17, 2013 3:57 PM
> *To:* [EMAIL PROTECTED]
> *Subject:* RE: Sqoop hangs****
>
>  ****
>
> Hi Abraham,****
>
>  ****
>
> I am using Postgres 9.1 on Ubuntu. Nothing in the logs. I am also able to
> do table-list from sqoop.****
>
>  ****
>
> Thanks,****
>
> Firas****
>
>  ****
>
> *From:* Abraham Elmahrek [mailto:[EMAIL PROTECTED] <[EMAIL PROTECTED]>]
> *Sent:* Thursday, October 17, 2013 3:50 PM
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Sqoop hangs****
>
>  ****
>
> Firas,****
>
>  ****
>
> Have you checked your postgresql logs? The database could be in a
> deadlock. Also, what version of PostGreSQL are you running?****
>
>  ****
>
> -Abe****
>
>  ****
>
> On Thu, Oct 17, 2013 at 12:24 PM, Firas Khasawneh <[EMAIL PROTECTED]>
> wrote:****
>
>   Hi,****
>
>  ****
>
> When importing from a Postgres database, sqoop hangs and never exists
> unless I kill it from the command line. Any help regarding this? I am not
> seeing any errors or log files for sqoop.****
>
>  ****
>
> Thanks,****
>
> Firas****
>
>  ****
>
>   ****
>
>  ** **
>