Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - location of log files for mapreduce job run through eclipse


Copy link to this message
-
Re: location of log files for mapreduce job run through eclipse
Sayan Kole 2013-03-07, 19:56
Ok. thanks. When I run the job from eclipse/command line, only certain
Log.info gets displayed on the console from certain files but not from
JobTracker. How do I display Log.info messages in JobTracker.java onto the
console like it does say for example Task.java shown below

13/03/07 12:31:17 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0'
done.
13/03/07 12:31:17 INFO mapred.Task:  Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@bdccedd

Thanks,
Sayan

On Thu, Mar 7, 2013 at 12:07 PM, Abdelrhman Shettia <
[EMAIL PROTECTED]> wrote:

> Hi Sayan ,
>
> May want to try to use the log4j in hadoop and place it with the
> packages/jars and validate it matches the one in the cluster or print it to
> the console .  I came across nice document that can help you in this case.
>
>
> http://www.thecloudavenue.com/2012/10/debugging-hadoop-mapreduce-program-in.html
>
>
> Thanks
> -Abdelrhaman
>
>
> On Mar 7, 2013, at 10:33 AM, Sayan Kole <[EMAIL PROTECTED]> wrote:
>
>  jobtracker in /hadoop/logs gets updated about the job status and
> everything with Log.info. But when I run it through eclipse, the log file
> of the jobtracker does not get written to. Is there somewhere in eclipse I
> have to specify something that I am missing?
>
>
>