Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> Displaying Map output in MapReduce


Copy link to this message
-
Re: Displaying Map output in MapReduce
Minor correction - port is 50075:
http://10.32.56.159:50075/logs/userlogs/

On Fri, Jul 2, 2010 at 12:32 AM, Alberto Luengo Cabanillas <
[EMAIL PROTECTED]> wrote:

> Hi! Supposing that you´re using a virtualized environment, you should be
> able to get to JobTracker Web Admin Interface from http://
> <your_virtualized_
> machine_ip>:50070/logs/userlogs. In case you´re running Hadoop from inside
> a
> cluster frontend, use this machine´s IP. Inside this directory, it will
> exist another one called "userlogs" where you will see all map and reduce
> tasks launch by the JobTracker and the TaskTrackers. These tasks will look
> like 'job_[m,r]_0_xxxxxx' (or similar). Inside of every one of them there
> will be three subdirectories (stdout, stdlog and stderr) which will contain
> all your debugging messages.
> Inside my MapReduce development programs I use the Java *LOG* class in a
> sentence like this:
>
> private static final Log LOG > LogFactory.getLog(<your_class_name>.class.getName());
> LOG.info("***********INSIDE MY REDUCER SETUP**********");
>
> Besides these messages, a normal "System.out.println(...)" will also appear
> in the above directories.
>
> Hope it helps!
>
> 2010/7/2 abc xyz <[EMAIL PROTECTED]>
>
> > Hi folks,
> >
> > I want to just display the output of my mapper on console or want to log
> it
> > in
> > some file. System.out.println and Log4j's logger are not displaying the
> > output.
> > How can I see the intermediate results?
> >
> > Cheers
> >
> >
> >
>
>
>
>
>
>
> --
> Alberto
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB