Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> YARN log access


Copy link to this message
-
RE: YARN log access
Thanks, I missed the target 2.4.0 release.  For 2.2.0, is there any way to reach the individual task container logs?
John

From: Ted Yu [mailto:[EMAIL PROTECTED]]
Sent: Saturday, January 04, 2014 10:47 AM
To: [EMAIL PROTECTED]
Subject: Re: YARN log access

YARN-649 is targeted at 2.4.0 release and YARN-1524 is Open.

>From the link you posted, I see:
amContainerLogs   The URL of the application master container logs

On Sat, Jan 4, 2014 at 9:18 AM, John Lilley <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Ted,
Thanks for the pointer.  But when I read about the RESTful API:
http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Application_API
I only see a method to query the AM logs, not the task container logs.  How does one get from AppID to the list of task container logs?
Thanks
john
From: Ted Yu [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
See:
https://issues.apache.org/jira/browse/YARN-649
https://issues.apache.org/jira/browse/YARN-1524

On Fri, Jan 3, 2014 at 8:50 AM, John Lilley <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Is there a programmatic or HTTP interface for querying the logs of a YARN application run?  Ideally I would start with the AppID, query the AppMaster log, and then descend into the task logs.

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB