Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> problem viewing task logs on ec2 via socks proxy


Copy link to this message
-
Re: problem viewing task logs on ec2 via socks proxy
Hi John,

This question really belongs on the Cloudera list
(http://getsatisfaction.com/cloudera) or the Whirr user list, but I
wonder if you're seeing this because you're not using the SOCKS proxy
for DNS lookups? See bottom of
https://docs.cloudera.com/display/DOC/Launching+a+Cluster.

Cheers
Tom

On Mon, Sep 20, 2010 at 9:57 AM, John Clarke <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I'm using Hadoop 0.18.3 and I run on EC2 using Cloudera's python scripts.
> I'm having trouble viewing the task logs via the socks proxy.
>
> I start the proxy by:
> hadoop-ec2 proxy <my_cluster>
>
> I can view the task tracker and namenode pages once I load the .pac file via
> the foxyproxy plugin for firefox. However once I drill down into a job and
> try to click on the task log links it appears that they dont go through the
> proxy and so dont work.
>
> They have the form:
> http://domu-12-31-38-00-40-57.compute-1.internal:50060/tasklog?taskid=attempt_201009201153_0003_m_000019_0&start=-4097
>
>
> I tried replacing the "domu-12-31-38-00-40-57.compute-1.internal" part with
> the proxy IP but it didnt work.
>
> Any ideas how I can view the logs in the browser. I can ssh directly into
> the node to see the logs but the web interface is much handier.
>
> Thanks
> John
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB