Sameer Farooqui
2011-10-24, 18:02
Mark question
2011-10-24, 20:37
Sameer Farooqui
2011-10-24, 20:50
Mark question
2011-10-24, 22:46
Steve Loughran
2011-10-25, 09:15
-
Cannot access JobTracker GUI (port 50030) via web browser while running on Amazon EC2Sameer Farooqui 2011-10-24, 18:02
Hi guys,
I'm running a 1-node Hadoop 0.20.2 pseudo-distributed node with RedHat 6.1
on Amazon EC2 and while my node is healthy, I can't seem to get to the
JobTracker GUI working. Running 'curl localhost:50030' from the CMD line
returns a valid HTML file. Ports 50030, 50060, 50070 are open in the Amazon
Security Group. MapReduce jobs are starting and completing successfully, so
my Hadoop install is working fine. But when I try to access the web GUI from
a Chrome browser on my local computer, I get nothing.
Any thoughts? I tried some Google searches and even did a hail-mary Bing
search, but none of them were fruitful.
Some troubleshooting I did is below:
[root@ip-10-86-x-x ~]# jps
1337 QuorumPeerMain
1494 JobTracker
1410 DataNode
1629 SecondaryNameNode
1556 NameNode
1694 TaskTracker
1181 HRegionServer
1107 HMaster
11363 Jps
[root@ip-10-86-x-x ~]# curl localhost:50030
<meta HTTP-EQUIV="REFRESH" content="0;url=jobtracker.jsp"/>
<html>
<head>
<title>Hadoop Administration</title>
</head>
<body>
<h1>Hadoop Administration</h1>
<ul>
<li><a href="jobtracker.jsp">JobTracker</a></li>
</ul>
</body>
</html>
I'm running a 1-node Hadoop 0.20.2 pseudo-distributed node with RedHat 6.1
on Amazon EC2 and while my node is healthy, I can't seem to get to the
JobTracker GUI working. Running 'curl localhost:50030' from the CMD line
returns a valid HTML file. Ports 50030, 50060, 50070 are open in the Amazon
Security Group. MapReduce jobs are starting and completing successfully, so
my Hadoop install is working fine. But when I try to access the web GUI from
a Chrome browser on my local computer, I get nothing.
Any thoughts? I tried some Google searches and even did a hail-mary Bing
search, but none of them were fruitful.
Some troubleshooting I did is below:
[root@ip-10-86-x-x ~]# jps
1337 QuorumPeerMain
1494 JobTracker
1410 DataNode
1629 SecondaryNameNode
1556 NameNode
1694 TaskTracker
1181 HRegionServer
1107 HMaster
11363 Jps
[root@ip-10-86-x-x ~]# curl localhost:50030
<meta HTTP-EQUIV="REFRESH" content="0;url=jobtracker.jsp"/>
<html>
<head>
<title>Hadoop Administration</title>
</head>
<body>
<h1>Hadoop Administration</h1>
<ul>
<li><a href="jobtracker.jsp">JobTracker</a></li>
</ul>
</body>
</html>
-
Re: Cannot access JobTracker GUI (port 50030) via web browser while running on Amazon EC2Mark question 2011-10-24, 20:37
I have the same issue and the output of "curl localhost:50030" is like
yours, and I'm running on a remote cluster on pesudo-distributed mode.
Can anyone help?
Thanks,
Mark
On Mon, Oct 24, 2011 at 11:02 AM, Sameer Farooqui
<[EMAIL PROTECTED]>wrote:
> Hi guys,
>
> I'm running a 1-node Hadoop 0.20.2 pseudo-distributed node with RedHat 6.1
> on Amazon EC2 and while my node is healthy, I can't seem to get to the
> JobTracker GUI working. Running 'curl localhost:50030' from the CMD line
> returns a valid HTML file. Ports 50030, 50060, 50070 are open in the Amazon
> Security Group. MapReduce jobs are starting and completing successfully, so
> my Hadoop install is working fine. But when I try to access the web GUI
> from
> a Chrome browser on my local computer, I get nothing.
>
> Any thoughts? I tried some Google searches and even did a hail-mary Bing
> search, but none of them were fruitful.
>
> Some troubleshooting I did is below:
> [root@ip-10-86-x-x ~]# jps
> 1337 QuorumPeerMain
> 1494 JobTracker
> 1410 DataNode
> 1629 SecondaryNameNode
> 1556 NameNode
> 1694 TaskTracker
> 1181 HRegionServer
> 1107 HMaster
> 11363 Jps
>
>
> [root@ip-10-86-x-x ~]# curl localhost:50030
> <meta HTTP-EQUIV="REFRESH" content="0;url=jobtracker.jsp"/>
> <html>
>
> <head>
> <title>Hadoop Administration</title>
> </head>
>
> <body>
>
> <h1>Hadoop Administration</h1>
>
> <ul>
>
> <li><a href="jobtracker.jsp">JobTracker</a></li>
>
> </ul>
>
> </body>
>
> </html>
>
yours, and I'm running on a remote cluster on pesudo-distributed mode.
Can anyone help?
Thanks,
Mark
On Mon, Oct 24, 2011 at 11:02 AM, Sameer Farooqui
<[EMAIL PROTECTED]>wrote:
> Hi guys,
>
> I'm running a 1-node Hadoop 0.20.2 pseudo-distributed node with RedHat 6.1
> on Amazon EC2 and while my node is healthy, I can't seem to get to the
> JobTracker GUI working. Running 'curl localhost:50030' from the CMD line
> returns a valid HTML file. Ports 50030, 50060, 50070 are open in the Amazon
> Security Group. MapReduce jobs are starting and completing successfully, so
> my Hadoop install is working fine. But when I try to access the web GUI
> from
> a Chrome browser on my local computer, I get nothing.
>
> Any thoughts? I tried some Google searches and even did a hail-mary Bing
> search, but none of them were fruitful.
>
> Some troubleshooting I did is below:
> [root@ip-10-86-x-x ~]# jps
> 1337 QuorumPeerMain
> 1494 JobTracker
> 1410 DataNode
> 1629 SecondaryNameNode
> 1556 NameNode
> 1694 TaskTracker
> 1181 HRegionServer
> 1107 HMaster
> 11363 Jps
>
>
> [root@ip-10-86-x-x ~]# curl localhost:50030
> <meta HTTP-EQUIV="REFRESH" content="0;url=jobtracker.jsp"/>
> <html>
>
> <head>
> <title>Hadoop Administration</title>
> </head>
>
> <body>
>
> <h1>Hadoop Administration</h1>
>
> <ul>
>
> <li><a href="jobtracker.jsp">JobTracker</a></li>
>
> </ul>
>
> </body>
>
> </html>
>
-
Re: Cannot access JobTracker GUI (port 50030) via web browser while running on Amazon EC2Sameer Farooqui 2011-10-24, 20:50
Mark,
We figured it out. It's an issue with RedHat's IPTables. You have to open up
those ports:
vim /etc/sysconfig/iptables
Make the file look like this
# Firewall configuration written by system-config-firewall
# Manual customization of this file is not recommended.
*filter
:INPUT ACCEPT [0:0]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [0:0]
-A INPUT -m state --state ESTABLISHED,RELATED -j ACCEPT
-A INPUT -p icmp -j ACCEPT
-A INPUT -i lo -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 22 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 80 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 50030 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 50060 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 50070 -j ACCEPT
-A INPUT -j REJECT --reject-with icmp-host-prohibited
-A FORWARD -j REJECT --reject-with icmp-host-prohibited
COMMIT
Restart the web services
/etc/init.d/iptables restart
iptables: Flushing firewall rules: [ OK ]
iptables: Setting chains to policy ACCEPT: filter [ OK ]
iptables: Unloading modules: [ OK ]
iptables: Applying firewall rules: [ OK ]
On Mon, Oct 24, 2011 at 1:37 PM, Mark question <[EMAIL PROTECTED]> wrote:
> I have the same issue and the output of "curl localhost:50030" is like
> yours, and I'm running on a remote cluster on pesudo-distributed mode.
> Can anyone help?
>
> Thanks,
> Mark
>
> On Mon, Oct 24, 2011 at 11:02 AM, Sameer Farooqui
> <[EMAIL PROTECTED]>wrote:
>
> > Hi guys,
> >
> > I'm running a 1-node Hadoop 0.20.2 pseudo-distributed node with RedHat
> 6.1
> > on Amazon EC2 and while my node is healthy, I can't seem to get to the
> > JobTracker GUI working. Running 'curl localhost:50030' from the CMD line
> > returns a valid HTML file. Ports 50030, 50060, 50070 are open in the
> Amazon
> > Security Group. MapReduce jobs are starting and completing successfully,
> so
> > my Hadoop install is working fine. But when I try to access the web GUI
> > from
> > a Chrome browser on my local computer, I get nothing.
> >
> > Any thoughts? I tried some Google searches and even did a hail-mary Bing
> > search, but none of them were fruitful.
> >
> > Some troubleshooting I did is below:
> > [root@ip-10-86-x-x ~]# jps
> > 1337 QuorumPeerMain
> > 1494 JobTracker
> > 1410 DataNode
> > 1629 SecondaryNameNode
> > 1556 NameNode
> > 1694 TaskTracker
> > 1181 HRegionServer
> > 1107 HMaster
> > 11363 Jps
> >
> >
> > [root@ip-10-86-x-x ~]# curl localhost:50030
> > <meta HTTP-EQUIV="REFRESH" content="0;url=jobtracker.jsp"/>
> > <html>
> >
> > <head>
> > <title>Hadoop Administration</title>
> > </head>
> >
> > <body>
> >
> > <h1>Hadoop Administration</h1>
> >
> > <ul>
> >
> > <li><a href="jobtracker.jsp">JobTracker</a></li>
> >
> > </ul>
> >
> > </body>
> >
> > </html>
> >
>
We figured it out. It's an issue with RedHat's IPTables. You have to open up
those ports:
vim /etc/sysconfig/iptables
Make the file look like this
# Firewall configuration written by system-config-firewall
# Manual customization of this file is not recommended.
*filter
:INPUT ACCEPT [0:0]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [0:0]
-A INPUT -m state --state ESTABLISHED,RELATED -j ACCEPT
-A INPUT -p icmp -j ACCEPT
-A INPUT -i lo -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 22 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 80 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 50030 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 50060 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 50070 -j ACCEPT
-A INPUT -j REJECT --reject-with icmp-host-prohibited
-A FORWARD -j REJECT --reject-with icmp-host-prohibited
COMMIT
Restart the web services
/etc/init.d/iptables restart
iptables: Flushing firewall rules: [ OK ]
iptables: Setting chains to policy ACCEPT: filter [ OK ]
iptables: Unloading modules: [ OK ]
iptables: Applying firewall rules: [ OK ]
On Mon, Oct 24, 2011 at 1:37 PM, Mark question <[EMAIL PROTECTED]> wrote:
> I have the same issue and the output of "curl localhost:50030" is like
> yours, and I'm running on a remote cluster on pesudo-distributed mode.
> Can anyone help?
>
> Thanks,
> Mark
>
> On Mon, Oct 24, 2011 at 11:02 AM, Sameer Farooqui
> <[EMAIL PROTECTED]>wrote:
>
> > Hi guys,
> >
> > I'm running a 1-node Hadoop 0.20.2 pseudo-distributed node with RedHat
> 6.1
> > on Amazon EC2 and while my node is healthy, I can't seem to get to the
> > JobTracker GUI working. Running 'curl localhost:50030' from the CMD line
> > returns a valid HTML file. Ports 50030, 50060, 50070 are open in the
> Amazon
> > Security Group. MapReduce jobs are starting and completing successfully,
> so
> > my Hadoop install is working fine. But when I try to access the web GUI
> > from
> > a Chrome browser on my local computer, I get nothing.
> >
> > Any thoughts? I tried some Google searches and even did a hail-mary Bing
> > search, but none of them were fruitful.
> >
> > Some troubleshooting I did is below:
> > [root@ip-10-86-x-x ~]# jps
> > 1337 QuorumPeerMain
> > 1494 JobTracker
> > 1410 DataNode
> > 1629 SecondaryNameNode
> > 1556 NameNode
> > 1694 TaskTracker
> > 1181 HRegionServer
> > 1107 HMaster
> > 11363 Jps
> >
> >
> > [root@ip-10-86-x-x ~]# curl localhost:50030
> > <meta HTTP-EQUIV="REFRESH" content="0;url=jobtracker.jsp"/>
> > <html>
> >
> > <head>
> > <title>Hadoop Administration</title>
> > </head>
> >
> > <body>
> >
> > <h1>Hadoop Administration</h1>
> >
> > <ul>
> >
> > <li><a href="jobtracker.jsp">JobTracker</a></li>
> >
> > </ul>
> >
> > </body>
> >
> > </html>
> >
>
-
Re: Cannot access JobTracker GUI (port 50030) via web browser while running on Amazon EC2Mark question 2011-10-24, 22:46
Thank you, I'll try it.
Mark
On Mon, Oct 24, 2011 at 1:50 PM, Sameer Farooqui <[EMAIL PROTECTED]>wrote:
> Mark,
>
> We figured it out. It's an issue with RedHat's IPTables. You have to open
> up
> those ports:
>
>
> vim /etc/sysconfig/iptables
>
> Make the file look like this
>
> # Firewall configuration written by system-config-firewall
> # Manual customization of this file is not recommended.
> *filter
> :INPUT ACCEPT [0:0]
> :FORWARD ACCEPT [0:0]
> :OUTPUT ACCEPT [0:0]
> -A INPUT -m state --state ESTABLISHED,RELATED -j ACCEPT
> -A INPUT -p icmp -j ACCEPT
> -A INPUT -i lo -j ACCEPT
> -A INPUT -m state --state NEW -m tcp -p tcp --dport 22 -j ACCEPT
> -A INPUT -m state --state NEW -m tcp -p tcp --dport 80 -j ACCEPT
> -A INPUT -m state --state NEW -m tcp -p tcp --dport 50030 -j ACCEPT
> -A INPUT -m state --state NEW -m tcp -p tcp --dport 50060 -j ACCEPT
> -A INPUT -m state --state NEW -m tcp -p tcp --dport 50070 -j ACCEPT
> -A INPUT -j REJECT --reject-with icmp-host-prohibited
> -A FORWARD -j REJECT --reject-with icmp-host-prohibited
> COMMIT
>
> Restart the web services
> /etc/init.d/iptables restart
> iptables: Flushing firewall rules: [ OK ]
> iptables: Setting chains to policy ACCEPT: filter [ OK ]
> iptables: Unloading modules: [ OK ]
> iptables: Applying firewall rules: [ OK ]
>
>
> On Mon, Oct 24, 2011 at 1:37 PM, Mark question <[EMAIL PROTECTED]>
> wrote:
>
> > I have the same issue and the output of "curl localhost:50030" is like
> > yours, and I'm running on a remote cluster on pesudo-distributed mode.
> > Can anyone help?
> >
> > Thanks,
> > Mark
> >
> > On Mon, Oct 24, 2011 at 11:02 AM, Sameer Farooqui
> > <[EMAIL PROTECTED]>wrote:
> >
> > > Hi guys,
> > >
> > > I'm running a 1-node Hadoop 0.20.2 pseudo-distributed node with RedHat
> > 6.1
> > > on Amazon EC2 and while my node is healthy, I can't seem to get to the
> > > JobTracker GUI working. Running 'curl localhost:50030' from the CMD
> line
> > > returns a valid HTML file. Ports 50030, 50060, 50070 are open in the
> > Amazon
> > > Security Group. MapReduce jobs are starting and completing
> successfully,
> > so
> > > my Hadoop install is working fine. But when I try to access the web GUI
> > > from
> > > a Chrome browser on my local computer, I get nothing.
> > >
> > > Any thoughts? I tried some Google searches and even did a hail-mary
> Bing
> > > search, but none of them were fruitful.
> > >
> > > Some troubleshooting I did is below:
> > > [root@ip-10-86-x-x ~]# jps
> > > 1337 QuorumPeerMain
> > > 1494 JobTracker
> > > 1410 DataNode
> > > 1629 SecondaryNameNode
> > > 1556 NameNode
> > > 1694 TaskTracker
> > > 1181 HRegionServer
> > > 1107 HMaster
> > > 11363 Jps
> > >
> > >
> > > [root@ip-10-86-x-x ~]# curl localhost:50030
> > > <meta HTTP-EQUIV="REFRESH" content="0;url=jobtracker.jsp"/>
> > > <html>
> > >
> > > <head>
> > > <title>Hadoop Administration</title>
> > > </head>
> > >
> > > <body>
> > >
> > > <h1>Hadoop Administration</h1>
> > >
> > > <ul>
> > >
> > > <li><a href="jobtracker.jsp">JobTracker</a></li>
> > >
> > > </ul>
> > >
> > > </body>
> > >
> > > </html>
> > >
> >
>
Mark
On Mon, Oct 24, 2011 at 1:50 PM, Sameer Farooqui <[EMAIL PROTECTED]>wrote:
> Mark,
>
> We figured it out. It's an issue with RedHat's IPTables. You have to open
> up
> those ports:
>
>
> vim /etc/sysconfig/iptables
>
> Make the file look like this
>
> # Firewall configuration written by system-config-firewall
> # Manual customization of this file is not recommended.
> *filter
> :INPUT ACCEPT [0:0]
> :FORWARD ACCEPT [0:0]
> :OUTPUT ACCEPT [0:0]
> -A INPUT -m state --state ESTABLISHED,RELATED -j ACCEPT
> -A INPUT -p icmp -j ACCEPT
> -A INPUT -i lo -j ACCEPT
> -A INPUT -m state --state NEW -m tcp -p tcp --dport 22 -j ACCEPT
> -A INPUT -m state --state NEW -m tcp -p tcp --dport 80 -j ACCEPT
> -A INPUT -m state --state NEW -m tcp -p tcp --dport 50030 -j ACCEPT
> -A INPUT -m state --state NEW -m tcp -p tcp --dport 50060 -j ACCEPT
> -A INPUT -m state --state NEW -m tcp -p tcp --dport 50070 -j ACCEPT
> -A INPUT -j REJECT --reject-with icmp-host-prohibited
> -A FORWARD -j REJECT --reject-with icmp-host-prohibited
> COMMIT
>
> Restart the web services
> /etc/init.d/iptables restart
> iptables: Flushing firewall rules: [ OK ]
> iptables: Setting chains to policy ACCEPT: filter [ OK ]
> iptables: Unloading modules: [ OK ]
> iptables: Applying firewall rules: [ OK ]
>
>
> On Mon, Oct 24, 2011 at 1:37 PM, Mark question <[EMAIL PROTECTED]>
> wrote:
>
> > I have the same issue and the output of "curl localhost:50030" is like
> > yours, and I'm running on a remote cluster on pesudo-distributed mode.
> > Can anyone help?
> >
> > Thanks,
> > Mark
> >
> > On Mon, Oct 24, 2011 at 11:02 AM, Sameer Farooqui
> > <[EMAIL PROTECTED]>wrote:
> >
> > > Hi guys,
> > >
> > > I'm running a 1-node Hadoop 0.20.2 pseudo-distributed node with RedHat
> > 6.1
> > > on Amazon EC2 and while my node is healthy, I can't seem to get to the
> > > JobTracker GUI working. Running 'curl localhost:50030' from the CMD
> line
> > > returns a valid HTML file. Ports 50030, 50060, 50070 are open in the
> > Amazon
> > > Security Group. MapReduce jobs are starting and completing
> successfully,
> > so
> > > my Hadoop install is working fine. But when I try to access the web GUI
> > > from
> > > a Chrome browser on my local computer, I get nothing.
> > >
> > > Any thoughts? I tried some Google searches and even did a hail-mary
> Bing
> > > search, but none of them were fruitful.
> > >
> > > Some troubleshooting I did is below:
> > > [root@ip-10-86-x-x ~]# jps
> > > 1337 QuorumPeerMain
> > > 1494 JobTracker
> > > 1410 DataNode
> > > 1629 SecondaryNameNode
> > > 1556 NameNode
> > > 1694 TaskTracker
> > > 1181 HRegionServer
> > > 1107 HMaster
> > > 11363 Jps
> > >
> > >
> > > [root@ip-10-86-x-x ~]# curl localhost:50030
> > > <meta HTTP-EQUIV="REFRESH" content="0;url=jobtracker.jsp"/>
> > > <html>
> > >
> > > <head>
> > > <title>Hadoop Administration</title>
> > > </head>
> > >
> > > <body>
> > >
> > > <h1>Hadoop Administration</h1>
> > >
> > > <ul>
> > >
> > > <li><a href="jobtracker.jsp">JobTracker</a></li>
> > >
> > > </ul>
> > >
> > > </body>
> > >
> > > </html>
> > >
> >
>
-
Re: Cannot access JobTracker GUI (port 50030) via web browser while running on Amazon EC2Steve Loughran 2011-10-25, 09:15
On 24/10/11 23:46, Mark question wrote:
> Thank you, I'll try it.
> Mark
>
> On Mon, Oct 24, 2011 at 1:50 PM, Sameer Farooqui<[EMAIL PROTECTED]>wrote:
>
>> Mark,
>>
>> We figured it out. It's an issue with RedHat's IPTables. You have to open
>> up
>> those ports:
>>
>>
>> vim /etc/sysconfig/iptables
Of course, if you open up the cluster ports to everyone, that means
everyone else with an IPv4 address. SSH tunnelling is a better tactic
> Thank you, I'll try it.
> Mark
>
> On Mon, Oct 24, 2011 at 1:50 PM, Sameer Farooqui<[EMAIL PROTECTED]>wrote:
>
>> Mark,
>>
>> We figured it out. It's an issue with RedHat's IPTables. You have to open
>> up
>> those ports:
>>
>>
>> vim /etc/sysconfig/iptables
Of course, if you open up the cluster ports to everyone, that means
everyone else with an IPv4 address. SSH tunnelling is a better tactic
