Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Checkpoint Woes
Gabriel Rosendorf
2012-02-01, 21:15
Harsh J
2012-02-01, 21:18
Gabriel Rosendorf
2012-02-01, 21:23
Gabriel Rosendorf
2012-02-02, 14:11
+
Gabriel Rosendorf 2012-02-01, 21:15
+
Harsh J 2012-02-01, 21:18
+
Gabriel Rosendorf 2012-02-01, 21:23
Copy link to this message
-
Re: Checkpoint Woes
Jakob Homan 2012-02-01, 21:27
> Posted URL master:50070putimage=1&port=50090&machine=0.0.0.0&token=-31:1318804155:0:1328129935000:1328129628242
Have you defined your secondary namenode address?  The 2NN is telling
the NN to pull the merged image from http://0.0.0.0.0:50090.
On Wed, Feb 1, 2012 at 1:23 PM, Gabriel Rosendorf
<[EMAIL PROTECTED]> wrote:
> No firewall.
>
> Here's hdfs-site.xml from 2NN: http://pastie.org/3298304
> And from NN: http://pastie.org/3298309
>
> On Feb 1, 2012, at 4:18 PM, Harsh J wrote:
>
>> Have you ensured there is no firewall between the two hosts? Can you
>> also pastebin your hdfs-site.xml?
>>
>> On Thu, Feb 2, 2012 at 2:45 AM, Gabriel Rosendorf
>> <[EMAIL PROTECTED]> wrote:
>>> So I'm at a loss.  Checkpointing is failing, and both hosts (NN and 2NN) are
>>> reachable via HTTP.
>>> Any ideas would be greatly appreciated!
>>>
>>> From NameNode:
>>>
>>> 2012-02-01 21:02:53,460 INFO org.apache.hadoop.hdfs.StateChange: *BLOCK*
>>> NameSystem.processReport: from 10.178.231.219:50010, blocks: 0, processing
>>> time: 0 msecs
>>> 2012-02-01 21:03:56,581 INFO
>>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log from
>>> 10.178.224.109
>>> 2012-02-01 21:03:56,685 WARN org.mortbay.log: /getimage:
>>> java.io.IOException: GetImage failed. java.net.ConnectException: Connection
>>> refused
>>> at java.net.PlainSocketImpl.socketConnect(Native Method)
>>> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>>> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:211)
>>> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>>> at java.net.Socket.connect(Socket.java:529)
>>> at java.net.Socket.connect(Socket.java:478)
>>> at sun.net.NetworkClient.doConnect(NetworkClient.java:163)
>>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
>>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
>>> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
>>> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
>>> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
>>> at
>>> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
>>> at
>>> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
>>> at
>>> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
>>> at
>>> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1172)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.TransferFsImage.getFileClient(TransferFsImage.java:160)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.GetImageServlet$1$1.run(GetImageServlet.java:88)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.GetImageServlet$1$1.run(GetImageServlet.java:85)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at javax.security.auth.Subject.doAs(Subject.java:396)
>>> at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.GetImageServlet$1.run(GetImageServlet.java:85)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.GetImageServlet$1.run(GetImageServlet.java:70)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at javax.security.auth.Subject.doAs(Subject.java:396)
>>> at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.GetImageServlet.doGet(GetImageServlet.java:70)
>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>>> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
>>> at
>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
>>> at
>>> org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:816)
>>> at
>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
+
Gabriel Rosendorf 2012-02-02, 14:11