Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Checkpoint Woes


Copy link to this message
-
Re: Checkpoint Woes
> Posted URL master:50070putimage=1&port=50090&machine=0.0.0.0&token=-31:1318804155:0:1328129935000:1328129628242
Have you defined your secondary namenode address?  The 2NN is telling
the NN to pull the merged image from http://0.0.0.0.0:50090.
On Wed, Feb 1, 2012 at 1:23 PM, Gabriel Rosendorf
<[EMAIL PROTECTED]> wrote:
> No firewall.
>
> Here's hdfs-site.xml from 2NN: http://pastie.org/3298304
> And from NN: http://pastie.org/3298309
>
> On Feb 1, 2012, at 4:18 PM, Harsh J wrote:
>
>> Have you ensured there is no firewall between the two hosts? Can you
>> also pastebin your hdfs-site.xml?
>>
>> On Thu, Feb 2, 2012 at 2:45 AM, Gabriel Rosendorf
>> <[EMAIL PROTECTED]> wrote:
>>> So I'm at a loss.  Checkpointing is failing, and both hosts (NN and 2NN) are
>>> reachable via HTTP.
>>> Any ideas would be greatly appreciated!
>>>
>>> From NameNode:
>>>
>>> 2012-02-01 21:02:53,460 INFO org.apache.hadoop.hdfs.StateChange: *BLOCK*
>>> NameSystem.processReport: from 10.178.231.219:50010, blocks: 0, processing
>>> time: 0 msecs
>>> 2012-02-01 21:03:56,581 INFO
>>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log from
>>> 10.178.224.109
>>> 2012-02-01 21:03:56,685 WARN org.mortbay.log: /getimage:
>>> java.io.IOException: GetImage failed. java.net.ConnectException: Connection
>>> refused
>>> at java.net.PlainSocketImpl.socketConnect(Native Method)
>>> at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
>>> at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:211)
>>> at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
>>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
>>> at java.net.Socket.connect(Socket.java:529)
>>> at java.net.Socket.connect(Socket.java:478)
>>> at sun.net.NetworkClient.doConnect(NetworkClient.java:163)
>>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:394)
>>> at sun.net.www.http.HttpClient.openServer(HttpClient.java:529)
>>> at sun.net.www.http.HttpClient.<init>(HttpClient.java:233)
>>> at sun.net.www.http.HttpClient.New(HttpClient.java:306)
>>> at sun.net.www.http.HttpClient.New(HttpClient.java:323)
>>> at
>>> sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:970)
>>> at
>>> sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:911)
>>> at
>>> sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:836)
>>> at
>>> sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1172)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.TransferFsImage.getFileClient(TransferFsImage.java:160)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.GetImageServlet$1$1.run(GetImageServlet.java:88)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.GetImageServlet$1$1.run(GetImageServlet.java:85)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at javax.security.auth.Subject.doAs(Subject.java:396)
>>> at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.GetImageServlet$1.run(GetImageServlet.java:85)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.GetImageServlet$1.run(GetImageServlet.java:70)
>>> at java.security.AccessController.doPrivileged(Native Method)
>>> at javax.security.auth.Subject.doAs(Subject.java:396)
>>> at
>>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.GetImageServlet.doGet(GetImageServlet.java:70)
>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>>> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
>>> at
>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
>>> at
>>> org.apache.hadoop.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:816)
>>> at
>>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB