Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> I just got "Cannot complete block: block has not been COMMITTED by the client"


+
stack 2009-11-11, 23:40
+
stack 2009-11-11, 23:41
+
stack 2009-11-11, 23:46
Copy link to this message
-
Re: I just got "Cannot complete block: block has not been COMMITTED by the client"
I removed HDFS-630 and this issue seems to go away.  I haven't seen it over
the last few restarts.
St.Ack

On Wed, Nov 11, 2009 at 3:46 PM, stack <[EMAIL PROTECTED]> wrote:

> Here's the NN's view on the problematic file:
>
> [stack@aa0-000-12 logs]$ grep 1257981905391
> hadoop-stack-namenode-aa0-000-12.u.powerset.com.log
> 2009-11-11 23:25:05,449 DEBUG org.apache.hadoop.hdfs.StateChange: *DIR*
> NameNode.create: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> for DFSClient_-1861029014 at 208.76.44.140
> 2009-11-11 23:25:05,449 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
> NameSystem.startFile: src=/hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391,
> holder=DFSClient_-1861029014, clientMachine=208.76.44.140,
> createParent=true, replication=3, overwrite=true, append=false
> 2009-11-11 23:25:05,451 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
> FSDirectory.addFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> is added to the file system
> 2009-11-11 23:25:05,451 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
> NameSystem.startFile: add /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> to namespace for DFSClient_-1861029014
> 2009-11-11 23:25:05,452 INFO
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit:
> ugi=stack,powerset,engineering  ip=/208.76.44.140       cmd=create
> src=/hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> dst=null        perm=stack:supergroup:rw-r--r--
> 2009-11-11 23:25:12,405 DEBUG org.apache.hadoop.hdfs.StateChange: *BLOCK*
> NameNode.addBlock: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> for DFSClient_-1861029014
> 2009-11-11 23:25:12,406 DEBUG org.apache.hadoop.hdfs.StateChange: BLOCK*
> NameSystem.getAdditionalBlock: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> for DFSClient_-1861029014
> 2009-11-11 23:25:12,406 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
> FSDirectory.addFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> with blk_-3269268615851057446_1010 block is added to the in-memory file
> system
> 2009-11-11 23:25:12,406 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
> NameSystem.allocateBlock: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391.
> blk_-3269268615851057446_1010{blockUCState=UNDER_CONSTRUCTION,
> primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[208.76.44.140:51010|RBW],
> ReplicaUnderConstruction[208.76.44.141:51010|RBW],
> ReplicaUnderConstruction[208.76.44.142:51010|RBW]]}
> 2009-11-11 23:25:12,504 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
> NameSystem.fsync: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> for DFSClient_-1861029014
> 2009-11-11 23:25:12,505 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
> FSDirectory.persistBlocks: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> with 1 blocks is persisted to the file system
> 2009-11-11 23:25:34,233 DEBUG org.apache.hadoop.hdfs.StateChange: *DIR*
> NameNode.complete: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> for DFSClient_-1861029014
> 2009-11-11 23:25:34,233 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
> NameSystem.completeFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> for DFSClient_-1861029014
> 2009-11-11 23:25:34,234 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
> FSDirectory.closeFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> with 1 blocks is persisted to the file system
> 2009-11-11 23:25:34,234 INFO org.apache.hadoop.hdfs.StateChange: DIR*
> NameSystem.completeFile: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
> is closed by DFSClient_-1861029014
+
stack 2009-11-14, 21:34
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB