Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - I just got "Cannot complete block: block has not been COMMITTED by the client"


+
stack 2009-11-11, 23:40
+
stack 2009-11-11, 23:41
+
stack 2009-11-11, 23:46
+
stack 2009-11-12, 01:53
Copy link to this message
-
Re: I just got "Cannot complete block: block has not been COMMITTED by the client"
stack 2009-11-14, 21:34
Follow up: This was not an hdfs-630 issue.  It was caused by my not having
the same patched jar everywhere across the cluster.  Pardon the noise.
St.Ack

On Wed, Nov 11, 2009 at 5:53 PM, stack <[EMAIL PROTECTED]> wrote:

> I removed HDFS-630 and this issue seems to go away.  I haven't seen it over
> the last few restarts.
> St.Ack
>
>
> On Wed, Nov 11, 2009 at 3:46 PM, stack <[EMAIL PROTECTED]> wrote:
>
>> Here's the NN's view on the problematic file:
>>
>> [stack@aa0-000-12 logs]$ grep 1257981905391
>> hadoop-stack-namenode-aa0-000-12.u.powerset.com.log
>> 2009-11-11 23:25:05,449 DEBUG org.apache.hadoop.hdfs.StateChange: *DIR*
>> NameNode.create: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> for DFSClient_-1861029014 at 208.76.44.140
>> 2009-11-11 23:25:05,449 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> NameSystem.startFile: src=/hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391,
>> holder=DFSClient_-1861029014, clientMachine=208.76.44.140,
>> createParent=true, replication=3, overwrite=true, append=false
>> 2009-11-11 23:25:05,451 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> FSDirectory.addFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> is added to the file system
>> 2009-11-11 23:25:05,451 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> NameSystem.startFile: add /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> to namespace for DFSClient_-1861029014
>> 2009-11-11 23:25:05,452 INFO
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit:
>> ugi=stack,powerset,engineering  ip=/208.76.44.140       cmd=create
>> src=/hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> dst=null        perm=stack:supergroup:rw-r--r--
>> 2009-11-11 23:25:12,405 DEBUG org.apache.hadoop.hdfs.StateChange: *BLOCK*
>> NameNode.addBlock: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> for DFSClient_-1861029014
>> 2009-11-11 23:25:12,406 DEBUG org.apache.hadoop.hdfs.StateChange: BLOCK*
>> NameSystem.getAdditionalBlock: file /hbase/.logs/
>> aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391 for
>> DFSClient_-1861029014
>> 2009-11-11 23:25:12,406 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> FSDirectory.addFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> with blk_-3269268615851057446_1010 block is added to the in-memory file
>> system
>> 2009-11-11 23:25:12,406 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
>> NameSystem.allocateBlock: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391.
>> blk_-3269268615851057446_1010{blockUCState=UNDER_CONSTRUCTION,
>> primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[208.76.44.140:51010|RBW],
>> ReplicaUnderConstruction[208.76.44.141:51010|RBW],
>> ReplicaUnderConstruction[208.76.44.142:51010|RBW]]}
>> 2009-11-11 23:25:12,504 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
>> NameSystem.fsync: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> for DFSClient_-1861029014
>> 2009-11-11 23:25:12,505 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> FSDirectory.persistBlocks: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> with 1 blocks is persisted to the file system
>> 2009-11-11 23:25:34,233 DEBUG org.apache.hadoop.hdfs.StateChange: *DIR*
>> NameNode.complete: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> for DFSClient_-1861029014
>> 2009-11-11 23:25:34,233 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> NameSystem.completeFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> for DFSClient_-1861029014
>> 2009-11-11 23:25:34,234 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> FSDirectory.closeFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391