Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> I just got "Cannot complete block: block has not been COMMITTED by the client"


+
stack 2009-11-11, 23:40
+
stack 2009-11-11, 23:41
+
stack 2009-11-11, 23:46
+
stack 2009-11-12, 01:53
Copy link to this message
-
Re: I just got "Cannot complete block: block has not been COMMITTED by the client"
Follow up: This was not an hdfs-630 issue.  It was caused by my not having
the same patched jar everywhere across the cluster.  Pardon the noise.
St.Ack

On Wed, Nov 11, 2009 at 5:53 PM, stack <[EMAIL PROTECTED]> wrote:

> I removed HDFS-630 and this issue seems to go away.  I haven't seen it over
> the last few restarts.
> St.Ack
>
>
> On Wed, Nov 11, 2009 at 3:46 PM, stack <[EMAIL PROTECTED]> wrote:
>
>> Here's the NN's view on the problematic file:
>>
>> [stack@aa0-000-12 logs]$ grep 1257981905391
>> hadoop-stack-namenode-aa0-000-12.u.powerset.com.log
>> 2009-11-11 23:25:05,449 DEBUG org.apache.hadoop.hdfs.StateChange: *DIR*
>> NameNode.create: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> for DFSClient_-1861029014 at 208.76.44.140
>> 2009-11-11 23:25:05,449 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> NameSystem.startFile: src=/hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391,
>> holder=DFSClient_-1861029014, clientMachine=208.76.44.140,
>> createParent=true, replication=3, overwrite=true, append=false
>> 2009-11-11 23:25:05,451 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> FSDirectory.addFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> is added to the file system
>> 2009-11-11 23:25:05,451 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> NameSystem.startFile: add /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> to namespace for DFSClient_-1861029014
>> 2009-11-11 23:25:05,452 INFO
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit:
>> ugi=stack,powerset,engineering  ip=/208.76.44.140       cmd=create
>> src=/hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> dst=null        perm=stack:supergroup:rw-r--r--
>> 2009-11-11 23:25:12,405 DEBUG org.apache.hadoop.hdfs.StateChange: *BLOCK*
>> NameNode.addBlock: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> for DFSClient_-1861029014
>> 2009-11-11 23:25:12,406 DEBUG org.apache.hadoop.hdfs.StateChange: BLOCK*
>> NameSystem.getAdditionalBlock: file /hbase/.logs/
>> aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391 for
>> DFSClient_-1861029014
>> 2009-11-11 23:25:12,406 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> FSDirectory.addFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> with blk_-3269268615851057446_1010 block is added to the in-memory file
>> system
>> 2009-11-11 23:25:12,406 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
>> NameSystem.allocateBlock: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391.
>> blk_-3269268615851057446_1010{blockUCState=UNDER_CONSTRUCTION,
>> primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[208.76.44.140:51010|RBW],
>> ReplicaUnderConstruction[208.76.44.141:51010|RBW],
>> ReplicaUnderConstruction[208.76.44.142:51010|RBW]]}
>> 2009-11-11 23:25:12,504 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
>> NameSystem.fsync: file /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> for DFSClient_-1861029014
>> 2009-11-11 23:25:12,505 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> FSDirectory.persistBlocks: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> with 1 blocks is persisted to the file system
>> 2009-11-11 23:25:34,233 DEBUG org.apache.hadoop.hdfs.StateChange: *DIR*
>> NameNode.complete: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> for DFSClient_-1861029014
>> 2009-11-11 23:25:34,233 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> NameSystem.completeFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
>> for DFSClient_-1861029014
>> 2009-11-11 23:25:34,234 DEBUG org.apache.hadoop.hdfs.StateChange: DIR*
>> FSDirectory.closeFile: /hbase/.logs/aa0-000-13.u.powerset.com,60020,1257981904990/hlog.dat.1257981905391
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB