Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> hdfs behavior

Inder Pall 2011-11-28, 11:43
I think, you might not completed even single block write completely.

Length will be updated in NN after completing the block. Currently partial block lengths will not be included in length calculation.



From: Inder Pall [[EMAIL PROTECTED]]
Sent: Monday, November 28, 2011 5:13 PM
Subject: hdfs behavior


i am seeing the following -

1. writing to a large file on HDFS
2. tail -f on the same file shows data is streaming.
3. hadoop dfs -ls on the same file shows size as 0.

Has anyone experienced this?

-- Inder