Is setting dfs.replication to 1 sufficient to stop replication?  How do I verify that?  I have a pseudo cluster running 0.21.0.  It seems that the hdfs disk consumption triples the amount of data stored.

Thanks,
Jane

Hi,

On Wed, Dec 29, 2010 at 5:51 AM, Jane Chen <[EMAIL PROTECTED]> wrote:
> Is setting dfs.replication to 1 sufficient to stop replication?  How do I verify that?  I have a pseudo cluster running 0.21.0.  It seems that the hdfs disk consumption triples the amount of data stored.

Setting to 1 is sufficient to stop replication. Can you check if the
web UI for NameNode has a way to show the replicas of blocks for a
file ?

>
> Thanks,
> Jane
>
>
>
>

You are right.  There's only one replica.  When does the deleted file space get reclaimed?

--- On Tue, 12/28/10, Hemanth Yamijala <[EMAIL PROTECTED]> wrote:

> From: Hemanth Yamijala <[EMAIL PROTECTED]>
> Subject: Re: HDFS disk consumption.
> To: [EMAIL PROTECTED]
> Date: Tuesday, December 28, 2010, 8:43 PM
> Hi,
>
> On Wed, Dec 29, 2010 at 5:51 AM, Jane Chen <[EMAIL PROTECTED]>
> wrote:
> > Is setting dfs.replication to 1 sufficient to stop
> replication?  How do I verify that?  I have a pseudo
> cluster running 0.21.0.  It seems that the hdfs disk
> consumption triples the amount of data stored.
>
> Setting to 1 is sufficient to stop replication. Can you
> check if the
> web UI for NameNode has a way to show the replicas of
> blocks for a
> file ?
>
> >
> > Thanks,
> > Jane
> >
> >
> >
> >
>

If you remove the file from the command line. The file will be moved to
trash folder(if you enable the feature).otherwise the file will be moved
immediately.
On Thu, Dec 30, 2010 at 1:09 AM, Jane Chen <[EMAIL PROTECTED]> wrote:

> You are right.  There's only one replica.  When does the deleted file space
> get reclaimed?
>
> --- On Tue, 12/28/10, Hemanth Yamijala <[EMAIL PROTECTED]> wrote:
>
> > From: Hemanth Yamijala <[EMAIL PROTECTED]>
> > Subject: Re: HDFS disk consumption.
> > To: [EMAIL PROTECTED]
> > Date: Tuesday, December 28, 2010, 8:43 PM
> > Hi,
> >
> > On Wed, Dec 29, 2010 at 5:51 AM, Jane Chen <[EMAIL PROTECTED]>
> > wrote:
> > > Is setting dfs.replication to 1 sufficient to stop
> > replication?  How do I verify that?  I have a pseudo
> > cluster running 0.21.0.  It seems that the hdfs disk
> > consumption triples the amount of data stored.
> >
> > Setting to 1 is sufficient to stop replication. Can you
> > check if the
> > web UI for NameNode has a way to show the replicas of
> > blocks for a
> > file ?
> >
> > >
> > > Thanks,
> > > Jane
> > >
> > >
> > >
> > >
> >
>
>
>
>
--
-----李平