Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - correct way to reserve space


+
Rita 2011-10-27, 00:24
+
Alexander C.H. Lorenz 2011-10-27, 06:46
+
Harsh J 2011-10-27, 07:27
+
Alexander C.H. Lorenz 2011-10-27, 07:45
+
Harsh J 2011-10-27, 10:45
Copy link to this message
-
Re: correct way to reserve space
Rita 2011-10-28, 11:23
Thanks Harsh and everyone

On Thu, Oct 27, 2011 at 6:45 AM, Harsh J <[EMAIL PROTECTED]> wrote:

> Rita/Alexander,
>
> You may be interested in continuing the discussion for this feature at
> https://issues.apache.org/jira/browse/HDFS-1564
>
> Sorry I could not post that link earlier, as I was on my phone.
>
> On Thu, Oct 27, 2011 at 1:15 PM, Alexander C.H. Lorenz
> <[EMAIL PROTECTED]> wrote:
> > Hi Harsh,
> >
> > ah, nice to know, thanks ;)
> >
> > best,
> >  Alex
> >
> > On Thu, Oct 27, 2011 at 9:27 AM, Harsh J <[EMAIL PROTECTED]> wrote:
> >
> >> The percentage opt is not valid on 0.20 iirc.
> >>
> >> On Thursday, October 27, 2011, Alexander C.H. Lorenz <
> >> [EMAIL PROTECTED]> wrote:
> >> > Hi,
> >> >
> >> > in hdfs-site.xml:
> >> >
> >> > <property>
> >> >  <name>dfs.datanode.du.reserved</name>
> >> >  <value> VALUE_HERE (maybe 30000000000) </value>
> >> > </property>
> >> >
> >> > <property>
> >> >  <name>dfs.datanode.du.pct</name>
> >> >  <value>0.9f</value>
> >> > </property>
> >> >
> >> > But not available for each partition, its a general parameter. Correct
> me
> >> > please if I wrong.
> >> >
> >> > regards,
> >> >  Alex
> >> >
> >> >
> >> >
> >> > On Thu, Oct 27, 2011 at 2:24 AM, Rita <[EMAIL PROTECTED]> wrote:
> >> >
> >> >> What is the correct way to reserve space for hdfs?
> >> >>
> >> >> I currently have 2 filesystem, /fs1 and /fs2 and I would like to
> reserve
> >> >> space for non-dfs operations. For example, for /fs1 i would like to
> >> reserve
> >> >> 30gb of space for non-dfs and 10gb of space for /fs2 ?
> >> >>
> >> >>
> >> >> I fear HADOOP-2991 is still haunting us?
> >> >>
> >> >> I am using CDH 3U1
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> --- Get your facts first, then you can distort them as you please.--
> >> >>
> >> >
> >> >
> >> >
> >> > --
> >> > Alexander Lorenz
> >> > http://mapredit.blogspot.com
> >> >
> >>
> >> --
> >> Harsh J
> >>
> >
> >
> >
> > --
> > Alexander Lorenz
> > http://mapredit.blogspot.com
> >
>
>
>
> --
> Harsh J
>

--
--- Get your facts first, then you can distort them as you please.--