Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> measuring iops


+
Rita 2012-10-21, 12:30
+
Rita 2012-10-22, 12:23
+
Ravi Prakash 2012-10-22, 14:28
Copy link to this message
-
Re: measuring iops
Is it possible to know how many reads and writes are occurring thru the
entire cluster in a consolidated manner -- this does not include
replication factors.
On Mon, Oct 22, 2012 at 10:28 AM, Ravi Prakash <[EMAIL PROTECTED]> wrote:

> Hi Rita,
>
> SliveTest can help you measure the number of reads / writes / deletes / ls
> / appends per second your NameNode can handle.
>
> DFSIO can be used to help you measure the amount of throughput.
>
> Both these tests are actually very flexible and have a plethora of options
> to help you test different facets of performance. In my experience, you
> actually have to be very careful and understand what the tests are doing
> for the results to be sensible.
>
> HTH
> Ravi
>
>
>
>
> ________________________________
>  From: Rita <[EMAIL PROTECTED]>
> To: "<[EMAIL PROTECTED]>" <[EMAIL PROTECTED]>
> Sent: Monday, October 22, 2012 7:23 AM
> Subject: Re: measuring iops
>
> Anyone?
>
>
> On Sun, Oct 21, 2012 at 8:30 AM, Rita <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > Was curious if there was a method to measure the total number of IOPS
> (I/O
> > operations per second) on a HDFS cluster.
> >
> >
> >
> > --
> > --- Get your facts first, then you can distort them as you please.--
> >
>
>
>
> --
> --- Get your facts first, then you can distort them as you please.--
>

--
--- Get your facts first, then you can distort them as you please.--
+
Ravi Prakash 2012-10-23, 12:47
+
Michael Segel 2012-10-23, 13:19
+
Rita 2012-10-23, 23:01
+
Brian Bockelman 2012-10-23, 23:40
+
Lance Norskog 2012-10-26, 11:56