Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> measuring iops


+
Rita 2012-10-21, 12:30
+
Rita 2012-10-22, 12:23
+
Ravi Prakash 2012-10-22, 14:28
Copy link to this message
-
Re: measuring iops
Is it possible to know how many reads and writes are occurring thru the
entire cluster in a consolidated manner -- this does not include
replication factors.
On Mon, Oct 22, 2012 at 10:28 AM, Ravi Prakash <[EMAIL PROTECTED]> wrote:

> Hi Rita,
>
> SliveTest can help you measure the number of reads / writes / deletes / ls
> / appends per second your NameNode can handle.
>
> DFSIO can be used to help you measure the amount of throughput.
>
> Both these tests are actually very flexible and have a plethora of options
> to help you test different facets of performance. In my experience, you
> actually have to be very careful and understand what the tests are doing
> for the results to be sensible.
>
> HTH
> Ravi
>
>
>
>
> ________________________________
>  From: Rita <[EMAIL PROTECTED]>
> To: "<[EMAIL PROTECTED]>" <[EMAIL PROTECTED]>
> Sent: Monday, October 22, 2012 7:23 AM
> Subject: Re: measuring iops
>
> Anyone?
>
>
> On Sun, Oct 21, 2012 at 8:30 AM, Rita <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > Was curious if there was a method to measure the total number of IOPS
> (I/O
> > operations per second) on a HDFS cluster.
> >
> >
> >
> > --
> > --- Get your facts first, then you can distort them as you please.--
> >
>
>
>
> --
> --- Get your facts first, then you can distort them as you please.--
>

--
--- Get your facts first, then you can distort them as you please.--
+
Ravi Prakash 2012-10-23, 12:47
+
Michael Segel 2012-10-23, 13:19
+
Rita 2012-10-23, 23:01
+
Brian Bockelman 2012-10-23, 23:40
+
Lance Norskog 2012-10-26, 11:56
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB