Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # dev >> Measuring bandwidth in 2.1.x


+
hilfi alkaff 2013-09-13, 16:54
+
Chris Embree 2013-09-13, 17:26
Copy link to this message
-
Re: Measuring bandwidth in 2.1.x
Yes, I'm aware of the tool. I was thinking of using this for real-time
network bandwidth management. Using vnstat won't be able to distinguish,
let's say, monitoring bandwidth of multiple maps running on the same
machine.
On Fri, Sep 13, 2013 at 12:26 PM, Chris Embree <[EMAIL PROTECTED]> wrote:

> vnstat should be able to do this.  It has a "live" mode or can
> generate  hourly reports much like sar.  Google for vnstat to find it.
>
> On 9/13/13, hilfi alkaff <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > Is there any way that we could measure the actual bandwidth used by the
> > nodes when running MapReduce jobs (For example, when the mappers are
> > sending data to the reducers during the shuffle phase).
> >
> > Thanks
> >
> > --
> > ~Hilfi Alkaff~
> >
>

--
~Hilfi Alkaff~
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB