Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Re: how to benchmark the whole hadoop cluster performance?


Copy link to this message
-
Re: how to benchmark the whole hadoop cluster performance?
There's also this: https://github.com/palominolabs/benchpress

Which I really would like to integrate into Bigtop someday
and make available as a tool for Hadoop ecosystem
benchmarking.

Thanks,
Roman.

On Mon, Sep 2, 2013 at 12:15 PM, Stephen Boesch <[EMAIL PROTECTED]> wrote:
>
> You are on the right track.  TestDFSIO and TeraGen/Sort provide good
> characterization of IO  and shuffle /sort performance.  You would likely
> want to run/save dstat (/vmstat/iostat/..) info on the individual nodes as
> well.
>
> HiBench does provide additional useful characterizations such as mixed
> workloads using typical hadoop ecosystem tools.
>
>
> 2013/9/2 Ravi Kiran <[EMAIL PROTECTED]>
>>
>> You can also look at
>> a ) https://github.com/intel-hadoop/HiBench
>>
>>
>> Regards
>> Ravi Magham
>>
>>
>> On Mon, Sep 2, 2013 at 12:26 PM, ch huang <[EMAIL PROTECTED]> wrote:
>>>
>>> hi ,all:
>>>        i want to evaluate my hadoop cluster performance ,what tool can i
>>> use? (TestDFSIO,nnbench?)
>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB