Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Bigtop >> mail # user >> Proposal: Stress tests submodule


Copy link to this message
-
Proposal: Stress tests submodule
Hi bigtop:  

Are there any filesystem stress tests? I.e
-running 100 small mapreduce jobs

-recursively deleting and recreating a directory multiple times from different clients, concurrently.

-attempting to streaming  io into the same file concurrently from different tasks

I don't believe so - as most smokes/ are mapreduce oriented which is very structured.

Proposal: a stress/ submodule under test-artifacts which does some of these iterative metadata intensive operations in filesystem agnostic way.
+
Roman Shaposhnik 2013-09-08, 02:15
+
Jay Vyas 2013-09-08, 17:24
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB