Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Bigtop >> mail # user >> Proposal: Stress tests submodule

Copy link to this message
Proposal: Stress tests submodule
Hi bigtop:  

Are there any filesystem stress tests? I.e
-running 100 small mapreduce jobs

-recursively deleting and recreating a directory multiple times from different clients, concurrently.

-attempting to streaming  io into the same file concurrently from different tasks

I don't believe so - as most smokes/ are mapreduce oriented which is very structured.

Proposal: a stress/ submodule under test-artifacts which does some of these iterative metadata intensive operations in filesystem agnostic way.