The 11 Commandments of Benchmarking
Mark Nottingham has a great post about benchmarking HTTP servers. All the 11 rules exposed in the post apply as they are to NoSQL benchmarks and generally to storage benchmarks:
- Consistency
- One machine, one job
- Check the network
- Remove OS limitations
- Don’t test the client
- Overload is not capacity
- Thirty Seconds isn’t a test
- Do more than Hello world
- Not just averages
- Publish it all
- Try different tools
Go read the post now before creating yet another irrelevant benchmark.
Original title and link: The 11 Commandments of Benchmarking (NoSQL databases © myNoSQL)
via: http://www.mnot.net/blog/2011/05/18/http_benchmark_rules
