Performance testing about runtime HOT 2 CLOSED

Keep running tests on dedicated machines and publish results somewhere. Is that the best practice?

Sounds like a perfectly fine approach to me. E.g. here's a blog post from the HHVM team showing some of their benchmarks. I couldn't find out if they publish this somewhere publicly for every commit/test run, so if you do that it's even better.

The Mono team also publishes GC perf test results, see docs and an example result

To support dev scenario on local box we could generalize the infrastructure to run on any machine and provide a tool that compares 2 runs (baseline vs. PR), so any dev can check impact on performance prior to PR if there's perf risk.

👍

Another interesting thing the HHVM team is doing is to include major OSS projects in perf runs, e.g. https://github.com/hhvm/oss-performance. I'm not sure if you're already doing something similar internally, but I'd image seeing how a change impacts a complex application / framework like Orchard, RavenDB, Nancy, ServiceStack, etc. could be very helpful.

from runtime.

Closing this issue. Its being discussed in the forums

from runtime.