> So sadly regressions are just completely lost in noise unless they are *major* slowdowns.
However, if there is a series of tests over time, you can show that while there is a 10% noise factor in the tests, over the last X releases, there is a downwards trend or something like that.