Maybe this is just a different usage of the term "regression". In kernel-land a regression as you describe is where a change negatively affects performance in some unique scenario, Linux kernel developers take this seriously. For obvious functionality type regressions it would seem a test suite could, over time, test every code path.