GitLab

system_health_smoke_tests.py has a logic to make sure
we only run the latest version of a story in smoke test.

For example:
Case 1:
 Story_A:2019
 Story_A
Case 2:
 Story_A:2018
 Story_A:2019
In both cases, Story_A:2019 is expected to run, and all
other versions should be listed in the _DISABLED_TESTS in
order to save CQ run time.

However, in the current implementation, none of the old
versions in the above cases will be detected.This CL will
update the logic cover the above cases.

The new logic also discovered two stories which we currently
run smoke tests with their older versions. In this case, those
older versions now are added in the _DISABLED_TESTS. Those stories
are:
benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop/load:social:vk
benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_desktop/load:social:vk:2018

benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile/load:social:twitter
benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile/load:social:twitter:2019


R=crouleau@google.com

Bug: catapult:1006771
Change-Id: Ia90f38568685ca8be45710f97e91cd8ea81dc856
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/1845792
Commit-Queue: Wenbin Zhang <wenbinzhang@google.com>
Reviewed-by: Caleb Rouleau <crouleau@chromium.org>
Cr-Commit-Position: refs/heads/master@{#704917}