Commit 8be96fa4 authored by Wenbin Zhang's avatar Wenbin Zhang Committed by Commit Bot

[benchmarking] stop running reference build for system_health.common

As part of the progress of removing reference build from perf waterfall, this CL disabled the reference builds on system_health.common on all platforms, i.e.,
system_health.common_mobile.reference is no longer running on:
Android Nexus5 Perf, Android Nexus5X WebView Perf, android-go_webview-perf, android-go-perf, android-pixel2_weblayer-perf, android-pixel2_webview-perf, android-pixel2-perf
system_health.common_desktop.reference is no longer running on:
linux-perf, mac-10_12_laptop_low_end-perf, mac-10_13_laptop_high_end-perf, win-10_laptop_low_end-perf, win-10-perf

More details can be found in:
go/ref-builds-prd
go/chromeperf-refless

Bug: chromium:1108663
Change-Id: I9b0bee9818b74f2a26fb0ed5fbc0286526dfac56
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/2337380Reviewed-by: default avatarTimothy Dresser <tdresser@chromium.org>
Reviewed-by: default avatarJohn Chen <johnchen@chromium.org>
Auto-Submit: Wenbin Zhang <wenbinzhang@google.com>
Commit-Queue: Wenbin Zhang <wenbinzhang@google.com>
Cr-Commit-Position: refs/heads/master@{#794891}
parent 758cf97b
...@@ -113,6 +113,10 @@ GTEST_CONVERSION_WHITELIST = [ ...@@ -113,6 +113,10 @@ GTEST_CONVERSION_WHITELIST = [
'xr.vr.common_perftests', 'xr.vr.common_perftests',
] ]
BENCHMARKS_TO_SKIP_REF = [
'system_health.common_desktop',
'system_health.common_mobile'
]
class OutputFilePaths(object): class OutputFilePaths(object):
"""Provide paths to where results outputs should be written. """Provide paths to where results outputs should be written.
...@@ -625,7 +629,7 @@ def main(sys_args): ...@@ -625,7 +629,7 @@ def main(sys_args):
command_generator, output_paths, options.xvfb) command_generator, output_paths, options.xvfb)
overall_return_code = return_code or overall_return_code overall_return_code = return_code or overall_return_code
test_results_files.append(output_paths.test_results) test_results_files.append(output_paths.test_results)
if options.run_ref_build: if options.run_ref_build and benchmark not in BENCHMARKS_TO_SKIP_REF:
reference_benchmark_foldername = benchmark + '.reference' reference_benchmark_foldername = benchmark + '.reference'
reference_output_paths = OutputFilePaths( reference_output_paths = OutputFilePaths(
isolated_out_dir, reference_benchmark_foldername).SetUp() isolated_out_dir, reference_benchmark_foldername).SetUp()
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment