• nednguyen's avatar
    Enable more benchmark_smoke_unittest coverage · 65014162
    nednguyen authored
    Previously, benchmark_smoke_unittest has a heuristic to pick
    a benchmark for smoke testing if the benchmark uses a test
    in measurement directory.
    This patch removes that check, and instead provide a black
    list of benchmarks module that we exclude the
    benchmark_smoke_unittest to avoid high CQ time.
    
    This helped increases benchmark smoke coverage from 14 benchmarks -> 33 benchmarks (one in each benchmark module).
    
    On my local linux machine, this increases the cycle time of
    benchmark_smoke_unittest from 20s -> 1m7s.
    
    BUG=490130
    CQ_EXTRA_TRYBOTS=tryserver.chromium.perf:linux_perf_bisect;tryserver.chromium.perf:mac_perf_bisect;tryserver.chromium.perf:android_nexus5_perf_bisect
    
    Review URL: https://codereview.chromium.org/1144193002
    
    Cr-Commit-Position: refs/heads/master@{#330909}
    65014162
benchmark_smoke_unittest.py 5.01 KB