• sergeyberezin@chromium.org's avatar
    Temporarily increase retry limit in test_launcher · d4635c48
    sergeyberezin@chromium.org authored
    In bot mode, test_launcher would normally retry tests up to 3 times.
    This is sufficient to keep large test suites like browser_tests under
    1% flakiness rate if the flakiness of individual tests is also within
    1%. However, some tests especially in browser_tests are up to 33%
    flaky, making the browser_tests suite 40% flaky.
    
    Subsequent top-level retries effectively double the runtime of all
    bots running these tests, and we need a solution to shorten the try
    job runtime.
    
    A longer-term solution is the ignorer bot (see the bug), but until
    it's deployed, a quick hack is to increase the number of retries so
    statistically we should see about 1% flakiness of browser_tests at the
    expense of a slight runtime increase.
    
    R=sergiyb@chromium.org
    BUG=390600, 395189
    
    Review URL: https://codereview.chromium.org/393283006
    
    git-svn-id: svn://svn.chromium.org/chrome/trunk/src@284650 0039d316-1c4b-4281-b951-d872f2087c98
    d4635c48
test_launcher.cc 35.2 KB