Commit 25d36183 authored by kochi@chromium.org's avatar kochi@chromium.org

Update TestExpectation to suppress flakiness

As found while investigating crbug.com/503445, crash by assertion hit
may induce other innocent tests to crash (to be precise, look
like a crash) when an used object is collected by the garbage
collector and hit an assertion.

I've run independent tests repeatedly to identify which tests
causes similar failures and assigned bug for each.

They crash anyway, so they must be fixed, but to prevent other
innocent tests from crashing, mark them as "Skip" rather than
"Crash".

BUG=503445, 505364, 520616, 521907, 521913, 521914, 521918, 521929, 521936, 521937, 521941

Review URL: https://codereview.chromium.org/1298893002

git-svn-id: svn://svn.chromium.org/blink/trunk@200775 bbb929c8-8fbe-4397-9dbb-9b2b20218538
parent db72fb62
......@@ -406,9 +406,6 @@ crbug.com/505364 imported/web-platform-tests/shadow-dom/html-elements-and-their-
crbug.com/505364 imported/web-platform-tests/shadow-dom/html-elements-and-their-shadow-trees/test-004.html [ Crash ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/html-elements-in-shadow-trees/html-forms/test-003.html [ Failure ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/shadow-trees/custom-pseudo-elements/test-001.html [ Failure ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/shadow-trees/lower-boundary-encapsulation/test-004.html [ Failure ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/shadow-trees/lower-boundary-encapsulation/test-005.html [ Crash ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/ownerdocument-002.html [ Failure ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/styles/css-variables/test-001.html [ Failure ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/styles/test-003.html [ Failure ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/styles/test-008.html [ Crash ]
......@@ -416,10 +413,25 @@ crbug.com/505364 imported/web-platform-tests/shadow-dom/styles/test-010.html [ F
crbug.com/505364 imported/web-platform-tests/shadow-dom/user-interaction/focus-navigation/test-004.html [ Crash ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/user-interaction/ranges-and-selections/test-002.html [ Failure Crash ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/dom-tree-accessors-001.html [ Failure ]
crbug.com/505364 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/dom-tree-accessors-002.html [ Failure ]
crbug.com/505364 crbug.com/520616 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/test-007.html [ Crash Failure Timeout ]
crbug.com/505364 crbug.com/520616 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/test-009.html [ Crash Failure Timeout ]
# These tests are known to hit assertion after the test is finished, which causes
# other tests to be flaky. Skipping these until the real fix is done.
crbug.com/521941 imported/web-platform-tests/shadow-dom/shadow-trees/lower-boundary-encapsulation/test-003.html [ Skip ]
crbug.com/521941 imported/web-platform-tests/shadow-dom/shadow-trees/lower-boundary-encapsulation/test-004.html [ Skip ]
crbug.com/521941 imported/web-platform-tests/shadow-dom/shadow-trees/lower-boundary-encapsulation/test-005.html [ Skip ]
crbug.com/521918 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/dom-tree-accessors-001.html [ Skip ]
crbug.com/521918 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/dom-tree-accessors-002.html [ Skip ]
crbug.com/521907 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/ownerdocument-001.html [ Skip ]
crbug.com/521907 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/ownerdocument-002.html [ Skip ]
crbug.com/521929 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/selectors-api-001.html [ Skip ]
crbug.com/521929 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/selectors-api-002.html [ Skip ]
crbug.com/521937 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/shadow-root-001.html [ Skip ]
crbug.com/520616 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/test-005.html [ Skip ]
crbug.com/505364 crbug.com/520616 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/test-007.html [ Skip ]
crbug.com/505364 crbug.com/520616 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/test-009.html [ Skip ]
crbug.com/503445 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/test-011.html [ Skip ]
crbug.com/521913 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/window-named-properties-002.html [ Skip ]
crbug.com/521914 imported/web-platform-tests/shadow-dom/shadow-trees/upper-boundary-encapsulation/window-named-properties-003.html [ Skip ]
crbug.com/387740 imported/web-platform-tests/mediacapture-streams/stream-api/introduction/disabled-audio-silence.html [ Skip ]
crbug.com/387740 imported/web-platform-tests/mediacapture-streams/stream-api/introduction/disabled-video-black.html [ Skip ]
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment