Commit 7878d06f authored by Stephen McGruer's avatar Stephen McGruer Committed by Chromium LUCI CQ

[documentation] Update some web_tests documentation relating to Android

Android is no longer supported for running web_tests (and has not been
for some time). The SmokeTests file however is still used, by the
Fuchsia bots.

Bug: 567947
Change-Id: Id4dde2b2d8751b9fadc2a94fdd682b78fba5aeb7
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/2629569Reviewed-by: default avatarRakib Hasan <rmhasan@google.com>
Reviewed-by: default avatardanakj <danakj@chromium.org>
Commit-Queue: Stephen McGruer <smcgruer@chromium.org>
Auto-Submit: Stephen McGruer <smcgruer@chromium.org>
Cr-Commit-Position: refs/heads/master@{#844212}
parent 1ac48b60
...@@ -166,7 +166,7 @@ details. ...@@ -166,7 +166,7 @@ details.
longer than the usual timeout to run. Slow tests are given 5x the usual longer than the usual timeout to run. Slow tests are given 5x the usual
timeout. timeout.
* [SmokeTests](../../third_party/blink/web_tests/SmokeTests): A small subset * [SmokeTests](../../third_party/blink/web_tests/SmokeTests): A small subset
of tests that we run on the Android bot. of tests that we run on the Fuchsia bots.
* [StaleTestExpectations](../../third_party/blink/web_tests/StaleTestExpectations): * [StaleTestExpectations](../../third_party/blink/web_tests/StaleTestExpectations):
Platform-specific lines that have been in TestExpectations for many months. Platform-specific lines that have been in TestExpectations for many months.
They're moved here to get them out of the way of people doing rebaselines They're moved here to get them out of the way of people doing rebaselines
......
...@@ -23,6 +23,15 @@ Chrome-specific tests only. ...@@ -23,6 +23,15 @@ Chrome-specific tests only.
## Running Web Tests ## Running Web Tests
### Supported Platforms
* Linux
* MacOS
* Windows
* Fuchsia
Android is [not supported](https://crbug.com/567947).
### Initial Setup ### Initial Setup
Before you can run the web tests, you need to build the `blink_tests` target Before you can run the web tests, you need to build the `blink_tests` target
...@@ -32,16 +41,6 @@ to get `content_shell` and all of the other needed binaries. ...@@ -32,16 +41,6 @@ to get `content_shell` and all of the other needed binaries.
autoninja -C out/Default blink_tests autoninja -C out/Default blink_tests
``` ```
On **Android** (web test support
[currently limited to KitKat and earlier](https://crbug.com/567947)) you need to
build and install `content_shell_apk` instead. See also:
[Android Build Instructions](../android_build_instructions.md).
```bash
autoninja -C out/Default content_shell_apk
adb install -r out/Default/apks/ContentShell.apk
```
On **Mac**, you probably want to strip the content_shell binary before starting On **Mac**, you probably want to strip the content_shell binary before starting
the tests. If you don't, you'll have 5-10 running concurrently, all stuck being the tests. If you don't, you'll have 5-10 running concurrently, all stuck being
examined by the OS crash reporter. This may cause other failures like timeouts examined by the OS crash reporter. This may cause other failures like timeouts
...@@ -63,12 +62,6 @@ use the build in `out/Default`, use: ...@@ -63,12 +62,6 @@ use the build in `out/Default`, use:
third_party/blink/tools/run_web_tests.py -t Default third_party/blink/tools/run_web_tests.py -t Default
``` ```
For Android (if your build directory is `out/android`):
```bash
third_party/blink/tools/run_web_tests.py -t android --android
```
*** promo *** promo
* Windows users need to use `third_party/blink/tools/run_web_tests.bat` instead. * Windows users need to use `third_party/blink/tools/run_web_tests.bat` instead.
* Linux users should not use `testing/xvfb.py`; `run_web_tests.py` manages Xvfb * Linux users should not use `testing/xvfb.py`; `run_web_tests.py` manages Xvfb
...@@ -86,12 +79,11 @@ learn more about TestExpectations and related files. ...@@ -86,12 +79,11 @@ learn more about TestExpectations and related files.
*** promo *** promo
Currently only the tests listed in Currently only the tests listed in
[SmokeTests](../../third_party/blink/web_tests/SmokeTests) [SmokeTests](../../third_party/blink/web_tests/SmokeTests) are run on the
are run on the Android bots, since running all web tests takes too long on Fuchsia bots, since running all web tests takes too long on Fuchshia. Most
Android (and may still have some infrastructure issues). Most developers focus developers focus their Blink testing on Linux. We rely on the fact that the
their Blink testing on Linux. We rely on the fact that the Linux and Android Linux and Fuchsia behavior is nearly identical for scenarios outside those
behavior is nearly identical for scenarios outside those covered by the smoke covered by the smoke tests.
tests.
*** ***
To run only some of the tests, specify their directories or filenames as To run only some of the tests, specify their directories or filenames as
......
# This file lists a limited set of web tests that are run on platforms where
# executing all web tests is infeasible (usually due to performance or resource
# constraints). As of Q1 2021, only Fuchsia uses this file by default (of
# platforms that run web tests).
#
# Further documentation:
# https://chromium.googlesource.com/chromium/src/+/master/docs/testing/web_test_expectations.md
accessibility/aria-labelledby-on-input.html accessibility/aria-labelledby-on-input.html
accessibility/aria-link-supports-press.html accessibility/aria-link-supports-press.html
accessibility/insert-adjacent-html-causes-crash.xhtml accessibility/insert-adjacent-html-causes-crash.xhtml
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment