Examples of tests that make use of Puppeteer might include:
Screenshot-grabbing tests. In the case of lit-html components, such a test might perform the following steps:
Integration tests. For example:
First, make sure to run
npm ci from
//puppeteer-tests if you haven't already.
make puppeteer-tests from this repository's root directory. This will run all Puppeteer tests in the buildbot repository inside a Docker container.
(If the container image is missing, please run
make container from
If your application isn't already configured to run its Puppeteer tests as part of the
Infra-PerCommit-Puppeteer tryjob, please edit
//puppeteer-tests/docker/run-tests.sh and make any necessary changes. See below for more.
Puppeteer tests run on Node.js and are assumed to use the Mocha test runner.
Puppeteer tests make use of the utility functions defined in
//puppeteer-tests/util.js to launch a Puppeteer instance and take screenshots.
Screenshots will be found at
//puppeteer-tests/output after the tests finish. The
Infra-PerCommit-Puppeteer tryjob will upload to Gold any screenshots found in this directory, using the file name as the test name (excluding the
The best way to learn how to write Puppeteer tests is by example. See
//golden/**/*_puppeteer_test.js for some.
The recommended naming scheme for screenshots is
<application>_<component-name-sk>_<scenario>. This is to avoid name collisions and to be consistent with existing tests.
For example, tests for Gold's
dots-sk component are named as follows:
npx mocha from your application's subdirectory to execute Puppeteer tests locally (outside of Docker). Examples:
# First we "cd" into Gold's subdirectory, as we will only run Gold tests below. cd golden # Run all of Gold's Puppeteer tests. npx mocha ./**/*_puppeteer_test.js # Run all tests containing "dots-sk" in their name. npx mocha ./**/*_puppeteer_test.js -g dots-sk # Wait for a debugger to attach to the Node process before running the tests. npx mocha ./**/*_puppeteer_test.js --inspect-brk
To reduce flakiness, the
Infra-PerCommit-Puppeteer tryjob runs all Puppeteer tests run inside the
gcr.io/skia-public/puppeteer-tests:latest Docker container. This container is based on the
node:12.13 image and includes some additional dependencies required by Puppeteer.
The container is defined in
//puppeteer-tests/docker/Dockerfile, and can be rebuilt by running
make container from the
To push a new version of the container to the GCP's Container Registry, please run
This tryjob is orchestrated by the
//infra/bots/recipe/puppeteer_tests.py recipe, which performs the following steps:
make puppeteer-testsfrom the root directory of the checked out repository.
/src, and the
//puppeteer-tests/outputdirectory is mounted at
//puppeteer-tests/docker/run-tests.shis executed inside the container.
/testsinside the container, installs the Node dependencies with
npm ciand runs the tests with
//puppeteer-tests/upload-screenshots-to-gold.pyscript, which invokes
goldctlwith any screenshots found in
In order to include an application's Puppeteer tests in the
Infra-PerCommit-Puppeteer tryjob, file
//puppeteer-tests/docker/run-tests.sh must copy any necessary files into the Docker container, install any necessary dependencies and actually run the tests.
This is done in three steps:
/tests/my-app, and copy the necessary files from
//my-appin the repository.
npx mocha /tests/**/*_puppeteer_test.js.