Docker pushes watcher is an app that with new task drivers and new bots has replaced Google Cloud Build for Skia. The tracking bug for this work was skbug/9514.
Skia used to trigger builds on Google Cloud's Cloud Build framework using this cloudbuild.yaml file.
Using cloud build, the “skia-release” and “skia-wasm-release” images were created and pushed per commit in the Skia repository. The “infra” image was created and pushed per commit in the Buildbot repository.
Additionally cloudbuild.yaml created and pushed new images for various apps like fiddler, skottie, particles, debugger, etc.
The continuous-deploy app then ran pushk on those apps and deployed them to k8s.
The Cloud build framework worked but did not use Skia infra framework and was thus difficult to see failures and diagnose problems. The framework was replaced with task drivers and the docker-pushes-watcher app. Now all failures when building apps cause the corresponding bots to turn red on status.skia.org for the commits that break things, this makes failures much easier to find for the sheriff. Failures in the docker-pushes-watcher app show up as alerts for the trooper to diagnose and fix.
A task driver was written to build and push a specified docker image (build_push_docker_image).
The following bots were then created in the different repositories:
These bots could run out of order because of backfilling. Due to this the “Docker Pushes Watcher” app (described below) calculates which image is the most recent and then tags it with the “prod” tag.
Task Drivers were also written to create and push Docker images of various apps that depend on the “gcr.io/skia-public/skia-release” and “gcr.io/skia-public/skia-wasm-release” images:
The following bots were created using the above task drivers:
All above task drivers send a pubsub message when a docker image is created and pushed.
The docker pushes watcher app listens for pubsub messages for 2 main tasks:
A task driver has been written to build and push images of infra apps (push_apps_from_infra_image). The task driver sends a pubsub message after the image is built, the docker_pushes_watcher app then pushks those apps.
The following steps will add new apps to the auto-deploying framework: