| # Task Drivers |
| |
| Task Drivers are Go programs that facilitate the compilation of code, the execution of tests, and |
| other actions as a part of our Continuous Integration system. |
| |
| They run a series of steps and store logs in such a way that they can be viewed in a logical manner. |
| |
| ## Task Driver Server |
| |
| The purpose of ./go/task-driver-server is to ingest logs from the execution of task drivers and |
| to present those collected logs. |
| |
| When running, a task driver will stream logs and step metadata to both stdout to |
| [Stack Driver Logging](https://cloud.google.com/logging). There is a |
| [sink](https://cloud.google.com/logging/docs/export/configure_export_v2) set up that will forward |
| these logs to [Pub/Sub](https://cloud.google.com/pubsub/docs/overview) [1]. This server subscribes |
| to the Pub/Sub topic [2] and processes the metadata by storing it to BigTable. |
| |
| See [the design doc for more details](https://docs.google.com/document/d/1BqbHKD2TWthA0XhidCxriqIWzutRGgc0qxbfRgSDijs/edit) |
| |
| 1. The sink is called `task-driver-logs-to-pubsub`. |
| [cloud console](https://console.cloud.google.com/logs/router?project=skia-swarming-bots) |
| 2. The topic is called `projects/skia-swarming-bots/topics/task-driver-logs` |
| [cloud console](https://console.cloud.google.com/cloudpubsub/topic/detail/task-driver-logs?project=skia-swarming-bots) |
