| commit | 8ea8cc00a8782240188e3f630671a5193002c0da | [log] [tgz] |
|---|---|---|
| author | Ravi Mistry <rmistry@google.com> | Thu Aug 08 09:41:05 2019 -0400 |
| committer | Skia Commit-Bot <skia-commit-bot@chromium.org> | Fri Aug 09 12:13:12 2019 +0000 |
| tree | 8e79b71b75b87330538957d16fff4cf293c6a124 | |
| parent | b195d18f8e107466942c7d7c0160b74ee2833456 [diff] |
Add ability to bring up multiple Android compile servers * Separates FE and BE and creates new FE server. * Creates new AndroidCompileInstances Kind in Datastore that keeps track of when mirror was last synced and if mirror should be force synced. * Changed UI to account for and display multiple backends. Screenshot: https://screenshot.googleplex.com/E9fA5A9QNPU * The force mirror sync button will now signal to all instances to update their mirror and so will behave similarly as before. * Support for running multiple backends * Multiple instances satisfy new requests by Ack'ing and Nack'ing pubsub storage notifications. * Care has been taken to make sure duplicate tasks are not triggered in case pubsub sends the same message again (At-least-once delivery from https://cloud.google.com/pubsub/docs/subscriber). * In case a backend is restarted it will run all tasks that were interrupted before picking up new tasks. * Other improvements * Changed startup to only sync checkouts that do not exist. Otherwise it syncs all checkouts during startup which is unnecessary because checkouts are synced before running tasks anyway. * Removed UpdateInfraFailureMetric. The alert was only triggered for merge errors and the error is already exposed in the recipe output anyway. Bug: skia:9302 Change-Id: I662f26c7fc0c841b6b36e39b20f06d50289f7eaa Reviewed-on: https://skia-review.googlesource.com/c/buildbot/+/231096 Commit-Queue: Ravi Mistry <rmistry@google.com> Reviewed-by: Eric Boren <borenet@google.com>
This repo contains infrastructure code for Skia.
The main source code repository is a Git repository hosted at https://skia.googlesource.com/buildbot.git. It is possible to check out this repository directly with git clone or via go get.
Using git clone allows you to work in whatever directory you want. You will still need to set GOPATH in order to build some apps (recommended to put this in a cache dir). E.g.:
$ cd ${WORKDIR}
$ git clone https://skia.googlesource.com/buildbot.git
$ export GOPATH=${HOME}/.cache/gopath/$(basename ${WORKDIR})
$ mkdir $GOPATH
$ cd buildbot
Using go get will fetch the repository into your GOPATH directory along with all the Go dependencies. You will need to set GOPATH and GO111MODULE=on. E.g.:
$ export GOPATH=${WORKDIR}
$ export GO111MODULE=on
$ go get -u -t go.skia.org/infra/...
$ cd ${GOPATH}/src/go.skia.org/infra/
Note: go.skia.org is a custom import path and will only work if used like the examples here.
Install Node.js (not as root) and add the bin dir to your path. Optionally run npm install npm -g, as suggested by the npm getting started doc.
Install other dependencies:
$ sudo apt-get install python-django $ go get -u github.com/kisielk/errcheck \ golang.org/x/tools/cmd/goimports \ go.chromium.org/luci/client/cmd/isolate $ npm install -g polylint bower
Build ~everything:
$ make all
Some code is generated using go generate with external binaries. First, install the version of protoc referenced in the asset creation script and ensure it is on your PATH before other versions of protoc.
Install the necessary go packages:
$ go get -u \ github.com/golang/protobuf/protoc-gen-go \ golang.org/x/tools/cmd/stringer \ google.golang.org/grpc \ github.com/vektra/mockery/...
To generate code run in this directory:
$ go generate ./...
Install Cloud SDK.
Use this command to run the presubmit tests:
$ ./run_unittests --small