[gold] Partially implement goldctl's interaction with /json/digests

This adds a bulk of the implementation and some simple tests.

Follow up CLs will:
1) refactor the reused test code from diff_test
2) integrate with the CLI part

Bug: skia:9528

Change-Id: I442daf91def931a31f0b74a4b00a6b151cc36a16
Reviewed-on: https://skia-review.googlesource.com/c/buildbot/+/255532
Reviewed-by: Leandro Lovisolo <lovisolo@google.com>
Reviewed-by: Ben Wagner aka dogben <benjaminwagner@google.com>
11 files changed
tree: aebacc34686742ce6b8124b8abf468c09b341604
  1. am/
  2. android_compile/
  3. android_ingest/
  4. android_stats/
  5. api/
  6. appengine_scripts/
  7. autoroll/
  8. bash/
  9. blamer/
  10. chromeextensions/
  11. comments/
  12. common-sk/
  13. contestk/
  14. cq_watcher/
  15. ct/
  16. datahopper/
  17. debugger/
  18. debugger-assets/
  19. docker/
  20. docserverk/
  21. dot/
  22. ds/
  23. fiddlek/
  24. firestore/
  25. get_service_account/
  26. git_cookie_authdaemon/
  27. gitsync/
  28. go/
  29. gold-client/
  30. golden/
  31. hashtag/
  32. html-template-minifier/
  33. infra/
  34. infra-sk/
  35. jsdoc/
  36. jsfiddle/
  37. k8s_checker/
  38. kube/
  39. leasing/
  40. licenses/
  41. make/
  42. named-fiddles/
  43. particles/
  44. perdiff/
  45. perf/
  46. periodic-trigger/
  47. power/
  48. proberk/
  49. promk/
  50. pulld/
  51. push/
  52. res/
  53. scripts/
  54. sheriff_emails/
  55. skfe/
  56. skolo/
  57. skottie/
  58. status/
  59. task_driver/
  60. task_scheduler/
  61. tools/
  62. velero/
  63. webtools/
  64. .gitattributes
  65. .gitignore
  66. build_infra_prod.sh
  67. cipd.ensure
  68. codereview.settings
  69. DATASTORE.md
  70. DEPS
  71. go.mod
  72. go.sum
  73. launch.md
  74. LICENSE
  75. Makefile
  76. PRESUBMIT.py
  77. PRIVACY_POLICY.md
  78. README.md
  79. run_unittests
  80. run_unittests.go
  81. STYLEGUIDE.md
  82. whitespace.txt
README.md

Skia-Buildbot Repository

This repo contains infrastructure code for Skia.

Getting the Source Code

The main source code repository is a Git repository hosted at https://skia.googlesource.com/buildbot.git. It is possible to check out this repository directly with git clone or via go get.

Using git clone allows you to work in whatever directory you want. You will still need to set GOPATH in order to build some apps (recommended to put this in a cache dir). E.g.:

$ cd ${WORKDIR}
$ git clone https://skia.googlesource.com/buildbot.git
$ export GOPATH=${HOME}/.cache/gopath/$(basename ${WORKDIR})
$ mkdir $GOPATH
$ cd buildbot

Using go get will fetch the repository into your GOPATH directory along with all the Go dependencies. You will need to set GOPATH and GO111MODULE=on. E.g.:

$ export GOPATH=${WORKDIR}
$ export GO111MODULE=on
$ go get -u -t go.skia.org/infra/...
$ cd ${GOPATH}/src/go.skia.org/infra/

Note: go.skia.org is a custom import path and will only work if used like the examples here.

Install Node.js (not as root) and add the bin dir to your path. Optionally run npm install npm -g, as suggested by the npm getting started doc.

Install other dependencies:

$ sudo apt-get install python-django
$ go get -u github.com/kisielk/errcheck \
  golang.org/x/tools/cmd/goimports \
  go.chromium.org/luci/client/cmd/isolate
$ npm install -g polylint bower

Build ~everything:

$ make all

Generated Code

Some code is generated using go generate with external binaries. First, install the version of protoc referenced in the asset creation script and ensure it is on your PATH before other versions of protoc.

Install the necessary go packages:

$ go get -u \
  github.com/golang/protobuf/protoc-gen-go \
  golang.org/x/tools/cmd/stringer \
  google.golang.org/grpc \
  github.com/vektra/mockery/...

To generate code run in this directory:

$ go generate ./...

Running unit tests

Install Cloud SDK.

Use this command to run the presubmit tests:

$ ./run_unittests --small