Google Git
Sign in
skia / buildbot / 6bd6447508b4d7b38514c9caf7688fe278a651c8
commit6bd6447508b4d7b38514c9caf7688fe278a651c8[log] [tgz]
authorChris Mumford <cmumford@google.com>Tue Sep 19 09:13:48 2023 -0700
committerSkCQ <skcq-be@skia-corp.google.com.iam.gserviceaccount.com>Tue Sep 19 17:31:07 2023 +0000
tree233bbd8d947ee20dcbf1b7d8f5d6f286872f8f75
parent24bd451cfe2faab215cb616e18a1e5d057448b29 [diff]
Switch back to the Python version of gsutil

Commit 84cc4bdc442ddedd4fe4cada9e1780e9c57bccd8 switched from the
Python version of gsutil, fetched from a CIPD package at
infra/gsutil, to a Go version in the infra/tools/luci/gsutil CIPD
package. This was done for the Python v2 to v3 migration. The
Luci Go version of gsutil is *way* less feature complete than
the official Python version. This isn't a problem for the Skia
uses of gsutil, but the CIPD version of gsutil is also embedded
into the base-cipd Docker image, which is used by autorollers
that use more gsutil subcommands.

Fortunately the official gsutil switched to Python 3, so switching
back to the Python version of gsutil.

Bug: b/295525434
Change-Id: I531904ba9684b154e6cfc3cceaa09f1f951fc6a9
Reviewed-on: https://skia-review.googlesource.com/c/buildbot/+/757320
Reviewed-by: Kevin Lubick <kjlubick@google.com>
Commit-Queue: Chris Mumford <cmumford@google.com>
2 files changed
tree: 233bbd8d947ee20dcbf1b7d8f5d6f286872f8f75
  1. am/
  2. android_ingest/
  3. android_stats/
  4. api/
  5. autoroll/
  6. bash/
  7. bazel/
  8. bisection/
  9. blamer/
  10. bugs-central/
  11. cabe/
  12. cd/
  13. cherrypick-watcher/
  14. cmd/
  15. codereview-watcher/
  16. codesize/
  17. comments/
  18. comp-ui/
  19. cq_watcher/
  20. ct/
  21. datahopper/
  22. debugger-app/
  23. demos/
  24. docker/
  25. docker_pushes_watcher/
  26. docs/
  27. docsyserver/
  28. ds/
  29. elements-sk/
  30. email/
  31. external/
  32. fiddlek/
  33. firestore/
  34. get_service_account/
  35. gitsync/
  36. go/
  37. gold-client/
  38. golden/
  39. helloworld/
  40. infra/
  41. infra-sk/
  42. jsdoc/
  43. jsfiddle/
  44. k8s-checker/
  45. k8s-deployer/
  46. kube/
  47. leasing/
  48. licenses/
  49. machine/
  50. make/
  51. modules/
  52. named-fiddles/
  53. new_element/
  54. npm-audit-mirror/
  55. perdiff/
  56. perf/
  57. periodic-trigger/
  58. proberk/
  59. promk/
  60. puppeteer-tests/
  61. sa-keys-checker/
  62. scrap/
  63. scripts/
  64. shaders/
  65. sk/
  66. skbug/
  67. skcq/
  68. skfe/
  69. skolo/
  70. skottie/
  71. static_server/
  72. status/
  73. task_driver/
  74. task_scheduler/
  75. test-service/
  76. tools/
  77. tree_status/
  78. trybot_updater/
  79. .bazelignore
  80. .bazelrc
  81. .bazelversion
  82. .eslintrc.js
  83. .gitattributes
  84. .gitignore
  85. .npmrc
  86. .prettierignore
  87. .prettierrc.json
  88. .puppeteerrc.js
  89. .vpython
  90. BAZEL_CHEATSHEET.md
  91. BUILD.bazel
  92. build_infra_prod.sh
  93. cipd.ensure
  94. codereview.settings
  95. DATASTORE.md
  96. demopage.sh
  97. DEPS
  98. go.mod
  99. go.sum
  100. go_repositories.bzl
  101. karmatest.sh
  102. launch.md
  103. LICENSE
  104. Makefile
  105. OWNERS
  106. package-lock.json
  107. package.json
  108. PRESUBMIT.py
  109. PRIVACY_POLICY.md
  110. README.md
  111. STYLEGUIDE.md
  112. tools.go
  113. tsconfig.json
  114. whitespace.txt
  115. WORKSPACE
README.md

Skia-Buildbot Repository

This repo contains infrastructure code for Skia.

Getting the Source Code

The main source code repository is a Git repository hosted at https://skia.googlesource.com/buildbot.git. It is possible to check out this repository directly with git clone or via go get.

Using git clone allows you to work in whatever directory you want. You will still need to set GOPATH in order to build some apps (recommended to put this in a cache dir). E.g.:

$ cd ${WORKDIR}
$ git clone https://skia.googlesource.com/buildbot.git
$ export GOPATH=${HOME}/.cache/gopath/$(basename ${WORKDIR})
$ mkdir $GOPATH
$ cd buildbot

Install dependencies

Almost all applications are built with Bazel, and bazelisk is the recommended tool to ensure you have the right version of bazel installed:

go install github.com/bazelbuild/bazelisk@latest
go install github.com/bazelbuild/buildtools/buildifier@latest
go install github.com/kisielk/errcheck@latest
go install golang.org/x/tools/cmd/goimports@latest
go install github.com/mikefarah/yq/v4@latest
go install go.chromium.org/luci/client/cmd/...@latest

Install other dependencies:

sudo apt-get install jq

Build ~everything

bazelisk build --config=mayberemote //...

Test everything

bazelisk test --config=mayberemote //...

Generated Code

To update generated code run the following in any directory:

go generate ./...

Running unit tests

Install Cloud SDK.

Use this command to run the presubmit tests:

./run_unittests --small