[ansible] Windows: sleep for 10 seconds before launching TMM.

skia-e-win-367 and skia-e-368 fail to launch test_machine_monitor.exe with errors such as:

    .\test_machine_monitor.exe : F0622 12:21:48.611977    6756 with.go:241] Failed to initialize: oauth2: cannot fetch
    token: Post "https://oauth2.googleapis.com/token": dial tcp: lookup oauth2.googleapis.com: no such host

This indicates the network isn't ready before test_machine_monitor.exe is launched. Joe's hypothesis is that because these machines are new and snappy, TMM launches before the network has a chance to become ready. Adding a slight delay before launching TMM seems to fix it.

Note that the above error message isn't accessible from the GCP Logs Viewer. The trick to get log messages in this situation is to pipe both stdout and stderr into a text file from test_machine_monitor.ps1, e.g. "test_machine_monitor.exe --foo --bar ... 2>&1 >> logs.txt".

An alternative I considered is to use the "Event"[1] trigger from the win_scheduled_task[2] Ansible module to launch TMM when the network becomes online, rather than on logon as we do today. However this approach seems way more complicated[3]. Furthermore, it does not take into account the unlikely scenario of the network repeatedly going offline then back online, which would trigger a TMM launch every time the network goes online.

Another alternative would be to add some retry logic to TMM to prevent it from panicking if the network is offline. IMO the "sleep" approach wins due to its simplicity.

[1] https://docs.microsoft.com/en-us/windows/win32/taskschd/eventtrigger
[2] https://docs.ansible.com/ansible/latest/collections/community/windows/win_scheduled_task_module.html
[3] https://www.groovypost.com/howto/automatically-run-script-on-internet-connect-network-connection-drop

Change-Id: Ie8ecebaf00586df2058a04a9819fcdd5d0fff2da
Reviewed-on: https://skia-review.googlesource.com/c/buildbot/+/552396
Reviewed-by: Joe Gregorio <jcgregorio@google.com>
Commit-Queue: Joe Gregorio <jcgregorio@google.com>
Auto-Submit: Leandro Lovisolo <lovisolo@google.com>
1 file changed
tree: 1c846e0541bdae5ddd567f96536a6e599280cd87
  1. am/
  2. android_ingest/
  3. android_stats/
  4. api/
  5. autoroll/
  6. bash/
  7. bazel/
  8. blamer/
  9. bugs-central/
  10. cd/
  11. cherrypick-watcher/
  12. codereview-watcher/
  13. codesize/
  15. comp-ui/
  16. contestk/
  17. cq_watcher/
  18. ct/
  19. datahopper/
  20. debugger-app/
  21. demos/
  22. docker/
  23. docker_pushes_watcher/
  24. docs/
  25. docsyserver/
  26. dot/
  27. ds/
  28. email/
  29. external/
  30. fiddlek/
  31. firestore/
  32. get_service_account/
  33. gitsync/
  34. go/
  35. gold-client/
  36. golden/
  37. hashtag/
  38. infra/
  39. infra-sk/
  40. jsdoc/
  41. jsfiddle/
  42. k8s-checker/
  43. k8s-deployer/
  44. kube/
  45. leasing/
  46. licenses/
  47. machine/
  48. make/
  49. modules/
  50. named-fiddles/
  51. new_element/
  52. npm-audit-mirror/
  53. particles/
  54. perdiff/
  55. perf/
  56. periodic-trigger/
  57. proberk/
  58. promk/
  59. puppeteer-tests/
  60. sa-keys-checker/
  61. scrap/
  62. scripts/
  63. shaders/
  64. sk/
  65. skbug/
  66. skcq/
  67. skfe/
  68. skolo/
  69. skottie/
  70. static_server/
  71. status/
  72. switchboard/
  73. task_driver/
  74. task_scheduler/
  75. test-service/
  76. third_party/
  77. tools/
  78. tree_status/
  79. trybot_updater/
  80. velero/
  81. .bazelignore
  82. .bazelrc
  83. .bazelversion
  84. .eslintrc.js
  85. .gitattributes
  86. .gitignore
  87. .mocharc.json
  88. .npmrc
  89. .vpython
  91. BUILD.bazel
  92. build_infra_prod.sh
  93. cipd.ensure
  94. codereview.settings
  95. DATASTORE.md
  96. demopage.sh
  97. DEPS
  98. elements-sk-scss.bzl
  99. go.mod
  100. go.sum
  101. go_repositories.bzl
  102. launch.md
  103. LICENSE
  104. Makefile
  105. OWNERS
  106. package-lock.json
  107. package.json
  108. PRESUBMIT.py
  110. README.md
  111. run_unittests
  112. run_unittests.go
  113. STYLEGUIDE.md
  114. tools.go
  115. tsconfig.json
  116. whitespace.txt

Skia-Buildbot Repository

This repo contains infrastructure code for Skia.

Getting the Source Code

The main source code repository is a Git repository hosted at https://skia.googlesource.com/buildbot.git. It is possible to check out this repository directly with git clone or via go get.

Using git clone allows you to work in whatever directory you want. You will still need to set GOPATH in order to build some apps (recommended to put this in a cache dir). E.g.:

$ cd ${WORKDIR}
$ git clone https://skia.googlesource.com/buildbot.git
$ export GOPATH=${HOME}/.cache/gopath/$(basename ${WORKDIR})
$ mkdir $GOPATH
$ cd buildbot

Using go get will fetch the repository into your GOPATH directory along with all the Go dependencies. You will need to set GOPATH and GO111MODULE=on. E.g.:

$ export GOPATH=${WORKDIR}
$ export GO111MODULE=on
$ go get -u -t go.skia.org/infra/...
$ cd ${GOPATH}/src/go.skia.org/infra/

Note: go.skia.org is a custom import path and will only work if used like the examples here.

Install Node.js (not as root) and add the bin dir to your path. Optionally run npm install npm -g, as suggested by the npm getting started doc.

Install other dependencies:

$ sudo apt-get install \
    jq \
$ go get -u \
    github.com/kisielk/errcheck \
    golang.org/x/tools/cmd/goimports \
    go.chromium.org/luci/client/cmd/isolate \
    go get github.com/mikefarah/yq/v4

Build ~everything:

$ make all

Generated Code

Some code is generated using go generate with external binaries. First, install the version of protoc referenced in the asset creation script and ensure it is on your PATH before other versions of protoc.

Install the necessary go packages:

$ go get -u \
  github.com/golang/protobuf/protoc-gen-go \
  golang.org/x/tools/cmd/stringer \
  google.golang.org/grpc \

To generate code run in this directory:

$ go generate ./...

Running unit tests

Install Cloud SDK.

Use this command to run the presubmit tests:

$ ./run_unittests --small