Deduplicate fuzz cases on the frontend before they are displayed.

The current algorithm looks at the top 4 stacktrace frames (not caring about line
numbers) and the flags to determine unique instances.

fuzzes with no stacktraces or the "Other" flag are automatically considered
'unique'

Preliminary results show that this trims down the skpicture fuzzes from ~70k to ~500-1000

BUG=skia:4438

Review URL: https://codereview.chromium.org/1672033002
10 files changed
tree: fb274ef7750f0b02c50956421879c2572cb44163
  1. alertserver/
  2. android_stats/
  3. appengine_scripts/
  4. autoroll/
  5. bash/
  6. bug_chomper/
  7. build_scheduler/
  8. compute_engine_scripts/
  9. ct/
  10. datahopper/
  11. datahopper_internal/
  12. debugger/
  13. doc/
  14. fuzzer/
  15. get_service_account/
  16. go/
  17. golden/
  18. grafana/
  19. grandcentral/
  20. influxdb/
  21. infra/
  22. js/
  23. logserver/
  24. misc/
  25. nginx/
  26. nsqd/
  27. pdfium/
  28. perdiff/
  29. perf/
  30. prober/
  31. pulld/
  32. push/
  33. res/
  34. scripts/
  35. site_config/
  36. skfe/
  37. status/
  38. tools/
  39. tracedb/
  40. webtools/
  41. webtry/
  42. .gitattributes
  43. .gitignore
  44. codereview.settings
  45. DEPS
  46. launch.md
  47. LICENSE
  48. Makefile
  49. PRESUBMIT.py
  50. README.md
  51. run_unittests
  52. run_unittests.go
  53. whitespace.txt
  54. whitespace2.txt
README.md

Skia-Buildbot Repository

This repo contains infrastructure code for Skia.

Getting the Source Code

The main source code repository is a Git repository hosted at https://skia.googlesource.com/buildbot. Although it is possible to check out this repository directly with git clone or using gclient fetch, it is preferred to use go get so that the code is arranged correctly for Go. If this is your first time working on Go code, read about the GOPATH environment variable. Make sure that $GOPATH/bin comes before /usr/bin in your PATH. If you have GOPATH set, run:

$ go get -u go.skia.org/infra/...
$ cd $GOPATH/src/go.skia.org/infra/

This fetches the repository into your $GOPATH directory along with all the Go dependencies. Note: go.skia.org is a custom import path and will only work if used like the examples here.

Install depot_tools. You can learn more about using depot_tools from the tutorial. Then run:

$ cd ..
$ gclient config --name infra --unmanaged https://skia.googlesource.com/buildbot
$ gclient sync

This fetches additional dependencies specified by the DEPS file.

Database Setup for Testing

Tests which use the database package's testutils require you to have a MySQL instance running with a database named “sk_testing” and users called “readwrite” and “test_root” with appropriate permissions for sk_testing. The ‘setup_test_db’ script in ‘go/database’ is included for convenience in setting up this test database and user.

Go tests require a local installation of MySQL. For a Debian based distro:

$ sudo apt-get install mysql-client mysql-server

Leave the root password blank.

Then, to set up local versions of the production databases:

$ cd $GOPATH/src/go.skia.org/infra/go/database
$ ./setup_test_db

Running unit tests

Install Cloud SDK.

Install other dependencies:

$ sudo apt-get install npm nodejs-legacy python-django redis-server
$ go get github.com/kisielk/errcheck
$ go get golang.org/x/tools/cmd/goimports
$ sudo npm install -g polylint bower

Build from GOPATH:

$ cd $GOPATH/src/go.skia.org/infra/
$ make all

Use this command to run the presubmit tests:

$ ./run_unittests --short