mirror of
https://github.com/hanzoai/traces.git
synced 2026-10-30 18:20:41 +00:00
Suraj NathandGitHub
d33988d350
* mixin: add alerts for backend scheduler and worker targets * render mixin * add basic playbook * fix format * revert dashboard changes * tweak thresholds * round the floats to two digits
1.8 KiB
1.8 KiB
tempo-mixin
Once installed via the build instructions below, dashboards, rules, and alerts are located in the
operations/tempo-mixins-compiled folder. Use them directly in
Prometheus and Grafana to monitor Tempo.
You can either use the mixins in the tempo-mixin-compiled folder or you can build your own to
incorporate your own changes.
Build
To regenerate dashboards, rule and alerts, run make all.
This requires jsonnet and jsonnet-bundler to be installed.
On macOS, you can install these with the following commands:
brew install jsonnet
brew install jsonnet-bundler
go install github.com/jsonnet-bundler/jsonnet-bundler/cmd/[email protected]
Use the mixins
Once you run make all, the mixins are created in the tempo-mixin-compiled folder.
➜ make all git:(main|)
jb install
jsonnet -J vendor -S dashboards.jsonnet -m ../tempo-mixin-compiled/dashboards/
../tempo-mixin-compiled/dashboards/tempo-operational.json
../tempo-mixin-compiled/dashboards/tempo-reads.json
../tempo-mixin-compiled/dashboards/tempo-resources.json
../tempo-mixin-compiled/dashboards/tempo-rollout-progress.json
../tempo-mixin-compiled/dashboards/tempo-tenants.json
../tempo-mixin-compiled/dashboards/tempo-writes.json
jsonnet -J vendor -S alerts.jsonnet > ../tempo-mixin-compiled/alerts.yaml
jsonnet -J vendor -S rules.jsonnet > ../tempo-mixin-compiled/rules.yaml
Alerts and rules are listed in their matching files:
- Alerts ->
tempo-mixin-compiled/alerts.yaml - Rules -> 'tempo-mixin-compiled/rules.yaml`
For information on using the dashboards, refer to the mixin runbook.