Like Prometheus, but for logs.

prometheus hacktoberfest grafana cloudnative logging loki

History

Christian Haudum b91b782907 fix(cloud-mixin): Attribute OTLP route correctly to write path (#13943 ) The route `/otlp/v1/logs` is the OTLP endpoint for pushing logs, but it was attributed to the read path dashboard. This commit moves the route from the reads dashboard to the writes dashboard. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>		9 months ago
..
dashboards	fix(cloud-mixin): Attribute OTLP route correctly to write path (#13943 )	9 months ago
.gitignore	Loki mixin: publish compiled version of the mixin (#6254 )	3 years ago
.lint	chore: Add dashboards for Bloom Compactor and Gateway (#12855 )	1 year ago
README.md	Add README file to loki-mixin (#6083 )	3 years ago
alerts.libsonnet	fix: mixin generation when cluster label is changed (#12613 )	1 year ago
config.libsonnet	chore: make mixin range interval configurable (#13925 )	9 months ago
dashboards.libsonnet	chore: Add dashboards for Bloom Compactor and Gateway (#12855 )	1 year ago
jsonnetfile.json	Import Canary dashboard into Loki mixin. (#7304 )	3 years ago
jsonnetfile.lock.json	chore: make mixin range interval configurable (#13925 )	9 months ago
mixin-meta-monitoring.libsonnet	feat: Add a version of the mixin dashboards for meta monitoring (#12700 )	1 year ago
mixin-ssd.libsonnet	Loki cloud integration instructions (and necessary mixin changes) (#8492 )	2 years ago
mixin.libsonnet	Put loki-mixin and promtail-mixin dashboards in a folder.	5 years ago
recording_rules.libsonnet	chore: make mixin range interval configurable (#13925 )	9 months ago

README.md

loki-mixin

loki-mixin is a jsonnet library containing a set of Loki monitoring dashboards, alerts and rules collected based on our experience operating Loki in Grafana Cloud.

Dashboards

To test the dashboards against a local grafana & Loki setup perform the following steps.

Pre-requisites

jb is a jsonnet package manager To install it follow the instructions at: https://github.com/jsonnet-bundler/jsonnet-bundler.
Grizzly is a tool for managing jsonnet dashboards in Grafana: https://github.com/grafana/grizzly. To install it follow the instructions at: https://grafana.github.io/grizzly/installation/.
Make sure you have the latest dependencies in the vendor directory by running the following command in production/loki-mixin:

jb install

On your Grafana instance create an API key with role 'Admin' under Configuration > API keys. Copy this key for the next step.

Testing dashboards

To test the dashboard in your local grafana instance, in directory production/loki-mixin run the command:

GRAFANA_URL=http://localhost:3000 GRAFANA_TOKEN=<API_KEY> JSONNET_PATH=$(pwd)/lib:$(pwd)/vendor grr watch ./ dashboards.libsonnet

grr watch will detect changes when you save files and try to add/update dashboards:

INFO[0000] Watching for changes
INFO[0005] Changes detected. Applyingdashboards.libsonnet
INFO[0007] Applying 10 resources
Dashboard.reads-resources added
Dashboard.writes-resources added
Dashboard.reads updated
Dashboard.writes updated
...

Disclaimer: Since these dashboards are used on our own production setup, these contain very specific configurations to our cloud environment which may need to overridden for other setups and use-cases.