Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Ashwanth d9f3bf30b1 config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284) ... **What this PR does / why we need it**: Adds a new config `frontend.max-query-capacity` that allows users to configure what portion of the the available querier replicas can be used by a tenant. `max_query_capacity` is the corresponding YAML option that can be configured in limits or runtime overrides. For example, setting this to 0.5 would allow a tenant to use half of the available queriers. This complements the existing `frontend.max-queriers-per-tenant`. When both are configured, the smaller value of the resulting querier replica count is considered: ``` min(frontend.max-queriers-per-tenant, ceil(querier_replicas * frontend.max-query-capacity)) ``` *All* queriers will handle requests for a tenant if neither limits are applied. **Which issue(s) this PR fixes**: Fixes #<issue number> **Special notes for your reviewer**: noticed that we don't pass down the shuffle sharding limits for frontend (only using it with schedulers) 26f097162a/pkg/loki/modules.go (L895) but the [docs](26f097162a/pkg/validation/limits.go (L276)) mention that`frontend.max-queriers-per-tenant` applies to frontend as well. ``` This option only works with queriers connecting to the query-frontend / query-scheduler, not when using downstream URL. ``` **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [x] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated - [ ] If the change is worth mentioning in the release notes, add `add-to-release-notes` label - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/setup/upgrade/_index.md` - [ ] For Helm chart changes bump the Helm chart version in `production/helm/loki/Chart.yaml` and update `production/helm/loki/CHANGELOG.md` and `production/helm/loki/README.md`. [Example PR](d10549e3ec) - [ ] If the change is deprecating or removing a configuration option, update the `deprecated-config.yaml` and `deleted-config.yaml` files respectively in the `tools/deprecated-config-checker` directory. [Example PR](0d4416a4b0) --------- Co-authored-by: J Stickler <julie.stickler@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>		2 years ago
..
analytics	Update nix configuration (#8452)	2 years ago
bloomcompactor	Compact multiple series into a bloom block (#11295)	2 years ago
bloomgateway	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
canary	clients,pkg: use http.NewRequestWithContext (#10616)	2 years ago
chunkenc	Update nix configuration (#8452)	2 years ago
compactor	do not run retention loop when retention is not enabled (#11280)	2 years ago
configs	Upgrade dskit to use packages migrated from weaveworks/common (#10164)	2 years ago
distributor	Update nix configuration (#8452)	2 years ago
ingester	Stop using global logger in modules (#11051)	2 years ago
iter	Update nix configuration (#8452)	2 years ago
logcli	Send query plan to querier. (#11246)	2 years ago
loghttp	Use newest build image 0.31.2 with golangci-lint update. (#11118)	2 years ago
logproto	Send query plan to querier. (#11246)	2 years ago
logql	Fix `or` filter not being stringified correctly (#11337)	2 years ago
logqlanalyzer	fixed logql-analyzer (#8258)	2 years ago
logqlmodel	bug(volume): return 400 error for invalid volume request (#11313)	2 years ago
loki	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
lokifrontend	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
push	fix(deps): update module google.golang.org/grpc [security] (main) (#11031)	2 years ago
querier	Remove obsolete empty test in middleware. (#11304)	2 years ago
queue	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
ruler	Send query plan to querier. (#11246)	2 years ago
runtime	Loki: Implement initial phase of `limited_log_push_errors` (#9556)	2 years ago
scheduler	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
server	Upgrade dskit to use packages migrated from weaveworks/common (#10164)	2 years ago
sizing	fix xss vulnerability (#10559)	2 years ago
storage	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
tracing	Promtail: Add basic tracing support (#7414)	3 years ago
util	Categorized Labels: Return empty JSON object if no parsed nor structured metadata labels (#11325)	2 years ago
validation	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago