Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Ashwanth d9f3bf30b1 config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284) ... **What this PR does / why we need it**: Adds a new config `frontend.max-query-capacity` that allows users to configure what portion of the the available querier replicas can be used by a tenant. `max_query_capacity` is the corresponding YAML option that can be configured in limits or runtime overrides. For example, setting this to 0.5 would allow a tenant to use half of the available queriers. This complements the existing `frontend.max-queriers-per-tenant`. When both are configured, the smaller value of the resulting querier replica count is considered: ``` min(frontend.max-queriers-per-tenant, ceil(querier_replicas * frontend.max-query-capacity)) ``` *All* queriers will handle requests for a tenant if neither limits are applied. **Which issue(s) this PR fixes**: Fixes #<issue number> **Special notes for your reviewer**: noticed that we don't pass down the shuffle sharding limits for frontend (only using it with schedulers) 26f097162a/pkg/loki/modules.go (L895) but the [docs](26f097162a/pkg/validation/limits.go (L276)) mention that`frontend.max-queriers-per-tenant` applies to frontend as well. ``` This option only works with queriers connecting to the query-frontend / query-scheduler, not when using downstream URL. ``` **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [x] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated - [ ] If the change is worth mentioning in the release notes, add `add-to-release-notes` label - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/setup/upgrade/_index.md` - [ ] For Helm chart changes bump the Helm chart version in `production/helm/loki/Chart.yaml` and update `production/helm/loki/CHANGELOG.md` and `production/helm/loki/README.md`. [Example PR](d10549e3ec) - [ ] If the change is deprecating or removing a configuration option, update the `deprecated-config.yaml` and `deleted-config.yaml` files respectively in the `tools/deprecated-config-checker` directory. [Example PR](0d4416a4b0) --------- Co-authored-by: J Stickler <julie.stickler@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>		2 years ago
..
dequeue_qos_test.go	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
mapping.go	Introduce worker queue in bloom gateway (#10976)	2 years ago
mapping_test.go	Introduce worker queue in bloom gateway (#10976)	2 years ago
metrics.go	Use metrics namespace for more metrics (#11025)	2 years ago
queue.go	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
queue_test.go	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
tenant_queues.go	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
tenant_queues_test.go	config: adds `frontend.max-query-capacity` to tune per-tenant query capacity (#11284)	2 years ago
treequeue.go	Introduce worker queue in bloom gateway (#10976)	2 years ago
treequeue_test.go	Introduce worker queue in bloom gateway (#10976)	2 years ago
util.go	Bloom Gateway: Implement chunk filtering using workers that multiplex requests (#11181)	2 years ago