722 Commits (528ed22dc2dd4f4e54f0a8cb5ca6fea7b9ff0962)

Author	SHA1	Message	Date
Joao Marcal	cb8a7440d4	ksonnet/loki: Add gRPC port to compactor mixin (#8855) ... **What this PR does / why we need it**: Problem: in https://github.com/grafana/loki/pull/7804 the possibility to use gRPC for communicating with the compactor for query time filtering of data requested for deletion was added, however, the Loki mixin still generates the compactor service without a gRPC port. Solution: make the compactor service/deployment expose both an HTTP and gRPC port. Signed-off-by: JoaoBraveCoding <jmarcal@redhat.com>	2 years ago
Danny Kopping	a7ff0fd70e	Removing backend target from SSD docker setup (#8836) ... **What this PR does / why we need it**: The `backend` target is only present in v2.8.	2 years ago
Trevor Whitney	a4d06acca7	Add yaml linting step to helm ci (#8822) ... **What this PR does / why we need it**: Adds a yaml linting step for the included rules in the loki helm chart. Only way I could think to enforce the comma line ending was to require qutoes around string, otherwise the linter cannot tell if the comma is just part of the string.	2 years ago
Hervé Nicol	9688f83954	helm chart: fix role/PSP mapping (#8656) ... **What this PR does / why we need it**: Fixes role/PSP and role/SCC mapping in Helm chart. **Which issue(s) this PR fixes**: Fixes #8652 **Special notes for your reviewer**: **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Co-authored-by: Herve Nicol <12008875+hervenicol@users.noreply.github.com>	2 years ago
Danny Kopping	33e44ed39d	Ruler: remote rule evaluation (#8744) ... **What this PR does / why we need it**: Adds the ability to evaluate recording & alerting rules against a given `query-frontend`, allowing these queries to be executed with all the parallelisation & optimisation that regular adhoc queries have. This is important because with `local` evaluation all queries are single-threaded, and rules that evaluate a large range/volume of data may timeout or OOM the `ruler` itself, leading to missed metrics or alerts. When `remote` evaluation mode is enabled, the `ruler` effectively just becomes a gRPC client for the `query-frontend`, which will dramatically improve the reliability of the `ruler` and also drastically reduce its resource requirements. **Which issue(s) this PR fixes**: This PR implements the feature discussed in https://github.com/grafana/loki/pull/8129 (**LID 0002: Remote Rule Evaluation**).	2 years ago
Michel Hollands	10e3d80731	Fix distributor latency panel (#8760) ... **What this PR does / why we need it**: https://github.com/grafana/loki/pull/8247 changes a metric generated by a recording rule. This fixes the "Distributor Panel" to use this different metric. Tested by changing the "Distributor Panel" manually to see it showed results. **Checklist** - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` --------- Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	2 years ago
Michel Hollands	15fda6bf39	Change severity of PromtailFileMissing alert to warning (#8757) ... The PromtailFileMissing alert is not critical. This changes it to a warning. Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	2 years ago
Michel Hollands	1c4dd6ad40	Use changed metric in operational dashboard (#8749) ... **What this PR does / why we need it**: The metric `job_route` was changed to `cluster_job_route` in https://github.com/grafana/loki/pull/8247. This PR updates this metric in the operational dashboard. **Checklist** - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` --------- Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	2 years ago
Dylan Guedes	ea6abbfd07	Loki-Mixin: Remove query-readiness panel (#8735) ... **What this PR does / why we need it**: Remove from loki-mixin the panel that shows the query_readiness metric. The metric was removed a while ago.	2 years ago
Grot (@grafanabot)	215f37cfa3	[CI/CD] Update yaml file `./production/helm/loki/values.yaml` (+1 other) (#8655) ... **Here is a summary of the updates contained in this PR:** *** Update attribute `$.enterprise.version` in yaml file `./production/helm/loki/values.yaml` to the following value: `v1.6.2` *** Bump version of Helm Chart Add changelog entry to `./production/helm/loki/CHANGELOG.md` Re-generate docs Co-authored-by: Dylan Guedes <djmgguedes@gmail.com>	2 years ago
Trevor Whitney	dac3b84d08	Loki cloud integration instructions (and necessary mixin changes) (#8492) ... **What this PR does / why we need it**: This PR is a first stab at documentation for setting up the Grafana Cloud Loki Integration to monitor a local Loki cluster, installed using the helm chart, using Grafana Cloud. In addition to instructions on how to collect the necessary kubernetes metrics, there were also some things with the Loki mixin (which provides dashboards, alerts, and rules to the integration) that needed to be fixed. For example, our dashboards rely on there being a cluster label on our recording rules, yet our mixin does not include this? Also, we are still including `cortex-gw` panels even when the mixin is compile with `internal_components: false`. **Special notes for your reviewer**: The changes to the mixin will not be reflected in the current version of the integration. We need to merge this PR first then update the integration. **Checklist** - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` --------- Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
Susana Ferreira	9f8aa4b98a	Helm: fix enterprise-logs license secret name (#8498) ... **What this PR does / why we need it**: Rename `gel-license.jwt` property of secret `gel-secrets` to `license.jwt` on enterprise-logs chart to make it consistent betwen `gel-secrets` and `gel-license` kubectl secrets. * Fix the `stringData` property of the GEL secret, to contain `license.jwt` property when importing: * `gel-secrets`: containing both the `gcp_service_account.json` and `license.jwt` properties 6ece17a82f/production/helm/loki/docs/examples/enterprise/enterprise-secrets.yaml (L1-L12) * `gel-license`: containing only the `license.jwt` property 6a7403c4f5/tools/dev/k3d/environments/helm-cluster/main.jsonnet (L213-L217) * Minor fixes in the README documentation. **Special notes for your reviewer**: **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Susana Ferreira	141ee25c0e	Helm: update changelog CI comment (#8603) ... **What this PR does / why we need it**: Update the helm changelog CI comment to clarify that the pipeline is only used for new Loki releases. Related to PR: https://github.com/grafana/loki/pull/8323 **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Susana Ferreira	2a3874b240	Helm: update changelog with changes from PR #8467 (#8601) ... **What this PR does / why we need it**: Update changelog with changes from PR #8467 and bump helm chart version to 4.6.2 **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Zach Watson	d59792ffa3	production: Add missing string formatter token to nginx.conf config map (#8580) ... The `nginx.conf` config map server settings has a `proxy_set_header` line setting the X-Scope-OrgID using the gateway tenant ID. The Jsonnet string formatter is missing the `s` token. This PR adds the missing formatter token to the `nginx.conf` config map that's causing an `Unrecognized conversion type: ;` when trying to deploy. Fixes a bug introduced in #7624	2 years ago
Susana Ferreira	b8118b1e7b	Helm enterprise-logs: update kubernetes secrets creation (#8467) ... **What this PR does / why we need it**: Fix the Kubernetes secrets creation for the tokengen and provisioner jobs for multiple helm installations/uninstallations. The execution flow for the helm installation is the following: 1) `tokengen` job `loki` container generates a new admin token, stores it in the object storage and writes it to the `shared` mount. 2) `tokengen` job `create-secret` container creates a new Kubernetes secret for the generated admin token. 3) `provisioner` job `provisioner` container creates the new admin resources via the Admin API and writes the tokens to the `bootstrap` mount. 4) `provisioner` job `create-secret` container creates new Kubernetes secrets for each token of the additional tenants. ## Previous implementation Uninstall and re-install the enterprise-logs helm: 1) `tokengen` job `loki` container generates a new admin token, stores it in the object storage, and writes it to the `shared` mount. This is because this job uses an [emptyDir](https://kubernetes.io/docs/concepts/storage/volumes/#emptydir) mount which is deleted once the job completes. When a new job is created, the directory will be again empty, forcing the `tokengen` to generate a new token. 2) `tokengen` job `create-secret` container fails, because an admin token secret already exists: ``` Defaulted container "create-secret" out of: create-secret, loki (init) error: failed to create secret secrets "enterprise-logs-admin-token" already exists ``` 3) The helm installation fails ❌ ## Implementation in this PR 1) `tokengen` job `loki` container generates a new admin token, stores it in the object storage, and writes it to the `shared` mount. 2) `tokengen` job `create-secret` container updates the previously created Kubernetes secret for the admin token. 3) `provisioner` job `provisioner` container checks that the admin resources already exist and doesn't write the token files to the `bootstrap` mount. 4) `provisioner` job `create-secret` container checks that the token files are not present on the `bootstrap` mount, and does not create new secrets. 5) The helm installation succeeds ✅ **Special notes for your reviewer**: **Checklist** - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Michel Hollands	4f8d3240f6	Use 0.28.1 build image and update go and alpine versions (#8583) ... **What this PR does / why we need it**: - Use the 0.28.1 build image - Update Go version to 1.20.1 - Use Alpine 3.16.4 - Fix linter issues due to updated govet in 1.20.1 - Modify images to not create `/etc/nsswitch.conf` file anymore (available by default on Alpine 3.16.4) - Remove impossible test cases for `TestMemChunk_IteratorBounds`(see https://github.com/grafana/loki/pull/8591#discussion_r1115020111 for context) Signed-off-by: Michel Hollands <michel.hollands@grafana.com> Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: DylanGuedes <djmgguedes@gmail.com>	2 years ago
a5r0n	0f0553ff1c	helm: make multi tenant easy: use tenant id from nginx $remote_user (#8404) ... Fixes #8380 Co-authored-by: a5r0n <a5r0n@users.noreply.github.com>	2 years ago
bcirh	0394b56368	Fix missing braces for service stanza (#8510)	2 years ago
Christian Haudum	d960ee70c6	Helm: Remove unreleased setting from Helm chart configuration file (#8515) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Hervé Nicol	b04ad2e409	helm: azure config: don't set use_federated_token if false (#8513)	2 years ago
Hervé Nicol	f4119de4df	helm: values to override read/write/backend paths in gateway config (#8490) ... **What this PR does / why we need it**: Add configurations to override the generated read/write/backend URLs for the gateway. **Which issue(s) this PR fixes**: Fixes #8488	2 years ago
Tazmaniac	db423a31fa	[helm] Fix read-only /tmp in 3 targets mode (#8477)	2 years ago
Trevor Whitney	e6fb32b214	[helm] Bump to Loki 2.7.3 (#8445)	2 years ago
Trevor Whitney	50af51bb36	[helm] set compactor address (#8427)	2 years ago
Jan-Otto Kröpke	3c7a91b6f1	[Helm] Allow to configure publishNotReadyAddresses on memberlist service (#8446) ... Signed-off-by: Jan-Otto Kröpke <jok@cloudeteer.de>	2 years ago
Jim Gustavsson	99b4f475c4	Helm: Add podlabels to backend (#8398) ... Co-authored-by: Travis Patterson <travis.patterson@grafana.com>	2 years ago
Trevor Whitney	8ed5dd84ae	Fix namespace rendering in provisioner job (#8449)	2 years ago
Callum Styan	ff72e70925	[jsonnet] fix import ordering in loki.libsonnet (#8442) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	2 years ago
Trevor Whitney	ef8b382c06	[helm] Single binary object storage (#8284) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
Callum Styan	4d55a24ed3	Upstream additional multi-zone ingester jsonnet (#8360) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	2 years ago
Charlie N	340f62ac7a	[Mixin] Update clusterlabel usage (#8247) ... Signed-off-by: Whyeasy <Whyeasy@users.noreply.github.com>	2 years ago
Hamish Forbes	027c2ef957	Jsonnet: Allows gateway tenant ID to be configured (#7624) ... Co-authored-by: Karsten Jeschkies <karsten.jeschkies@grafana.com>	2 years ago
Michel Hollands	bd23b2b46c	Add table of Loki versions in helm chart (#8383)	2 years ago
Christian Haudum	a62318ef19	Reflect release 2.7.3 on main branch (#8372) ... Update * CHANGELOG * release notes * installation docs * version references in production/ folder	2 years ago
Karsten Jeschkies	8d43969d6b	Helm: Align ingress timeout and size limits. (#8352)	2 years ago
Trevor Whitney	772b494e59	fix dashboard helper to use regex (#8319)	2 years ago
manohar-koukuntla	37d65027fe	Zone aware ingesters (#7923)	2 years ago
Vladislav Diachenko	9f5402227a	Helm Chart release automation (step 1) (#8323)	2 years ago
Travis Patterson	653b807a92	update helm for GEL 1.6.1 (#8304)	2 years ago
Christian Haudum	5993640329	Reflect release 2.7.2 on main branch (#8299) ... To reflect current version in documentation and deployment files. * CHANGELOG and release notes for release 2.7.2 * Helm and jsonnet deployment files Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Trevor Whitney	cc39334391	[helm] Fix helm dashboards (#8261) ... Fix the dashboards shipped with the helm chart. Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz> Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
Mathieu Parent	be115e98ee	Helm: ensure valid label values when version has digest (#8260)	2 years ago
nervo	d6a60b4a9f	Helm: Default grafana dashboard label (#8188)	2 years ago
nervo	1945166363	Helm: Generalize enableStatefulSetAutoDeletePVC (#8193)	2 years ago
Robby Milo	4047d7a9c8	enable responsive table (#7890) ... Signed-off-by: Jack Baldry <jack.baldry@grafana.com> Co-authored-by: Jack Baldry <jack.baldry@grafana.com>	2 years ago
Felix Eichenberger	7cdb156424	Helm: Add selector to backend's volumeClaimTemplates (#8235)	2 years ago
J Stickler	6a473a8407	[Docs] Adding context to Istio installation. (#8248)	2 years ago
gyrofx	ee31c24044	Helm: Add initContainers to write, backend, singleBinary templates (#8236)	2 years ago
Teruya Ono	3e5fb36f30	Docker compose: Update loki and promtail version tags to 2.7.1 (#8230) ... **What this PR does / why we need it**: Updated loki and promtail version tags to the latest. **Which issue(s) this PR fixes**: **Special notes for your reviewer**: **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago