830 Commits (b2ea1214fcce6934c02d4301773777a6ff746f6d)

Author	SHA1	Message	Date
Kaviraj Kanagaraj	807aa459d4	logql: Support `urlencode` and `urldecode` template functions (#8271) ... Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	2 years ago
nicoche	80ea621ff3	promtail: Add `max-line-size-truncate` (#8233)	2 years ago
Daniel Plakinger	ea96fa62a3	Corrected typo (#8237)	2 years ago
nervo	d6a60b4a9f	Helm: Default grafana dashboard label (#8188)	2 years ago
nervo	1945166363	Helm: Generalize enableStatefulSetAutoDeletePVC (#8193)	2 years ago
Travis Patterson	4b9cc39f9f	fix remaining docs issues (#8263)	2 years ago
Robby Milo	4047d7a9c8	enable responsive table (#7890) ... Signed-off-by: Jack Baldry <jack.baldry@grafana.com> Co-authored-by: Jack Baldry <jack.baldry@grafana.com>	2 years ago
Owen Diehl	8d3c50f40d	tsdb docs first pass (#8048) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
J Stickler	6a473a8407	[Docs] Adding context to Istio installation. (#8248)	2 years ago
gyrofx	ee31c24044	Helm: Add initContainers to write, backend, singleBinary templates (#8236)	2 years ago
Danny Kopping	d0fd4e8ad1	Do not exit when using `stream_lag_labels` setting (#8243)	2 years ago
Travis Patterson	1c954166b8	Fix documentation linter errors (#8229)	2 years ago
Jijo Thomas John	54f09b89fd	[loki-canary] Support passing loki address as environment variable (#8205)	2 years ago
Susana Ferreira	7fc25743eb	Docs fix: add missing sections on index.template file (#8216) ... **What this PR does / why we need it**: PR https://github.com/grafana/loki/pull/7916 which introduced the documentation automation tool for Loki's configuration values, incorrectly removed the last sections of the documentation. This PR introduces them accordingly. **Checklist** - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [x] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Travis Patterson	636e19dfeb	place canary docs in their own package and fix links+description (#8217) ... There is a PR blocked on incorrect canary docs: https://github.com/grafana/loki/pull/8205 This PR should clear that CI error so the author can rebase and have the PR accepted This was failing three lint checks: 1. Docs need a `description` header 2. Images have to link to the same directory so `./` instead of `../` 3. Images can only be linked from `_index.md` files so a new package is required	2 years ago
Jack Baldry	a6047e9770	Remove template alias from Helm chart reference (#8213) ... With its inclusion, the page tries to redirect https://grafana.com/docs/writers-toolkit/latest/templates/reference-template/ to https://grafana.com/docs/loki/latest/installation/helm/reference/ Signed-off-by: Jack Baldry <jack.baldry@grafana.com> Signed-off-by: Jack Baldry <jack.baldry@grafana.com>	2 years ago
Yash Soni	c648968866	updating troubleshooting and upgrade changelog (#8206) ... **What this PR does / why we need it**: Updating docs which mentions `querier.query_timeout` to `limits_request.query_timeout` **Which issue(s) this PR fixes**: Fixes #8090 **Special notes for your reviewer**: **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [x] Documentation added - [ ] Tests updated - [x] `CHANGELOG.md` updated - [x] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Danny Kopping	fd3d362e0c	Removing duplicated limits file and refactored references (#8210)	2 years ago
Jack Baldry	3cb15d62d5	Docs: Add doc-validator tool to lint technical documentation (#6569) ... Source code: https://github.com/grafana/technical-documentation/tree/main/tools/doc-validator Signed-off-by: Jack Baldry <jack.baldry@grafana.com> **What this PR does / why we need it**: Adds a CI step for pull requests that validates links in technical documentation and performs linting of technical documentation source files. **Special notes for your reviewer**: - Lots of issues will need to be fixed before we can merge this. - The tool is still in early development so each error should be scrutinized for validity. **Checklist** - [ ] Documentation added - [na] Tests updated - [na] Is this an important fix or new feature? Add an entry in the `CHANGELOG.md`. - [na] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Signed-off-by: Jack Baldry <jack.baldry@grafana.com>	2 years ago
Kaviraj Kanagaraj	86461b3faa	promtail: Add doc for `max-line-size` flag. (#8202) ... Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> **What this PR does / why we need it**: Follow up from #8153 Changes: * Change type of the flag from `int` to `flagext.ByteSize` (to be consistent with similar flag in `distributor`) * Add doc to promtail config page * Fix changelog entries **Which issue(s) this PR fixes**: Fixes #NA **Special notes for your reviewer**: **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [x] Documentation added - [x] `CHANGELOG.md` updated Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	2 years ago
Kaviraj Kanagaraj	959e275b4f	promtail: Fix title and image path on `logrotation` doc (#8208) ... Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> **What this PR does / why we need it**: This fixes 1. Missing UI link to the side panel 2. Image paths   **Which issue(s) this PR fixes**: Fixes #NA **Special notes for your reviewer**: **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [x] Documentation added Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	2 years ago
nervo	7aa596752d	Helm - Loki: Introduce runtimeConfig (#8179)	2 years ago
Christian Haudum	d97aaca089	[docs] Clarify for what version the Helm chart docs are applicable (#8172) ... **What this PR does / why we need it**: The docs and reference of the Helm chart in the documentation is only applicable for the Loki Helm chart `>= 3.0` and therefore does not apply to the `grafana/loki-stack` chart, which depends on the Loki Helm chart `^2.15.2` ([requirements.yaml](https://github.com/grafana/helm-charts/blob/main/charts/loki-stack/requirements.yaml#L5)). Also added a headline to the "Install Loki using Helm" index page, because it looks awkward without, see screenshot.  **Which issue(s) this PR fixes**: Fixes: #8152 Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Prabuddha Chakraborty	20627ad000	Helm: Add ingester config in helm values (#7733) ... **What this PR does / why we need it**: Allow configuring ingester config from helm values: https://grafana.com/docs/loki/latest/configuration/#ingester We wanted to change the default chunk_encoding, which right now not possible in the current values template. Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	2 years ago
TAY TS	94ee5a2930	Helm chart: Add enableServiceLinks (#7129) ... **What this PR does / why we need it**: This is to allow disable `enableServiceLinks` so that the service environments are not injected into the pods where in my scenario Loki is deployed in the same namespace as the Knative services resulted the Loki pod unable to start up due to too many service environment being injected. Reference issue for pod unable to startup due to too many services: https://github.com/kubernetes/kubernetes/issues/84539#issue-514261281 Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	2 years ago
Owen Diehl	a7ea9c1422	Revert "fix(logql): remove __error_details__ label on drop __error__ or other way around" (#8200) ... Reverts grafana/loki#8150 I was talking with @adityacs about reverting this PR and found the following: Looking at why tests don’t keep `__error_details__` when `__error__` is dropped and I found this line of code: ```go // LabelsResult returns the LabelsResult from the builder. // No grouping is applied and the cache is used when possible. func (b *LabelsBuilder) LabelsResult() LabelsResult { // unchanged path. if len(b.del) == 0 && len(b.add) == 0 && b.err == "" { return b.currentResult } return b.toResult(b.labels()) }``` https://github.com/grafana/loki/blob/main/pkg/logql/log/labels.go#L314 We only add err details when err isn’t empty anyway, so I guess we’ll revert for simplicity but just keep the same functionality	2 years ago
Kaviraj Kanagaraj	5031ae1b4e	doc(promtail): Doc about how log rotate works with promtail. (#8096) ... Changes 1. Why log rotation matters? 2. Different components involving in reading, writing and rotating logs 3. Different types of log rotation. 4. How to configure log rotation effectively to work with promtail Fixes # Should resolve all confusions around log rotation errors with promtail Related: #7967 Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	2 years ago
openbob	af93f4a11e	Helm: Add Table Manager support to Loki helm chart (#8098) ... The Table Manager is a Loki component which takes care of creating a periodic table before its time period begins, and deleting it once its data time range exceeds the retention period. This PR is to add Table Manager support to the loki helm chart deployment as the current chart is based on the deprecated loki-simple-scalable chart that did not support Table Manager. Fixes #<6830>	2 years ago
Herman	9a516ce813	[docs] fix dead link in the docker client documentation (#8196) ... **What this PR does / why we need it**: Just fixes a dead link in the docker client docs.	2 years ago
Aditya C S	cf23194d05	fix(logql): remove __error_details__ label on drop __error__ or other way around (#8150)	2 years ago
Karsten Jeschkies	f24da4a194	Display replicas, cores and nodes in sizing tool. (#8088) ... **What this PR does / why we need it**: No every users wants to deploy Loki with Helm. That's why we are going to display the required replicas as well.  This change also fixes two bugs in the algorithm and introduces some tests for its invariant. **Checklist** - [ ] Reviewed the `CONTRIBUTING.md` guide - [x] Documentation added - [x] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Signed-off-by: Ashwanth Goli <iamashwanth@gmail.com> Co-authored-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: liam-howe-maersk <118169897+liam-howe-maersk@users.noreply.github.com> Co-authored-by: JordanRushing <rushing.jordan@gmail.com> Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com> Co-authored-by: Periklis Tsirakidis <periklis@redhat.com> Co-authored-by: Ashwanth Goli <iamashwanth@gmail.com>	2 years ago
Trevor Whitney	eb39e2645f	[helm] allow provisioned tokens to be created in different namespaces (#8081) ... **What this PR does / why we need it**: _Note_: This PR bumps the chart to 4.0, so it includes a few other breaking changes we've been waiting to make. The new helm chart has a few different ways to create tokens when running in enterprise mode: * The tokengen job creates the initial admin token * The provisioner job creates the self-monitoring tenant if enabled * The provisioner job can also create additional tenants if configured The problem with these jobs is they put the generated read/write tokens for these tenants in secrets in the same namespace as the loki deploiyment. This is problematic if you need these tokens for a specific application, for example a Grafana datasource, that is deployed in a separate namespace. This PR introduces two breaking changes, one of which is breaking as it significantly changes how both the self monitoring and additional tenants are configured. First it adds the value `enterprise.adminToken.additionalNamespaces` and moves `enterprise.adminTokenSecret` to `enterprise.adminToken.secret`. If `additionalNamespaces` are included, additional secrets containing the GEL admin token are created in those namespaces as well as the release namespace. Second, it changes the structure of defining a tenant from just a string name, to an object containing a `name` and `secretNamespace` field. The `secretNamespace` is the namespace the secret containing that tenants token(s) will be placed in. In the case of the self-monitoring token, a secret will still be created in the default namespace in addition to the `secretNamespace` specified as that token is required by multiple components.	2 years ago
JordanRushing	d8a0c6f87f	Revert "[loki-canary] Support passing loki address as environment variable (#8024)" (#8183) ... **What this PR does / why we need it**: This PR reverts commit f9ed9cb7d9 which introduced breaking config changes for the Loki canary. The relevant change introduced support for configuring a new `LOKI_ADDRESS` canary environment variable by adopting a new library for flags. This is the easiest path forward to avoid forcing breaking config changes on canary operators; such a change is likely better suited to join other configuration changes in a future major Loki release. **Which issue(s) this PR fixes**: N/A **Special notes for your reviewer**: Related PR: - https://github.com/grafana/loki/pull/8024 **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Danny Kopping	4e16ea6b4d	Minor LID fixes (#8167) ... Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	2 years ago
Kaviraj Kanagaraj	9b5fa5e100	doc(distributor): Clarify `distributor.max-line-size` flag. (#8165) ... **What this PR does / why we need it**: Add a clarrification of two flags `distributor.max-line-size` and `distributor.max-line-size-truncate`. And clarity on [discarding the logs](https://github.com/grafana/loki/blob/main/pkg/distributor/validator.go#L84-L92) if later is disabled while still former is set to non-zero values. Whereas if `distributor.max-line-size-truncate` is set, [log line is only truncated.](https://github.com/grafana/loki/blob/main/pkg/distributor/distributor.go#L517-L534) Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> **Which issue(s) this PR fixes**: Fixes #NA **Special notes for your reviewer**: Figured while working on PR #8153 **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [x] Documentation added Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	2 years ago
Travis Patterson	5e53303cb8	run 'make doc' and commit the changes (#8142)	2 years ago
Ludovic Cleroux	6e3b62bf3e	Documentation: Add installation instructions for Istio (#4812) ... **What this PR does / why we need it**: Because there is very little information on how to install loki in the istio service mesh, and I spent a good deal of time figuring it out. Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	2 years ago
Nils	e4fbd3c949	Loki: Add support for Azure Workload Identity authentication (#7540)	2 years ago
Marcus Teixeira	78c2063e0b	Docs: fix helm ssd typo (#7959) ... Fix docs about helm ssd installation. Co-authored-by: Travis Patterson <travis.patterson@grafana.com>	2 years ago
Danny Kopping	37c1ec442f	Correct template and LID (#8128) ... The extra colon causes a YAML parsing failure, see https://github.com/grafana/loki/actions/runs/3905966435/jobs/6678935989 Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	2 years ago
Aditya C S	8df5803d9a	feat(logql): Support drop labels in logql pipeline (#7975) ... This PR introduces `drop` stage in logql pipeline. Fixes #7870, Fixes #7368	2 years ago
Danny Kopping	2c0cc01fa1	Minor fixups to LIDs (#8124) ... Including spelling my own surname right! 🙈 Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	2 years ago
Danny Kopping	9cab63d921	Loki Improvement Documents (LIDs) (#8056) ... **What this PR does / why we need it**: This PR adds a _Loki Improvement Document_ process to engage contributors and the community on major changes to Loki, _before_ large amounts of work is done. The aim here is to have a **lightweight documented history of our decisions** which the community can view in perpetuity. Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	2 years ago
Karsten Jeschkies	907450c9c3	Enhance sizing tool documentation. (#8079)	2 years ago
Jan-Otto Kröpke	59030db186	Add toggle for persistence disk in single-binary mode (#7778)	2 years ago
HTErik	4108aedeea	Promtail Docs: Clarifiy labels and timestamps set by cri stage (#7521) ... Add description that `cri` stage not only adds labels for timestamp, but that it also sets the timestamp of the log-entry before sending it. Honestly I don't know if this is the intention or not, but this is how things are implemented today and it makes the most sense. Even if not, changing the behavior now would not be possible without breaking old implicit assumptions, so better have more explicit documentation. Also clarify that the cri-`flags` get extracted as a label.	2 years ago
Jennifer Villa	fb1ebcb01b	Fixed a typo and made a small edit to the Helm monolithic setup doc. (#8109) ... Its storage type, not filesystem type. Also "before you begin" seemed a bit vague given the list below, so I added that the list below was software requirements.	2 years ago
Trevor Whitney	712bfdd0e0	[helm] add third scalable target `backend` (#7920) ... **What this PR does / why we need it**: Adds the new 3rd scalable deployment mode target (backend) to the helm chart. This new target was added in #7650	2 years ago
chriskuchin	4d5678aa17	lambda-promtail: Add support for VPC flow Logs to lambda-promtail (#7868) ... This add support to the S3 parsing logic for AWS VPC Flow logs. It also makes a small change to allow not printing log lines during processing. It leaves the default of printing the log lines in place. Signed-off-by: Thomas Belian <thomas.belian@bt909.de> Co-authored-by: Thomas Belián <72987757+bt909@users.noreply.github.com>	2 years ago
Chris Hodges	eb6ba615f4	Promtail: Add configuration to drop batches when rate limited by Loki (#7973) ... This change will allow for more deterministic behavior by multitenant Promtail instances where one or more tenants are being heavily throttled due to limits exceeded within Loki. Specifically, it will reduce the performance impact of having exponential backoff cause HOL blocking for rate limit response codes while other tenants are ready to send batches. Co-authored-by: chodges15 <chris.hodges@gmail.org>	2 years ago