3277 Commits (7193f540c221635316741db8bd1a7e5f0b51fa3a)

 

All Branches   

Search

Author	SHA1	Message	Date
Karsten Jeschkies	7193f540c2	Return bad request for multi-tenant tail. (#5792) ... Closes #5753	3 years ago
李国忠	49c331aa6d	fix boltdb-shipper doc (#5796)	3 years ago
Christian Simon	3d941ccccb	Update alpine images to 3.15.4 (#5780)	3 years ago
Michel Hollands	b865b81ba0	Add a DeletionMode config variable (#5481) ... * Add deletionEnabled setting and remove delete request manager Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Rebase Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove deletion handling from delete requests manager Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * change store so it stores a logql statement Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add validation code for logql statement Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Run deleteRequestsManager when deletion is enabled Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove unused variables Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Revert "Remove deletion handling from delete requests manager" This reverts commit ce4f774497aa590caff86b0745ec81588592a9e1. * Re-add IsDeleted method Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Re-add tests for IsDeleted Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix delete request store test Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix linting issue Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Revert compactor changes Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add deletion mode Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add v1 mode Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Rename LogQLRequest to Query Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix linting issues Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Use DeleteMode in compactor module Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Rename logql to query Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Put cancel under delete verb Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update documentation Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update changelog Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Revert only the API surface area while keeping everything else * Use moved code in syntax package Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove duplicte import Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Use renamed field in tests Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove duplicates and empty lines in changelog Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update changelog description Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update pkg/storage/stores/shipper/compactor/deletion/delete_request.go Co-authored-by: Christian Simon <simon@swine.de> * Update pkg/storage/stores/shipper/compactor/deletion/delete_requests_manager_test.go Co-authored-by: Christian Simon <simon@swine.de> * Update pkg/storage/stores/shipper/compactor/deletion/delete_requests_store.go Co-authored-by: Christian Simon <simon@swine.de> * Update pkg/storage/stores/shipper/compactor/deletion/delete_requests_store.go Co-authored-by: Christian Simon <simon@swine.de> * Update CHANGELOG.md Co-authored-by: Christian Simon <simon@swine.de> * Update pkg/storage/stores/shipper/compactor/deletion/delete_requests_store.go Co-authored-by: Christian Simon <simon@swine.de> * Make DeletionMode struct member non public Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Revert change to docs re cancellation Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Use same variable names Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add parameter validation to changelog Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Rename v1 to WholeStreamDeletion Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix default value of deletion mode config setting Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * reimplement new api * Add delete request handler when delete mode is set Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove unused variable Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add comment to change the code when other deletion modes are available Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * create expirationChecker if deletionMode is set Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Address review comments Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update pkg/storage/stores/shipper/compactor/compactor.go Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * Rename AddQuery to SetQuery Signed-off-by: Michel Hollands <michel.hollands@grafana.com> Co-authored-by: Travis Patterson <travis.patterson@grafana.com> Co-authored-by: Christian Simon <simon@swine.de> Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com>	3 years ago
Christian Haudum	ece1fb5a34	Allow promtail to push RFC5424 formatted syslog messages (#5715) ... * Allow promtail to push RFC5424 formatted syslog messages This PR introduces a new flag `use_rfc5424_message` for syslog scrape targets, which allows to push the full [RFC5424](https://datatracker.ietf.org/doc/html/rfc5424) formatted syslog message received by Promtail to be pushed to Loki, instead of only the message content. Storing the full message allows users to parse the message in Loki instead of relabelling in Promtail. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add changelog entry Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add test for pushing RFC5424 messages Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Allow promtail to push RFC5424 formatted syslog messages Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Christian Haudum	03036f1335	golangci-lint: Check for pointers to enclosing loop variables (#5775) ... * Checks for pointers to enclosing loop variables Using the pointer to the enclosing loop variable in a range loop likely leads to unwanted behaviour. Introducing the check `exportloopref` helps to prevent the usage of such pointers. > The iteration variables may be declared by the "range" clause using a > form of short variable declaration (:=). In this case their types are > set to the types of the respective iteration values and their scope is > the block of the "for" statement; they are re-used in each iteration. https://go.dev/ref/spec#For_statements Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Checks for pointers to enclosing loop variables Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Ed Welch	f313a9ff4f	Build: update package for fuzzer after refactoring (#5776) ... * Update the package name to reflect the moved package after refactoring Signed-off-by: Ed Welch <edward.welch@grafana.com> * also include makefile Signed-off-by: Ed Welch <edward.welch@grafana.com>	3 years ago
Ed Welch	e15a03b5e5	Loki: Add more details about usage reporting to the docs and default config files. (#5767) ... * Add more details to usage reporting including putting it in our default config files Signed-off-by: Ed Welch <edward.welch@grafana.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * update verbiage Signed-off-by: Ed Welch <edward.welch@grafana.com> * add newlines Signed-off-by: Ed Welch <edward.welch@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Ed Welch	c158b2c5f5	Loki: Revert #4845 which changed the format of errors from the API (#5772) ... * This reverts the changes from #4845, unfortunately changing the content type from plain text to JSON is a breaking change of the API and we should wait to do this at a major release. Signed-off-by: Ed Welch <edward.welch@grafana.com> * fix tests which were updated after initial change. Signed-off-by: Ed Welch <edward.welch@grafana.com>	3 years ago
Karen Miller	c860fc6442	Docs: Document Promtail global rate limiting (#5737) ... * Docs: Document Promtail global rate limiting * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Jennifer Villa <jvilla2013@gmail.com> * Revise strings that explain the new configuration parameters * For rate limiting, limit_config becomes limits_config Co-authored-by: Jennifer Villa <jvilla2013@gmail.com>	3 years ago
Ed Welch	b136d0dab3	Increase flush_op_timeout to 10m, 10s is often much too short for a big WAL replay which can generate a lot of chunks very quickly. (#5768) ... Signed-off-by: Ed Welch <edward.welch@grafana.com>	3 years ago
Ed Welch	a9ac01bd0f	use an empty registry when setting up the logger for the push server (#5761) ... Signed-off-by: Ed Welch <edward.welch@grafana.com>	3 years ago
Gerard Vanloo	76b0fc5663	operator: Update Prometheus go client to resolve CVE-2022-21698 (#5748)	3 years ago
李国忠	098b5a2d37	[new] promtail pipeline: Promtail Rate Limit stage #5048 (#5051) ... * [new] promtail pipeline: Promtail Rate Limit stage #5048 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * Update clients/pkg/logentry/stages/limit.go Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz> * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * Update docs/sources/clients/promtail/pipelines.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * Update docs/sources/clients/promtail/stages/limit.md * Update docs/sources/clients/promtail/stages/limit.md * fix import package * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/pipelines.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Owen Diehl	86cb8d52d3	ensure tsdb is sorted by hash then labelset (#5746)	3 years ago
Sashank Agarwal	62876c57f7	operator: change uuids to tenant name in doc (#5739)	3 years ago
Owen Diehl	51fbc95bbd	fixes existing test case and adds more (#5687)	3 years ago
JordanRushing	52f9df415d	Update MultiTenantQuerier `Series()` and `Label()` to use `user.InjectOrgID()` instead of `user.InjectUserID()` (#5735)	3 years ago
Periklis Tsirakidis	dac64c4d47	operator: Add missing label matcher for openshift logging tenant mode (#5729)	3 years ago
JordanRushing	1cfff09117	Implement `Series` and `Label` for MultiTenantQuerier (#5566) ... **What this PR does / why we need it**: re: #5490, #5517 This PR continues implementing the `Querier` interface by adding `Label` and `Series` methods for `MultiTenantQuerier`. Two new functions are also added to `pkg/logproto`: `MergeSeriesResponses` and `MergeLabelResponses` which consolidate multi-tenant responses into a single response. **Which issue(s) this PR fixes**: N/A **Special notes for your reviewer**: N/A **Checklist** - [ ] Documentation added - [x] Tests updated - [ ] Add an entry in the `CHANGELOG.md` about the changes. Signed-off-by: JordanRushing <rushing.jordan@gmail.com> Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz>	3 years ago
Karsten Jeschkies	a5921f791a	Revert changes to generated assets_vfsdata.go. (#5728)	3 years ago
Karsten Jeschkies	46956d0bf6	Use dskit/tenant intead of loki/pkg/tenant. (#5724)	3 years ago
Michel Hollands	9d62f051b8	Update fluent-bit output name (#5711) ... * Update fluent-bit output name Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Empty commit * Another empty commit	3 years ago
Subomi Oluwalana	732b4ab539	Fixed Getting started docs error (#5504) ... * Simple docs error The docs read "... are what send the logs that Loki generate to Loki" instead of "... are what send the logs that promtail generate to Loki" * Capitalise spelling of Promtail	3 years ago
Karen Miller	34433343e8	Docs: add an empty v2.5 release notes section (#5533)	3 years ago
Paul Ryan	4e3f3b7f7e	Promtail: Fix retry/stop when erroring for out of cloudflare retention range (e.g. over 168 hours old) (#5698) ... * fix: 5696 don't retry when out of range for cloudflare	3 years ago
Alex Tomic	3bf2efa371	logcli: Remove port from TLS server name when provided in --addr (#5477) ... If connecting to a TLS secured endpoint with an explicit port, ensure that ServerName contains only the host and not the port to avoid a cert validation failure	3 years ago
Susana Ferreira	d4dd4eda4a	Update docker repo to grafana/loki-query-tee (#5716) ... * Update docker repo to grafana/loki-querytee * Sign drone.yml file * Update makefile - update target to generate query-tee image with correct name - update error message on drone target * Update Makefile drone target error message Co-authored-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Christian Haudum	6d7422aabf	Assert that push values tuples consist of string values (#5685) ... * Assert that push values tuples consist of string values This fixes a bug in the parsing of push requests that could allowed users sending non-string "log lines" from clients, such as full JSON objects. The values were interpreted as strings, even though they weren't, leading to unexpected log line transformation because the request did not fail. Fixes #5645 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add changelog entry Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Christian Haudum	5ecbbbe5f5	Mark GELF support in Promtail as experimental (#5697) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Christian Haudum	95bf7592e0	Build querytee image as part of CI pipeline (#5700) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Christian Haudum	1a7b170cdb	Update Fluent Bit docs (#5402) ... * Change links to fluentbit.io website The documentation for the Fluent Bit Loki output plugin references the fluentbit.io website multiple times. However, the structure of this website seems to have changed. This commit updates the links to the correct URLs (if possible). Additionally, renamed occurences of "fluentbit" to "Fluent Bit", which seems to be the correct spelling of the product according to their website. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Remove trailing commas from JSON code blocks Trailing commands are syntactically not allowed in JSON. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Sashank Agarwal	b3a2cec7c0	operator: Fix immediate reset of degraded condition (#5691)	3 years ago
Nicolas Vanheuverzwijn	0950034890	Update retention.md (#5706) ... Retention policy actually accept suffix such as `d` and `w` but Go's time.ParseDuration does not. See a2dd731586/pkg/storage/chunk/table_manager.go (L93)	3 years ago
Franz Wong	d67306b657	Promtail: Rename config name limit_config to limits_config (#5707) ... * Rename promtail config name 'limit_config' to 'limits_config' * Add changelog entry * Fix formatting	3 years ago
Robert Jacob	908692794d	operator: Update operator-sdk to 1.18.1 (#5704)	3 years ago
Periklis Tsirakidis	20068ca36c	operator: Replace frontend_worker parallelism with match_max_concurrent (#5693)	3 years ago
Gerard Vanloo	ae4c3b1afc	operator: Fix multiple storage support for boltdb_shipper and schema (#5699)	3 years ago
Susana Ferreira	1d1461824d	Move promtail StreamLagLabels config to upper level config.Config (#5686) ... * Move promtail StreamLagLabels config to upper level config.Config * Fix promtail config load test * Fix promtail configuration reference * Add options promtail config section * Kick GitHub CI Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Sashank Agarwal	dec695f112	operator: make replicationFactor optional (#5701)	3 years ago
Callum Styan	2ebbecfcbd	Require unique client configs when there are multiple clients. (#5688) ... * Require unique client configs when there are multiple clients. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fixing linter error Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Robert Jacob	cb757a4a3a	operator: Update to Go 1.17 (#5695) ... * Update Go 1.17 * Migrations for Go 1.17 * Update bingo and add missing sum files * Update mention in doc * Update changelog * Update Go in workflows	3 years ago
Sashank Agarwal	cb9960d598	operator: Document how to connect to LokiStack gateway component (#5615)	3 years ago
Robert Jacob	4f2f0886d7	operator: Update Loki operand to 2.4.2 (#5655)	3 years ago
Callum Styan	2c2578e84c	Fix bug with new promtail stream lag metric where labels might not be (#5675) ... applied if they don't exist on the source stream Signed-off-by: Callum Styan <callumstyan@gmail.com>	3 years ago
Salva Corts	0c5900e407	Fix debug image by updating Delve version (#5673)	3 years ago
Karsten Jeschkies	705baa39f4	Speed up re-labelling in multi-tenant queries. (#5663)	3 years ago
Mikael Schirén	f3a86ded23	Add Digitalist as adopter (#5596)	3 years ago
Peter Olivo	0a49d21d40	Fix broken Fluentbit / Fluentd plugin doc links (#5664)	3 years ago
Gerard Vanloo	8154f3f2b4	operator: Update developer addons (#5599)	3 years ago