7250 Commits (a4aee4f4ff494b525f68c9c6c1ae3417a8e61ebe)

 

All Branches   

Search

Author	SHA1	Message	Date
Cyril Tovena	a4aee4f4ff	fix: Wait for OwnedStreams service in Ingester startup (#14208)	8 months ago
Christian Haudum	cdf084fdae	perf(blooms): Remove compression of `.tar` archived bloom blocks (#14159) ... Decompression is a CPU intensive task, especially un-gzipping. The gain of compressing a tar archive of storage optimized binary blocks is neglectable (question: is it?). In this example, the block of ~170MiB is ~3.3MiB bigger when not compressed, which is a ratio of ~2% ```bash $ ls -las 2bc017f79711e12a-2bffc5dcc0e8e964_1726004114913-1726106283939-bc42f529.tar 177048 -rw-rw-r-- 1 christian christian 181293056 Sep 18 13:49 2bc017f79711e12a-2bffc5dcc0e8e964_1726004114913-1726106283939-bc42f529.tar $ ls -las 2bc017f79711e12a-2bffc5dcc0e8e964_1726004114913-1726106283939-bc42f529.tar.gz 173732 -rw-rw-r-- 1 christian christian 177897689 Sep 18 13:49 2bc017f79711e12a-2bffc5dcc0e8e964_1726004114913-1726106283939-bc42f529.tar.gz $ qalc '(181293056 - 177897689) / 1024/ 1024' ((181293056 − 177897689) / 1024) / 1024 ≈ 3.238074303 $ qalc '181293056 / 177897689' 181293056 / 177897689 ≈ 1.019086066 ``` After some consideration, we decided to store the encoding of the bloom block in the `BlockRef`. This means, that the changes in this PR do not break compatibility with existing blocks compressed with gzip, although new blocks will not be compressed any more. However, the PR adds support for different compression algorithms, such as gzip, snappy, lz4, flate, and zstd. Compression is not configurable yet. --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Dylan Guedes	3f47f09a69	fix(helm): Check for `rbac.namespaced` condition before creating roles (#14201) ... Modify the `tokengen` and `provisioner` to check for `rbac.namespaced` before creating the role, as we do with the backend component. This is a fix as we were expected to do this check.	8 months ago
Quentin Bisson	5d45c96ce1	fix(mixin): Remove pod label from disk usage aggregation (#14180) ... This PR fixes the disk read and writes dashboards to support node-exporter pod name changes when node changes often (tools like karpenter for instance, autoscaling, etc.) as this causes duplicate entries when checking metrics over 1h	8 months ago
Taylor Mansfield	170217f38f	docs: Fix awkwardly worded line about fluent-cli (#14197) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	8 months ago
Christian Haudum	50ad3df658	docs: Update Loki components page with new bloom components (#14169) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Sven Grossmann	f8d9143eea	fix(log-to-span): timestamp.Time should be called with milliseconds (#14196)	8 months ago
Joao Marcal	18e9355e39	chore(operator): update the release-please config for next release (#14143)	8 months ago
Quentin Bisson	8f54ec6588	fix: mixins / loki-resources-overview panel layout (#14178)	8 months ago
Quentin Bisson	547ca708b9	feat: add missing cluster label to mixins (#12870) ... Signed-off-by: QuentinBisson <quentin@giantswarm.io> Co-authored-by: Vladyslav Diachenko <82767850+vlad-diachenko@users.noreply.github.com> Co-authored-by: Callum Styan <callumstyan@gmail.com>	8 months ago
Paul Rogers	fc90a63636	feat: implement IsRetryableErr for S3ObjectClient (#14174) ... **What this PR does / why we need it**: Adds support for `IsRetryableErr`in the `S3ObjectClient`, similar to what is found in the `GCSObjectClient`	8 months ago
Christian Haudum	2840d48b92	chore: Clean up unused bloom filter related code (#14183) ... This PR tries to eliminate dead code in the bloom package, mainly related to line tokenization. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Jack Baldry	d8e7e246ba	ci: Use centralized 'Add to docs project' workflow with GitHub App auth (#14181) ... Signed-off-by: Jack Baldry <jack.baldry@grafana.com>	8 months ago
J Stickler	49fa5fa5b0	docs: Loki 3.2 Release Notes (#14191)	8 months ago
Vladyslav Diachenko	64bfcee0dd	ci: temporarily disable the workflow for the PRs where PRs branch is from (#14188) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	8 months ago
Ashwanth	900751c3bb	fix: report correct status code for metric and log queries in metrics.go (#12102)	8 months ago
Dylan Guedes	a47515300a	fix: Report PSRL error message correctly (#14187) ... **What this PR does / why we need it**: Modify our `validateEntries` code to report a log failure when a PSRL is identified.	8 months ago
Vladyslav Diachenko	31368806a9	feat: add backoff mechanism to the retention process (#14182) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	8 months ago
Christian Haudum	963779064b	chore: Move compression utilities into separate package (#14167) ... Compression tooling has been part of the `chunkenc` (chunk encoding) package in the past for legacy reasons. Since more components use this now, it's easier to keep it in a separate package. This also eliminates the confusion around "encoding", since this has been incorrectly used synonymously with "compression" in the past. --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	8 months ago
Quentin Bisson	ce2e6d520b	feat: mixins / allow bloom dashboards disabling (#14177) ... This PR allows hiding the bloom dashboards if they are not used.	8 months ago
Vladyslav Diachenko	a26416d078	ci(helm): update Kube Diff workflow (#14173) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	8 months ago
Quentin Bisson	16881ab0d3	fix(mixins): add backend path section in loki-operational for single scalable deployment (#13023) ... Signed-off-by: QuentinBisson <quentin@giantswarm.io>	8 months ago
François Gouteroux	f2d349924c	fix(promtail): validate scrape_config job name, do not allow duplicate job names (#13719) ... Signed-off-by: François Gouteroux <francois.gouteroux@gmail.com>	8 months ago
Quentin Bisson	45b8719aa7	feat(mixins): merge resources dashboards for ssd into one (#13471) ... Signed-off-by: QuentinBisson <quentin@giantswarm.io>	8 months ago
Jonathan Foster	f4da88e4d3	docs: add `X-Scope-OrgID` header to Grafana datasource if multi-tenancy is enabled (#13914) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	8 months ago
Robert Fratto	1b7086632e	chore(storage/bloom/v1): update comments on bloom test (#14168)	8 months ago
Christian Haudum	02b26a85df	chore: Remove outdate TODO file for bloom package (#14158) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Cyril Tovena	44958c4b8b	chore(kafka): Refactor configurations and remove old modules (#14161)	8 months ago
Jack Baldry	e899826645	ci: Update workflows to use actions that don't need organization secrets (#13991) ... Signed-off-by: Jack Baldry <jack.baldry@grafana.com>	8 months ago
Karsten Jeschkies	48e4a346b8	chore: Remove unused quantile merge step evaluator. (#14160)	8 months ago
Quentin Bisson	0ea7431139	fix(mixins): disk space utilization panels with latest KSM versions (#13486)	8 months ago
Quentin Bisson	3aa4f2227e	feat(mixins): Allow hiding useless rows in loki-operational (#13646) ... Signed-off-by: QuentinBisson <quentin@giantswarm.io>	8 months ago
Ed Welch	b90b863162	chore: restore backport creator workflow (#14156) ... Signed-off-by: Edward Welch <edward.welch@grafana.com> Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	8 months ago
Ed Welch	66cffcb427	feat: add structured metadata to the promtail push API (#14153) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	8 months ago
Christian Haudum	6e36041c08	chore(blooms): Remove excessive logging in fused querier (#14152) ... The FusedQuerier emits a large amount of log lines at level WARN if a bloom is empty. Since the introduction of structured metadata blooms, this happens every time a series does not have structured metadata in any of its entries. In the future, an optimisation could be to not write blooms for series at all, if they contain no data. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
benclive	78b275bf10	fix: Propagate query stats from quantile & topk queries (#13831) ... Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Callum Styan <callumstyan@gmail.com>	8 months ago
Vladyslav Diachenko	1e939aa1f4	ci(helm): added workflow to see the diff (#14134) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	8 months ago
Christian Haudum	39fa9b47e9	chore: Fix linter errors (#14145) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Christian Haudum	5bffc10d85	chore(blooms): Replace extracting line filters with extracting label filters (#14137) ... Replace the logic for extracting line filters with extracting label filters on the bloom gateway client, because otherwise the bloom gateway server would receive requests with no label matchers. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Christian Haudum	1308d903d4	chore(ci): Temporarily remove Backport PR action (#14136) ... The action can be added again by reverting this PR, once it is fixed. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Robert Fratto	ebe0bb875e	chore: replace remaining references to ExtractTestableLineFilters (#14135)	8 months ago
Robert Fratto	4de51f9953	chore(bloomgateway): update bloom gateway to test for structured metadata blooms (#14130) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com> Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Sandeep Sukhani	89c4282654	chore: avoid some allocations in tsdb while reading posting offset table (#14111)	8 months ago
Sven Grossmann	63e84b476a	fix(aggregated-metrics): correctly create logfmt string (#14124)	8 months ago
Robert Fratto	53cfef3bca	chore(storage/bloom/v1): add ExtractTestableLabelMatchers (#14119) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	8 months ago
Christian Haudum	e64124ec1a	chore(blooms): Expose series/stream metadata when iterating over blooms (#14097) ... The bloom block format stores metadata from indexing in the index part of the block (series file), which contains information, such as the fields (metadata names) that have been indexed in the bloom filter. This will be needed in the read path (bloom gateway) later on, to check whether a provided label name from the label filter expression was actually indexed or not. In this PR, the newly available metadata is used by the bloom inspect tool (located in ./tools/bloom/inspect/) to list the fields along the series, as well as the individual pages of the series that contain the actual scalable bloom filters. --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
George Robinson	18c27f9d4e	feat: revert "feat: add functions to common.libsonnet for warpstream" (#14129)	8 months ago
George Robinson	2bde071872	feat: add functions to common.libsonnet for warpstream (#14123)	8 months ago
Paul Rogers	f226b598a4	chore: Final batch of linting cleanup for Go 1.23 and newer golangci (#14120)	8 months ago
Sven Grossmann	93009d4e8c	fix(detected_fields): always return empty array as `null` (#14112)	8 months ago