apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Robert Fratto	f6091a67d1	chore(engine): move to toggleable section prefetching (#19142 ) dataset.readerDownloader was originally introduced in #16429, an attempt to balance peak memory usage of reading a section with read times by downloading a configurable size of pages in advance. In practice, each roundtrip to object storage adds too much of a latency hit, and we've started to set the cache limit high enough to ensure that each reader only needs a single prefetch. Given what we've found, it no longer makes sense to control peak memory usage via the prefetch size. Other options, such as downloading directly to disk, may be explored in the future. In the meantime, this PR removes the ability to specify a cache size. All non-pruned pages will be bulk requested using the range reader (#19067) on the first read call. Pages which have left the potential read window will continue to be eagerly removed for garbage collection. However, we don't want to prefetch when the dataset is entirely in memory, which is the case when the logs section builder is performing k-way merge over in-memory sections. To lower the memory usage of builders, prefetching is configurable. For this initial PR, prefetching is only disabled for the logs section builder; all other reads force prefetching. Signed-off-by: Robert Fratto <robertfratto@gmail.com>	8 months ago
Periklis Tsirakidis	383032bccd	chore: Remove dataobj querier component (#19132 )	8 months ago
unique-jakub	18b8995a32	feat(helm): add configurable livenessProbe to single binary StatefulSet (#19072 ) Signed-off-by: unique-jakub <jakub@unique.ch> Signed-off-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> Co-authored-by: Jan-Otto Kröpke <mail@jkroepke.de> Co-authored-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> set to auto merge when tests pass	8 months ago
fmlecpac	4cbbc4f3bc	fix(networkpolicy): use UDP/53 for DNS egress instead of named port (#19073 ) Signed-off-by: fmlecpac <168742771+fmlecpac@users.noreply.github.com>	8 months ago
TheRealNoob	3272ca7197	fix(helm): un-deprecate several features in `monitoring` block (#19012 ) Signed-off-by: TheRealNoob <mike1118@live.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	8 months ago
Andreas Lindhé	10441c899f	feat(helm): Add health probes to loki in backend (#18548 ) Signed-off-by: Andreas Lindhé <7773090+lindhe@users.noreply.github.com> Co-authored-by: Jan-Otto Kröpke <mail@jkroepke.de>	8 months ago
Fabien D	cadc824015	feat(loki-mixin): allow disabling thanos dashboard and fix dashboard's file name (#18749 ) Co-authored-by: J Stickler <julie.stickler@grafana.com>	8 months ago
Florian Weber	490f38d5ca	docs: Fix the default value for `no-file` description (#19121 ) Signed-off-by: Florian Weber <706419+fnwbr@users.noreply.github.com>	8 months ago
Robert Jacob	155972ec25	feat(operator): Update Loki operand to v3.5.4 (#19122 )	8 months ago
Joao Marcal	8e6c018665	fix(operator): updated AlertingRule sample to make it comply with the validation we apply (#18671 )	8 months ago
benclive	b786095aea	chore: Read multi-tenant objects in query-engine (#19104 )	8 months ago
nicolevanderhoeven	62cec3e842	test: Copy Helm CI tests into new framework (#19008 )	8 months ago
Christian Haudum	65de5f95db	chore(engine): Simplify `Pipeline` interface (#19110 ) This PR replaces the two calls to retrieve a value from the pipeline with a single one. To do this, the `Read()` method now returns two arguments: `arrow.Record` and `error`, rather than just the error. If the error is not `nil`, the first argument (arrow.Record) must be ignored by the caller. The `Value()` method is not needed any more and was removed. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
renovate[bot]	70cff6ae0d	chore(deps): update dependency vite to v7.1.4 (main) (#19116 ) Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	8 months ago
renovate[bot]	6c3864e0b9	chore(deps): update dependency github.com/grafana/loki/production/loki-mixin to v3.5.4 (main) (#19115 ) Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	8 months ago
renovate[bot]	ab86bc301a	chore(deps): update dependency @types/react-dom to v19.1.9 (main) (#19114 ) Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	8 months ago
renovate[bot]	c4a14bf996	chore(deps): update dependency @types/node to v22.18.1 (main) (#19112 ) Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	8 months ago
benclive	065fc936fd	chore: Fix bugs in the index-builders (#19105 )	8 months ago
enterprise-logs-app[bot]	33f15bb39d	chore: release loki helm chart 6.39.0 (#19109 ) Co-authored-by: enterprise-logs-app[bot] <157844630+enterprise-logs-app[bot]@users.noreply.github.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	8 months ago
loki-gh-app[bot]	aae4f8c679	chore: release loki helm chart 6.39.0 (#19091 ) Co-authored-by: JStickler <4106682+JStickler@users.noreply.github.com>	8 months ago
Robert Jacob	63a806591d	chore(operator): Update to Go 1.24.4 (#19100 )	8 months ago
Tom Hellier	0819e48b6b	feat(helm): add more specificity to affinity and topology spread constraints (#17404 ) (#19061 ) Signed-off-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> Signed-off-by: J Stickler <julie.stickler@grafana.com> Co-authored-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	8 months ago
Ilia Lazebnik	ed68531da5	feat(helm): add dnsconfig to all missing resources (#18903 ) Signed-off-by: drfaust92 <ilia.lazebnik@gmail.com> Signed-off-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> Co-authored-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com>	8 months ago
Bradley	51d710f156	fix(helm): admin-api should only be deployed in microservice mode (#13655 ) Signed-off-by: Bradley Pettit <12028233+bradleypettit@users.noreply.github.com> Signed-off-by: Bradley <12028233+bradleypettit@users.noreply.github.com> Signed-off-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> Signed-off-by: J Stickler <julie.stickler@grafana.com> Co-authored-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	8 months ago
Antonin	350d46c34f	fix(helm): avoid double zonal ingester scrapping by not scrapping headless svc (#19000 ) Signed-off-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> Co-authored-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com>	8 months ago
Sandeep Sukhani	0b2d0b070e	chore: make index updates idempotent from horizontally scalable compactor (#19093 )	8 months ago
Jan-Otto Kröpke	95ced86f69	fix(helm): Add init container configuration for backend, bloom builder, distributor, query-frontend, query-scheduler, read, write. (#18709 ) Signed-off-by: Jan-Otto Kröpke <mail@jkroepke.de>	8 months ago
Salva Corts	af257fd058	feat: per policy overridable stream limits (#18994 )	8 months ago
Sophie Waldman	8a9da8f0e3	chore: Update engine planner to sort by input time range (#18951 ) When convering a [logical.MakeTable] into nodes, keep information on the time range for each location and use the time ranges to sort the nodes created. The processMakeTable method will now always return a root Merge node. Inside the Merge node, overlapping shards will be grouped as DataObjScan nodes inside a SortMerge, while any individual shards without any overlap will be DataObjScan nodes directly under the Merge. Signed-off-by: Sophie Waldman <sophie.waldman@grafana.com>	8 months ago
Ashwanth	d950d4075d	chore(engine): improve performance of matching window calculation (#19013 ) Currently range aggregation linearly scans through all the possible time windows (a 24h query with a 1m step results in 1440 windows) to find the matching ones. This is quite expensive as this matching is done for each row. This PR updates the matching code to use arithmetic which runs in constant time for cases where step >= range and for overlapping windows (step < range) it uses binary search. Co-authored-by: Ashwanth Goli <iamashwanth@gmail.com> Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
TheRealNoob	6a953bb492	feat(helm): allow extraObjects as dict (#13252 ) Signed-off-by: TheRealNoob <mike1118@live.com> Signed-off-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> Co-authored-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	8 months ago
Hiromasa Ihara	1cda92572a	feat(fluentd): Add 'compress gzip' setting to fluentd plugin (#18995 ) Added gzip compression for push request payloads to fluentd plugin. Signed-off-by: Hiromasa Ihara <iharahiromasa@gmail.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	8 months ago
cui	14ef18c3b2	refactor(tools): using reflect.TypeFor (#18991 ) Try to use better API `reflect.TypeFor` instead of `reflect.TypeOf` when we have known the type. Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
keeghcet	81229effb9	chore: fix inconsistent function name in comment (#19081 ) Signed-off-by: keeghcet <keeghcet@outlook.com>	8 months ago
JordanRushing	86c81e880a	chore(querytee): Fix flaky proxy endpoint test panic (#19019 ) Signed-off-by: Jordan Rushing <rushing.jordan@gmail.com>	8 months ago
Charles Korn	8509f1df90	chore(deps): upgrade dskit (#19089 )	8 months ago
benclive	5d428b2ac4	chore: Fix panic for queries with unsupported predicate types (#19086 )	8 months ago
benclive	653d7ac19e	chore: Fix tenant info in sections when resetting (#19085 ) Co-authored-by: George Robinson <george.robinson@grafana.com>	8 months ago
George Robinson	a03e86c858	feat: remove tenant topic tee (#19082 )	8 months ago
Shantanu Alshi	4dfef8fc15	chore(otlp): Add support for zstd and lz4 content-encodings for OTLP logs (#18842 )	8 months ago
George Robinson	f60f818bdd	feat: build multi-tenant data objects (#19034 )	8 months ago
Karsten Jeschkies	adb27ff177	perf: Reduce allocations for JSON and logfmt parser (#18637 ) What this PR does / why we need it: The JSON and logfmt parsers suffer from a high number of allocations when the parsed labels have a high cardinality. This change reduces the allocations quite a bit by copying the labels bytes to a byte buffer. Note: The benchmarks ran without a validation step that calls `LabelResult.Labels()` as that method uses a lot of allocation but is used only once in production code.	8 months ago
Christian Haudum	b39a5bd8f3	chore(ci): Run `make release-workflows` to update Go version in yaml (#19078 ) Running make release-workflows is needed after updating GO_VERSION in the Makefile in order to reflect the changes in the workflow files. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Christian Haudum	30af552a39	chore(ci): Update Go version and release workflows (#19076 ) Run make release-workflows to avoid drift between source (jsonnet) and target (yaml) files. Also update Go version to 1.24.6 which is required by go.mod. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Christian Haudum	f50c87fce2	feat(engine): Prefetch inputs of Merge pipeline concurrently (#19039 ) This PR adds prefetching to the inputs of the Merge node. The Merge is a pipeline that takes N inputs and sequentially consumes each one of them. It completely exhausts an input before moving to the next one. However the inputs do not prefetch any data, so calling Read() may wait on i/o (fetching data from object storage, decoding, etc). Prefetching data allows to fetch the next batch which the caller node is processing the current batch. This PR changes the behaviour of the Merge so inputs are prefetched. Since inputs of the Merge pipeline are read sequentially, the current input is always prefetched. The setting `-querier.engine.merge-prefetch-count` controls how many of the next inputs are prefetched concurrently. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Ashwanth Goli <iamashwanth@gmail.com>	8 months ago
Trevor Whitney	04f89298c4	ci: fix claude workflow (#19027 )	8 months ago
George Robinson	90ac000ce6	fix: records discarded if one fetch returns error (#19069 )	8 months ago
Robert Fratto	32e3b46928	chore(rangeio): add tracing to rangeio.ReadRanges (#19067 )	8 months ago
George Robinson	5809c4739b	fix: nil error returned when client closed (#19068 )	8 months ago
George Robinson	44aba62243	fix: fix possible data loss in dataobj-consumers (#19060 )	8 months ago

1 2 3 4 5 ...

10192 Commits (f6091a67d168d3a341a53dd6ab2aeffaea5fe71d) All Branches Search

10192 Commits (f6091a67d168d3a341a53dd6ab2aeffaea5fe71d)

All Branches