8791 Commits (bd4331363b204c60aa15b174d17935a4d3ea3c18)

 

All Branches   

Search

Author	SHA1	Message	Date
Robert Fratto	bd4331363b	chore: align benchmark results between chunks and dataobjs (#17127)	2 months ago
Robert Fratto	88beefb02a	fix(logql): Fix inconsistency with parsed field short circuiting (#17104) ... PR #8724 originally changed the behaviour of LogQL so that the first extracted field takes precedence over any later extracted field with the same name. However, this PR had two subtle issues due to the caching that parse stages perform for key lookups: * The precedence logic did not always apply to duplicate fields within the same parse stage (notably for logfmt). * The caching behaviour could incorrectly cause stages to permanently ignore fields for future log lines where that stage should otherwise perform extraction. Additionally, once structured metadata was introduced, it was incorrectly being flagged as an "extracted field." Combined with the caching behaviour described above, this means that parsed fields only take precedence over structured metadata if the first log line encountered by the engine doesn't have that field also set as structured metadata. This can be demonstrated with the following scenario: 1. A log line from a stream that uses structured metadata for `trace_id` is encountered first. This (incorrectly) causes the trace_id field to be ignored in all parse stages. 2. All later log lines from streams without structured metadata can no longer extract or filter on a parsed `trace_id` for the lifetime of the query, due to the caching from step 1. The fix is two-fold: * Decouple skipping previously extracted fields from the logic which caches interned keys. * Only mark parsed labels as extracted fields (previously all labels). Because the check for whether a field is already extracted is now called more times, the list of extracted fields has been updated to a map to allow for faster checks.	2 months ago
Karsten Jeschkies	7312ccb3f3	refactor(stringlabels): Support stringlabels distributor tests (#17123)	2 months ago
Karsten Jeschkies	5bba0c27b7	refactor(stringlabels): Support stringlabels ingester tests (#17121)	2 months ago
benclive	8e421186df	chore: Collect basic stats from dataobj queries (#17111)	2 months ago
George Robinson	d197cdac8d	feat: add enforceLimits to ingest_limits.go (#17117)	2 months ago
George Robinson	b0931b1b52	chore: change the result of exceedsLimits (#17112)	2 months ago
George Robinson	bccededc44	chore: fix private interface had exported methods (#17115)	2 months ago
Karsten Jeschkies	75593e0ed7	refactor(stringlabels): Support stringlabels in loghttp, pattern and ruler tests. (#17102)	2 months ago
Vitaly Orlov	c7ffeb5211	docs: update template_functions.md to change argument order for contains (#17043) ... Signed-off-by: Vitaly Orlov <orloff.v@gmail.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 months ago
aarogoss	e962398462	feat: Optionally enable kafka histograms for read/write latency (#17089)	2 months ago
Periklis Tsirakidis	54ff5dce52	feat(ingest-limits): Add partition id caching (#16964)	2 months ago
Sandeep Sukhani	db59d0e9b2	fix: wire up deletion series progress tracking (#17099)	2 months ago
Karsten Jeschkies	c49eeba326	refactor(stringlabels): Support stringlabels in querier tests (#17088) ... **What this PR does / why we need it**: This is the first step of support Prometheus `stringlabels` implementation in Loki. **Special notes for your reviewer**: The tests should compile with build tag `stringlabels`.	2 months ago
renovate[bot]	6e77d026dd	chore(deps): update dependency typescript to v5.8.3 (main) (#17097) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	2 months ago
renovate[bot]	dbb2f7f08f	chore(deps): update dependency go to v1.24.2 (main) (#17096) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	2 months ago
renovate[bot]	1fb4ca6b14	chore(deps): update dependency github.com/grafana/loki/production/loki-mixin to v3.4.3 (main) (#17094) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	2 months ago
Periklis Tsirakidis	befb5b36bb	chore(ingest-limits): Rollout using both balancers (#17085)	2 months ago
Sandeep Sukhani	8e4b10408d	fix: avoid copying label values from tsdb unless required (#17077)	2 months ago
Christophe Serafin	5625464332	fix: Fix missing series in monolithic mode (#17067) ... In monolithic mode, unlike other API endpoints (query/labels/...), the series endpoint did not retrieve data from storage for the time window between end of `index_cache_validity` and `query_store_max_look_back_period`, and therefore missing series in the response.	2 months ago
Trevor Whitney	940a067a50	chore: apply series limit per variant for multi-variant queries (#16887)	2 months ago
Owen Diehl	2aed4c3da5	fix(json, structured metadata): json-parsing cleanup (#17072)	2 months ago
Hristo Venev	9629d07c60	fix: Unescape JSON strucutred metadata string values (#13919)	2 months ago
Owen Diehl	cf272892e4	revert: "fix(json, structured metadata): correctly handle escaping in json parsing API" (#17071)	2 months ago
Owen Diehl	243b155ff3	fix(json, structured metadata): correctly handle escaping in json parsing API (#17068)	2 months ago
JordanRushing	9000de1aa7	fix(push): Add guard clauses to prevent negative counter values (#17056) ... Signed-off-by: Jordan Rushing <rushing.jordan@gmail.com> Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	2 months ago
Christian Haudum	e297c51d20	chore(metastore): Use constants for label names (#17048) ... This PR contains improvements for: 1. Make label names contants 2. Use `strconv.FormatInt` for encoding timestamp into label value (equivalent to `strconv.ParseInt` when decoding) 3. Use `labels.New` to construct labels, rather then string formatting Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 months ago
JordanRushing	9e9f534460	fix: prevent panic when ContentLength is negative in Distributor RequestBodyTooLarge metrics (#17054)	2 months ago
Robert Fratto	300c1e859e	chore(logql/bench): Fix bug in bench data generation and update naming conventions (#17051) ... This PR fixes a bug found in generating test data for chunks: MemChunks weren't being closed properly before flushing, which caused the last block of every chunk to be omitted from the flush. As a result, benchmark tests against chunks were inaccurate, causing many metric queries to appear 5-10x faster with chunks than they actually are. Additionally, this PR expands on #17006 with another naming convention change: the type of query is now included in the benchmark name to allow developers to only run benchmarks of a specific query type (metric, log). PR #17006 neglected to reflect the naming convention change in the benchmark TUI, which stopped it from working. This is now fixed to match the latest naming convention introduced in this PR, and the TUI will now work again.	2 months ago
Christian Haudum	1705f98a9f	chore(engine): Wire up new execution engine (#17032) ... This PR connects the already existing components of the new query engine and wires them up in the querier API. The feature flag `-querier.engine.enable-v2-engine` controls whether supported queries should be executed using the new engine. Note that this implementation currently does not execute any queries. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 months ago
George Robinson	ffa9656f7f	chore: refactor how distributor checks ingest-limits (#17042)	2 months ago
George Robinson	e90e0c41fb	chore: rename RejectedStreams to ExceedsLimitsResult (#17041)	2 months ago
George Robinson	38c40170fc	chore(ingest-limits): rate should be a uint64 as it cannot be negative (#17040)	2 months ago
Trevor Whitney	bfb935d893	fix: allow boolean numeric values in detected labels (#16997)	2 months ago
Joao Marcal	c48209c00c	chore(operator): move to golangci-lint v2 (#17017)	2 months ago
Periklis Tsirakidis	406690d26e	fix(ingest-limits): Incorrect ingested bytes counter usage (#17037)	2 months ago
Travis Patterson	d204d7465c	chore: expose partition ring for consumption by GEL (#17036)	2 months ago
Jackson Coelho	6243ebc2b5	chore: remove loki annotations from gateway nginx deployment (#16933)	2 months ago
Periklis Tsirakidis	5229a2ab65	fix(ingest-limits): Get usage from owing instances only (#16937)	2 months ago
George Robinson	7f1a1c755a	feat: add metric to track ingest limits failures in distributor (#17015)	2 months ago
Robert Jacob	c63f0a9d8d	fix(operator): Update memberlist when ingester becomes unhealthy (#17026) ... Co-authored-by: Aleksei Panfilov <aleert@yandex.ru>	2 months ago
Christian Haudum	ba61aa88de	chore(engine): Integrate metastore into physical query planning (#17016) ... This PR integrates the data object lookup using the metastore into the query planning. To achieve that, I extended the `Metastore` interface with an additional function that not only returns the data object paths, but also the stream IDs of streams that match the given label matchers. ```go type Metastore interface { ... // StreamsIDs returns object store paths and stream IDs for all matching objects for the given matchers between [start,end] StreamIDs(ctx context.Context, start, end time.Time, matchers ...*labels.Matcher) ([]string, [][]int64, error) ... } ``` Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 months ago
Trevor Whitney	58aa00a5f4	fix: short circuit level detection when already detected (#17028)	2 months ago
Trevor Whitney	a8f65d1db3	ci: skip flaky analytics test (#17009)	2 months ago
Jay Clifford	93360f6da1	feat: Meta Monitoring Loki v2 (Part 2) - Loki Mixin's (#16962) ... Co-authored-by: Poyzan <31743851+poyzannur@users.noreply.github.com>	2 months ago
George Robinson	532a652c21	chore: some metrics changes to ingest-limits-frontend (#17004)	2 months ago
Salva Corts	9c6ab304ed	chore: trigger ci (#17019)	2 months ago
Andrés Álvarez	8c6cb1ef9a	ci(helm-diff): fix name for distributed scenario (#16930) ... Signed-off-by: Andres Alvarez <1671935+kir4h@users.noreply.github.com>	2 months ago
aarogoss	7fc9026208	feat: Add agent IPs to distributor log (#17011) ... Signed-off-by: aarogoss <32306622+aarogoss@users.noreply.github.com> Co-authored-by: Ed Welch <edward.welch@grafana.com>	2 months ago
Jay Clifford	2d0bbfd70b	feat: Meta Monitoring Loki v2 (Part 1) - Telemetry Collection (#16665) ... Signed-off-by: Jay Clifford <45856600+Jayclifford345@users.noreply.github.com> Co-authored-by: J Stickler <julie.stickler@grafana.com> Co-authored-by: Pete Wall <pete@petewall.net>	2 months ago