3971 Commits (bfa2a1df65e233ce99fccd01df2130f440ebd166)

Author	SHA1	Message	Date
George Robinson	16e68c8871	chore: use nested if, it's much easier to reason about (#17450)	11 months ago
aarogoss	32f2af2510	chore: run `make lint` and fix one linter conversion complaint (#17452) ... Updates the queryrange/limits.go:WeightedParallelism function return. The linter is complaining about an int being cast to an int. Also ran make lint which introduces a negligible spelling change to limits/frontend/ring.go.	11 months ago
Periklis Tsirakidis	46b2271aac	fix(distributor): Disable metadata topic writes (#17437)	11 months ago
Periklis Tsirakidis	1df66cc007	feat(ui): Add ingest limits rings (#16978)	11 months ago
Christian Haudum	6b4430afd0	chore(engine): Collect pipeline records into Loki result (#17447) ... This PR adds the missing piece between existing HTTP handler and the new execution engine, which converts the Apache Arrow records from the vectorized, columnar, pull-based iterator pipeline into the existing (row-based) Loki response format. Since the engine only supports logs queries at the moment, the transformation logic does not take possible metric query results into account. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	11 months ago
Periklis Tsirakidis	c32e479dd2	fix(ingest-limits): Use stripe locking for metadata (#17150)	11 months ago
renovate[bot]	35e32f3b33	chore(deps): update dependency @types/node to v22.15.2 (main) (#17448) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Christian Haudum	208e519564	chore(engine): Add framework for function evaluation (#17374) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	11 months ago
renovate[bot]	9f25be15bd	chore(deps): update dependency @types/node to v22.15.1 (main) (#17446) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Trevor Whitney	4b0aaaaf2e	fix: hide __aggregated_metric__ in /series and /labels (#14677)	11 months ago
renovate[bot]	d349d38688	chore(deps): update dependency @types/node to v22.15.0 (main) (#17442) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
aarogoss	a4547152f5	chore: moves call to simulated latency to distributor.PushWithResolver (#17441)	11 months ago
matthewhudsonedb	d70b20e37f	fix(push): fix guard clauses to prevent error spam in logs (#17372)	11 months ago
renovate[bot]	3f1fb469a8	fix(deps): update dependency react-router-dom to v7.5.2 (main) (#17438) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Christian Haudum	1f8e4eebfb	chore(engine): Implement execution pipeline for SortMerge operator (#17406) ... This PR contains an implementation of the k-way merge operation without using a heap, like @rfratto described [here](https://github.com/grafana/loki/pull/17280). The SortMerge is implemented only using slices: * Maintain the following invariant: * For each input pipeline, we store the next record to process. (this already exists as `HeapSortMerge.batches`) * Additionally for each record, track the starting slice offset (which resets to zero whenever a new record is loaded in). * Iteration stops when all input pipelines have been exhausted (no change from how this is now). * To get the next record: * Iterate through each record, looking at the value from their starting slice offset. * Track the top _two_ winners (e.g., the record whose next value is the smallest and the record whose next value is the next smallest). * Find the largest offset in the starting record whose value is still less than the value of the runner-up record from the previous step. * Return the slice of that record using the two offsets, and update the stored offset of the returned record for the next call to `Read`. This approach, like the one with heap, still requires to concatenate (coalesce) the single row records - which is not implemented in this PR yet. On that note, single row records are the worst case scenario with this implementation, not necessarily the regular case. **Update:** After an offline discussion, @owen-d and I agreed on ignoring the worst-case scenario of single-row records for now. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	11 months ago
Christian Haudum	50b12efa5e	chore(engine): Only use new engine if dataobjs are available in storage (#17411) ... Objects in object storage usually lag behind 20-30 minutes, but to ensure that they are available, we enable the v2 engine only if the end time is earlier than 1 hour ago. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	11 months ago
Owen Diehl	cf54d502fc	feat(dataobj, executor): filter node execution (#17327) ... # Add Filter Pipeline Implementation This PR implements a filter pipeline for Loki's engine executor component. The filter operator enables row-level filtering of Arrow record batches based on boolean expressions. This is a fundamental component for query execution. ## Changes - Implement `NewFilterPipeline` for evaluating filter predicates on record batches - Add `filterBatch` utility to efficiently filter Arrow records - Update `executeFilter` in the executor to use the new implementation - Add comprehensive test suite for the filter pipeline: - Basic literal predicates (true/false) - Column reference predicates - Empty batch handling - Multiple batch processing ## Implementation Notes The filter implementation follows the same pattern as the project pipeline, evaluating predicates against each record and creating a new filtered record based on the results. The implementation supports compound predicates with AND logic. This implementation provides a foundation for more advanced filtering operations as the expression evaluator is enhanced to support more complex expressions.	11 months ago
renovate[bot]	fc14fcc821	chore(deps): update dependency vite to v6.3.3 (main) (#17434) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Ed Welch	d660af37fb	fix: better fix integer overrun when calculating parallelism for very long time range queries (#17430)	11 months ago
Ed Welch	82acbd58b2	fix: fix integer overrun when calculating parallelism for very long time range queries (#17428)	11 months ago
George Robinson	32745b890c	chore: small test fixes (#17416)	11 months ago
George Robinson	d618cd4ef6	chore: improve the test coverage for ring.go (#17415)	11 months ago
Footur	ba8830b080	docs: Document the default value for the working_directory for compactor (#17075) ... Signed-off-by: Footur <3769085+Footur@users.noreply.github.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	11 months ago
George Robinson	4a733fcf7d	feat: add method to get zone-aware partition consumers (#17377)	11 months ago
Periklis Tsirakidis	434e906660	fix(ingest-limits): Disable auto commiting records (#17409)	11 months ago
aarogoss	01cf36df78	feat: adds partition-ingester push latency histogram (#17385)	11 months ago
renovate[bot]	3c741be39e	fix(deps): update dependency react-hook-form to v7.56.1 (main) (#17394) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	34e70ace25	fix(deps): update dependency @tanstack/react-query-devtools to v5.74.6 (main) (#17393) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	1af41c4ebd	fix(deps): update dependency @radix-ui/react-toast to v1.2.11 (main) (#17390) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	72d78ceffc	fix(deps): update dependency @radix-ui/react-tooltip to v1.2.4 (main) (#17391) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	23a2f2d0ef	fix(deps): update dependency @radix-ui/react-tabs to v1.1.9 (main) (#17389) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	80e12d9635	fix(deps): update dependency @radix-ui/react-hover-card to v1.1.11 (main) (#17386) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	86bf1e915e	fix(deps): update dependency @radix-ui/react-scroll-area to v1.2.6 (main) (#17388) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	b09c54bb91	fix(deps): update dependency @radix-ui/react-popover to v1.1.11 (main) (#17387) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Ed Welch	3d8d822b6e	chore: adds a simple noop object client (#17365)	11 months ago
renovate[bot]	f7252dc605	fix(deps): update dependency @radix-ui/react-dropdown-menu to v2.1.12 (main) (#17384) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
George Robinson	846c834975	chore: improve ring_test.go (#17380)	11 months ago
renovate[bot]	6cb79a530b	fix(deps): update dependency @radix-ui/react-checkbox to v1.2.3 (main) (#17381) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	0a4aec6ea7	fix(deps): update dependency @radix-ui/react-collapsible to v1.1.8 (main) (#17382) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	ee9e1d030b	fix(deps): update dependency @radix-ui/react-dialog to v1.1.11 (main) (#17383) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
George Robinson	e6d8a225ec	fix: evict the limits cache once half the TTL has elapsed (#17337)	11 months ago
renovate[bot]	ef2bc84957	chore(deps): update dependency eslint-plugin-react-refresh to v0.4.20 (main) (#17369) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	98c28a5359	chore(deps): update dependency @typescript-eslint/parser to v8.31.0 (main) (#17368) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
aarogoss	ab65ac5e8e	feat: refactors kafka/client to improve metric collection (#17308)	11 months ago
renovate[bot]	8714f36ff4	chore(deps): update dependency @typescript-eslint/eslint-plugin to v8.31.0 (main) (#17367) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	a85a0c705b	chore(deps): update dependency eslint to v9.25.1 (main) (#17366) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	91754ae050	fix(deps): update dependency lucide-react to ^0.503.0 (main) (#17361) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
Ed Welch	87922da28d	fix: improve structured metadata label normalization performance (#17332)	11 months ago
renovate[bot]	2c27a58844	fix(deps): update dependency react-hook-form to v7.56.0 (main) (#17357) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago
renovate[bot]	3610c1437a	fix(deps): update dependency @radix-ui/react-toggle-group to v1.1.7 (main) (#17356) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	11 months ago