619 Commits (79eae2ca25c8faa262c246bafcf913eb4e8fd2c3)

Author	SHA1	Message	Date
renovate-sh-app[bot]	563ddfddce	chore(deps): update memcached docker tag to v1.6.40 (main) (#20335) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com>	4 months ago
renovate-sh-app[bot]	9e4c382d1f	chore(deps): update alpine docker tag to v3.23.2 (main) (#20148) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com>	4 months ago
Ivan Kalita	08e3c4385f	feat(metastore): shard sections queries over index files (#20134) ... Running metastore queriesin a distributed manner using query engine workers: - Build a distributed metastore plan from GetIndexes and execute it via the v2 scheduler/worker pipeline - Split the request into per-index PointersScan tasks, then fan-in and CollectSections to produce final section descriptors - Add physical plan + protobuf support for Merge/PointersScan, improve tracing/cleanup, and add coverage for planner/workflow/proto roundtrips	4 months ago
Ivan Kalita	9be17c7a42	feat(metastore): metastore DI (#20253) ... This commit fixes a problem that happens when we instantiate 2 metastores in a single process. Even though this can't happen at the moment it will be the case once we introduce distributed metastore queries - when running both schedulers and workers in the same process all of them will need an instance of metastore. Each instance (before this PR) internally creates and registers metastore metrics which causes panic due to exactly the same metrics were already registered by the same registerer. I attempt to fix this problem via creating and registering metastore metrics only once.	4 months ago
Ivan Kalita	e4ec8441d3	feat(metastore): use arrow for scanning and blooms (#20234) ... Changing metastore implementation to work with arrow.RecordBatch without intermediate materialization to structs. metastore.Sections now uses new metastore.GetIndexes, metastore.IndexSectionsReader and metastore.CollectSections. We'd like to run metastore queries in a distributed manner using engine v2. In order to achieve that we need to split the work that metastore.Sections does internally, schedule it on different workers, and collect the results. The engine achieves that via pipelines that produce arrow.RecordBatch-es. In this PR the metastore.Sections is updated such a way to make it easier to integrate metastore with the engine.	4 months ago
Trevor Whitney	014520a3d8	feat: add race tolerance to query-tee (#20228) ... Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	4 months ago
Ashwanth	c6f0378762	chore(querytee): return valid staus code when req fails (#20220)	4 months ago
Trevor Whitney	0a34e25dea	fix: use the default downstream handler for unsupported requests (#20202) ... Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	4 months ago
Trevor Whitney	b9c7dddac4	fix: apply missing middlewares to query-tee (#20184)	4 months ago
Trevor Whitney	43a3f159b3	fix: persist correct goldfish result comparison in database (#20172)	5 months ago
Ashwanth	2bc72d94b6	chore(querytee): add metric to track requests received (#20177)	5 months ago
renovate-sh-app[bot]	b2758810ce	chore(deps): update jaegertracing/all-in-one docker tag to v1.76.0 (main) (#20147) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com>	5 months ago
Trevor Whitney	d7c1e1daa6	fix: remove logging of sensitive data (#20168)	5 months ago
Robert Fratto	ea31e73ac8	chore(querytee): fix recursive key in logger (#20167)	5 months ago
Trevor Whitney	495ad98afa	chore: improve error logging/resp in querytee (#20165)	5 months ago
Ashwanth	23948c40bd	feat: enable racing in the querytee (#20156) ... Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	5 months ago
Trevor Whitney	aab9e46bcf	feat: implement query splitting in the query-tee (#20039)	5 months ago
John Newbigin	581519e386	fix(goldfish): add tolerance check to mismatches in the query-tee (#20004)	5 months ago
Christian Haudum	8b59b944f2	chore(dataobj): Use common base config for indexobj and logsobj builders (#20037) ... Use the same config struct for both the indexobj builder and the logsobj builder, since they are configured identically, only with different default values.	5 months ago
Robert Fratto	2b2f00f24c	fix(querytee): forward response headers from backends (#20036)	5 months ago
renovate-sh-app[bot]	e5daa0dd7e	chore(deps): update jaegertracing/all-in-one docker tag to v1.75.0 (main) (#19976) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com>	5 months ago
renovate-sh-app[bot]	8f30364af2	chore(deps): update terraform google to v7.12.0 (main) (#19969) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com>	5 months ago
renovate-sh-app[bot]	39279b3fa7	chore(deps): update terraform google to v7.11.0 (main) (#19849) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com>	5 months ago
renovate-sh-app[bot]	33a4755db5	chore(deps): update terraform google to v7.10.0 (main) (#19772) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com>	6 months ago
renovate-sh-app[bot]	1a4c8793fa	chore(deps): update alpine docker tag to v3.22.2 (main) (#19739) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com>	6 months ago
Robert Fratto	8076ed1086	chore: bump go.mod to use Go 1.25 (#19723)	6 months ago
Trevor Whitney	b2396e1fb8	fix: expose RDS args for goldfish ui (#19724)	6 months ago
Assel Meher	a43cbab842	chore: explicitly set ingester.lifecycler.id in kafka local dev config (#19716)	6 months ago
Trevor Whitney	c22e05c1f9	feat(goldfish): mv comparison_status to db, add stats endpoint (#19698) ... Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	6 months ago
Trevor Whitney	e17ae2d98f	feat(goldfish): add endpoints for serving stored results (#19640)	6 months ago
Robert Fratto	75e5193a97	chore(engine): expose new scheduler and worker (#19633) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	6 months ago
JordanRushing	0291c521d8	feat(goldfish): Add support for query results in object storage (#19410) ... Signed-off-by: Jordan Rushing <rushing.jordan@gmail.com> Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	6 months ago
benclive	b3a2e867cd	chore: Add debug tooling to compare Loki query output (#19587)	6 months ago
George Robinson	977fb2ba6f	feat: consume single topics in dataobj-consumer using partition ring (#19186)	6 months ago
Jackson Coelho	352c046094	fix(build): rpm signature config (#19476)	7 months ago
Sandeep Sukhani	a935a63abb	chore: add support for fetching chunks with sizing info from the index to optimize GetShards calls (#19221) ... Signed-off-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
renovate[bot]	81acdef26e	chore(deps): update terraform google to v7.6.0 (main) (#19413) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	7 months ago
renovate[bot]	53c87b2558	chore(deps): update jaegertracing/all-in-one docker tag to v1.74.0 (main) (#19385) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	7 months ago
renovate[bot]	6fb38662e4	chore(deps): update terraform google to v7.5.0 (main) (#19367) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	7 months ago
renovate[bot]	c3882ab899	chore(deps): update jaegertracing/all-in-one docker tag to v1.73.0 (main) (#19299) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	7 months ago
renovate[bot]	60199992cd	chore(deps): update memcached docker tag to v1.6.39 (main) (#18650) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com> Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	7 months ago
renovate[bot]	8389eef6e7	chore(deps): update terraform google to v7 (main) (#19030) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	7 months ago
Christian Haudum	a3017f2b13	chore(dataobj-consumer): Sort logs object-wide (#19231) ... Sorting logs globally (object-wide per tenant) removes overlapping time ranges of sections in the objects. Sections contain logs from multiple streams, and the ingest lag of streams may vary. This means that although logs of individual sections are sorted by timestamp, the overall sorting of logs is not guaranteed. Therefore sections are sorted with a k-way merge (SortMerge), which does over-query data in case the query would reach its result limit early. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Trevor Whitney	cb3f2ad5b6	feat: capture logs drilldown flag in query samples (#19242)	7 months ago
Sophie Waldman	98b411a649	chore(linter): Fix issues flagged by updated golangci-lint version (#19206)	7 months ago
Trevor Whitney	89509dee9a	feat(goldfish): improve query performance with indexes and paritions (#19023)	8 months ago
cui	14ef18c3b2	refactor(tools): using reflect.TypeFor (#18991) ... Try to use better API `reflect.TypeFor` instead of `reflect.TypeOf` when we have known the type. Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
JordanRushing	86c81e880a	chore(querytee): Fix flaky proxy endpoint test panic (#19019) ... Signed-off-by: Jordan Rushing <rushing.jordan@gmail.com>	8 months ago
renovate[bot]	7c7df2e30c	chore(deps): update terraform google to v6.49.2 (main) (#18982) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>	8 months ago
Trevor Whitney	6df7c6291b	fix: Goldfish context cancellation and child spans (#18837) ... Co-authored-by: Claude <noreply@anthropic.com>	8 months ago