4948 Commits (0edc65d96e95331b094b120a07fe2ea3e4281c3c)

Author	SHA1	Message	Date
Ed Welch	657d9ac55f	chore: add stream count to metrics.go for queriers (#20215)	5 months ago
Ashwanth	e08721487c	chore: compute stats summary in query engine scheduler (#20222)	5 months ago
Robert Fratto	0c9dd8b7b7	chore(engine): update how scheduler tracks readiness (#20225) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	5 months ago
benclive	ea88458c03	fix(enginev2): Always compute summary when creating the stats object (#20224)	5 months ago
Assel Meher	de092daf0a	feat: Handle state change lock in prepare downscale (#20141)	5 months ago
Ashwanth	beb1728870	chore: stop adding plans to span events (#20219)	5 months ago
Robert Fratto	c57dc2cac8	chore(querier): fix engine router splitting logic (#20217) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	5 months ago
Robert Fratto	1272bbb384	chore(engine): send structured errors over the wire (#20211) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	5 months ago
Robert Fratto	9dc824bf7f	chore(engine): specify invalid time range (#20207) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	5 months ago
George Robinson	a03e00a3bc	chore: better comments when end offset is zero (#20196)	5 months ago
George Robinson	333da739c7	feat: add processed records metric (#20191)	5 months ago
benclive	f22e854dea	chore: Dispatch tasks more frequently (#20195)	5 months ago
Ashwanth	833b4e1690	chore: revert change to shrink v2 split (#20190)	5 months ago
Trevor Whitney	43a3f159b3	fix: persist correct goldfish result comparison in database (#20172)	5 months ago
George Robinson	c0c27b3596	feat: add downscalePermittedFunc to check downscale is permitted (#20171)	5 months ago
nicolevanderhoeven	7f47dddb3a	ci: Remove Helm 4 verification and fix flaky ruler test (#20178) ... Signed-off-by: J Stickler <julie.stickler@grafana.com> Co-authored-by: JStickler <4106682+JStickler@users.noreply.github.com> Co-authored-by: J Stickler <julie.stickler@grafana.com>	5 months ago
Ashwanth	c6d6bfc0b6	chore: xcap summary treat duration observation values as seconds (#20175)	5 months ago
Julien Pinsonneau	0c3dd8ce7e	fix: compactor file descriptor leak (#20077)	5 months ago
Ashwanth	5bbb50562a	chore: improvements to v2 engine split range (#20174)	5 months ago
George Robinson	23ef8eccce	feat: add gauge to track in-flight bytes (#20091)	5 months ago
Trevor Whitney	aab9e46bcf	feat: implement query splitting in the query-tee (#20039)	5 months ago
renovate-sh-app[bot]	0aac50bffb	fix(deps): update module github.com/prometheus/prometheus to v0.308.0 (main) (#20131) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: Paul Rogers <paul.rogers@grafana.com>	5 months ago
Trevor Whitney	8156f809e3	chore: add shared vscode launch config (#20103)	5 months ago
Ashwanth	9bd5d6a7d0	chore: revert dropping spans generated by gcs storage clients (#20133)	5 months ago
Ashwanth	635934869d	chore: include execution stats in `finished executing` log line (#20132)	5 months ago
Ashwanth	16df5f2f66	chore: set Dataobj logql stats from xcap (#20126)	5 months ago
Christian Haudum	0046bfb3a4	fix: Do not override S3 region if already specified in configuration chain (#20127) ... The region (and other settings) for the S3 configuration can be specified in various ways. When the region was already set by LoadDefaultConfig it should not be set to InvalidAWSRegion. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	5 months ago
Christian Haudum	326c7d1ea0	feat: Client side index gateway shuffle sharding (#20124) ... This PR adds the functionality to add a client-side shuffle sharding for index gateway requests. The per-tenant configuration index_gateway_max_capacity defines a fraction (0.0 to 1.0) of index gateways that become available for each tenant. The client uses the jumphash of the tenant ID to achieve greatest possible consitant hashing without using a server-side, statefule hash ring. This will allow to distribute workloads from different tenants across all index gateway instances and prevent individual tenants from overloading all index gateways. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	5 months ago
Ed Welch	0ecb4fb745	chore: improve metrics.go stats logging to include bloom filter time as well as fix missing size info in query-frontend (#20093)	5 months ago
Robert Fratto	2d54ddc6d9	chore(engine): adjustments to log task short circuiting (#20121)	5 months ago
Christian Haudum	d3f9532b06	fix: Fix regression in S3 client configuration (#20110) ... ### Summary This PR fixes a regression in how Loki's S3 configuration options are handled to create the S3 client which was introduced with the upgrade of the AWS SDK from v1 to v2 (#19205). With the v1 SDK the `s3` field of the `aws` configuration block was parsed to extract credentials, region, host, and schema. ``` storage_config: aws: s3: s3://<accesskey>:<secret>@<endpoint_or_region>/<bucketnames> ``` After the upgrade, only credentials were extraced, leaving all other parts of the URL as default, which would require explicit overrides. This was a breaking change and not documented in the upgrade notes. We want to keep backwards compatibility, even though the Thanos object client is going to supersed the custom S3/GCS/... clients. ref: #19908 Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	5 months ago
Ashwanth	54f9723af1	chore(xcap): adds exporter to summarise capture as a structured log line (#20099)	5 months ago
Ashwanth	356cd36d8e	chore: close stream section reader (#20107)	5 months ago
Ashwanth	728b308edf	chore: update read stats to use xcap (#20095)	5 months ago
Ashwanth	cbad9d4ccb	chore(xcap): support events, status and improve coverage (#20096)	5 months ago
benclive	99ba51e48a	fix(enginev2): Close pipeline before building query results (#20100)	5 months ago
Ashwanth	484299df05	chore(xcap): Adds wrapper around bucket client to track operations (#20094)	5 months ago
Ivan Kalita	827292d8ed	chore(metastore): add columnar indexpointers reader (#20068) ... Similar to https://github.com/grafana/loki/pull/20053 and https://github.com/grafana/loki/pull/19992 I add a columnar reader for index pointers sections.	5 months ago
benclive	0dea806656	fix: Respect categorizeLabels encoding flag in v2 queries (#20098)	5 months ago
benclive	448cc745ca	fix: Restrict start/end timestamp to requested range for scheduler (#20086)	5 months ago
Francisco Robles Martín	129ebd696d	docs: Fix max_line_size default behavior comment (#20067) ... Signed-off-by: Francisco Robles Martín <f.robles.martin@pm.me> Co-authored-by: J Stickler <julie.stickler@grafana.com>	5 months ago
Ivan Kalita	ee58c333b3	chore(metastore): use column reader for blooms (#20053) ... This PR is a continuation of https://github.com/grafana/loki/pull/19992. I use `pointers.Reader` to refine the sections that match bloom filters. I also fix minor issues that I introduced in the previous PR: - convert the columns only once per column (instead of doing it for every row) - ignore the sections that are of a wrong "type"	5 months ago
Ed Welch	6a81802aff	chore: add stream count and result information to metrics.go (#20055)	5 months ago
Robert Fratto	688dd2006e	chore: expose native histogram for HTTP server metrics (#20056)	5 months ago
benclive	225a0595ac	chore: Define an E2E ingestion processing time metric (#20054)	5 months ago
Ivan Kalita	3559d4bd42	chore(metastore): add column reader for pointers section (#19992) ... Adding columnar reader for (log)pointers section. Using it to read the stream section pointers. New reader is slower than existing RowReader due to double-translation of the data (columns->rows->rows vs columns->rows->columns->rows). The idea though is to get rid of the double-translation in the future.	5 months ago
benclive	044ded2e29	chore: Split indexing into distinct steps (#19987)	5 months ago
benclive	2ce207fbdb	chore: Use shared zstd encoders during dataobj build (#20044)	5 months ago
Christian Haudum	8b59b944f2	chore(dataobj): Use common base config for indexobj and logsobj builders (#20037) ... Use the same config struct for both the indexobj builder and the logsobj builder, since they are configured identically, only with different default values.	5 months ago
Christian Haudum	85573045a3	chore(engine): Clean up query engine configuration (#20049) ... chore(engine): More coherent naming of config options chore(engine): Remove duplicate engine configuation The configuration options `dataobj_storage_lag` and `dataobj_storage_start` have been registered twice, once under `query_engine.executor` and a second time under `querier`. chore(engine): Move configuration options Move configuration options for the next generation query engine that were previously located under `query_range` into `query_engine`. chore(engine): Re-organize configuration for next generatio query engine Organize the configuration settings in the config.yaml under `query_engine`, rather than under `querier.engine_v2`. Respectively change the CLI argument prefix from `-querier.engine-v2.*` to `-query-engine.*`.	5 months ago