614 Commits (bd20171975e913e429048a0a30328811fc4c8a87)

Author	SHA1	Message	Date
Sven Grossmann	4f534d7317	feat(detected-labels): remove cardinality filter (#13652)	2 years ago
Sven Grossmann	2642718d50	fix: remove limit middleware for `detected_labels` (#13643)	2 years ago
benclive	3a99b69ae5	feat: Add baseline rf1 querier implementation (#13639) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	2 years ago
Cyril Tovena	5f5fd4e4ab	feat(rf1): Store index ref in metastore (#13613)	2 years ago
Sven Grossmann	ce02cc254a	feat(structured-metadata-api): add structured metadata to `/detected_fields` API (#13604)	2 years ago
Ed Welch	10083159a7	fix: remove retries on the stats handlers because they already retry (#13608) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	2 years ago
Ed Welch	d3e1edbf11	fix: fix retry code to handle grpc status codes. updated newer stats retries to be wrapped with spans (#13592) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	2 years ago
Ed Welch	7232795e1f	fix: add a retry middleware to all the stats handlers (#13584) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	2 years ago
Ed Welch	6631c0f01d	chore: shard limited queries with a fixed sharding factor (#13576) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	2 years ago
Cyril Tovena	4451d56d6b	fix: Fixes span name of serializeRounTripper (#13541)	2 years ago
Trevor Whitney	f6a94d3034	fix: detected fields incorrect type bug (#13515)	2 years ago
Ashwanth	221491c123	fix(log results cache): include pipeline wrapper disabled in cache key (#13328)	2 years ago
Christian Haudum	ce71f1cf95	feat(api)!: Fail log queries when executed on instant query endpoint (#13421) ... ### What this PR does / why we need it **Background** A log selector expression is a LogQL expression that returns logs, in contrast to a sample expressions, which returns metrics (samples). The simplest form of log selector expressions are label matchers, e.g. `{env="prod"}`. **Change** This PR changes the behaviour of Loki so that the instant query endpoint `/api/v1/query` does not allow sending a log selector expression as query any more. Instead, it returns a status code 400 (Bad Request) with the error message **"log queries are not supported as an instant query type, please change you query to a range query type"**. **Why** Previously this API endpoint allowed these types of log queries, but returned inconsistent results, which where a major cause for confusion. Returning a concise error helps the user understand that they likely selected the wrong query type in Grafana when executing the query. --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Cyril Tovena	1fa5127797	fix: Remove query size limit for detected fields (#13423)	2 years ago
Cyril Tovena	0076bbdb42	chore: Refactor storage interface for rf1 (#13415)	2 years ago
Salva Corts	47f6ea53fc	feat(loki): Do not enforce max-query-bytes-read and max-querier-bytes-read in limited tripperware (#13406)	2 years ago
George Robinson	7f35179cd3	feat: Ingester RF-1 (#13365)	2 years ago
Christian Haudum	d8cc1cea83	chore: Make dedicated iterator package (#13273) ... Iterators of various types are widely used throughout the Loki code base. With the recent code additions of the bloom filters, a new set of utility functions for iterators emerged in `github.com/grafana/loki/v3/pkg/storage/bloom/v1`. The package defines interfaces for various common types, but also provides implementations to create and compose new iterators that implement these interfaces. This new package uses Go Generics. - However, at the current state, there are multiple iterator interfaces and implementations, which adds cognitive overhead in understanding how they work and which ones should be used. The idea is to unify them into a single iterator lib for Loki. - As a first step towards a single iterator library for the Loki code base, this PR moves the utilities from the `pkg/storage/bloom/v1` package to the `pkg/iter/v2` package. - Second, it changes the existing `EntryIterator` and `SampleIterator` iterators to "inherit" `v2.CloseIterator` in order to expose the same function names. - And lastly, naming conventions of iterator interfaces and structs are unified. The basic iterator interface (defined in `pkg/iter/v2/interface.go`) looks like so: ```go // Usage: // // for it.Next() { // curr := it.At() // // do something // } // if it.Err() != nil { // // do something // } type Iterator[T any] interface { Next() bool Err() error At() T } ``` --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Ashwanth	a457c5d171	fix(retry): fix retries when using protobuf encoding (#13316)	2 years ago
Dylan Guedes	4eb45cc588	refactor: Introduce context cause to our code (#13224) ... Introduce the usage of Go new `WithCause` functions to make our context cancellation errors more descriptive.	2 years ago
Dylan Guedes	c1fada9af0	refactor: Remove unnecessary spanlogger usage (#13255) ... Historically, we've been using `spanlogger` to enrich our spans. That isn't the right usage for it (as of now), as they'll be emitting log lines. Our current usage is causing: - Noisy/important log lines less visible - Unnecessary logging volume - Spread of the bad practice. With this PR I'm moving away from `spanlogger` all places where the log message is too bad or nonexistent. That's because these cases are indicating we don't care about that log line at all, and only about the data injected in the span.	2 years ago
Trevor Whitney	467eb1bb1b	feat: collect and serve pre-aggregated bytes and counts (#13020) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	2 years ago
JordanRushing	e7689b248d	feat: add recalculateOwnedStreams to check stream ownership if the ring is changed (#13103) ... Signed-off-by: JordanRushing <rushing.jordan@gmail.com> Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com> Co-authored-by: Vladyslav Diachenko <vlad.diachenko@grafana.com> Co-authored-by: Vladyslav Diachenko <82767850+vlad-diachenko@users.noreply.github.com>	2 years ago
benclive	740551bb31	fix: Correctly encode step when translating proto to http internally (#13171)	2 years ago
Ed Welch	bb864b3ad6	fix: add retry middleware to the "limited" query roundtripper (#13161) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	2 years ago
Sven Grossmann	8be8364435	feat(detected-labels): include labels with cardinality > 1 (#13128) ... Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	2 years ago
Yuri Kotov	808425953f	feat: API: Expose optional label matcher for label names API (#11982) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	2 years ago
Karsten Jeschkies	6e4555010e	fix: Introduce feature flag for [last|first]_over_time sharding. (#13067)	2 years ago
Trevor Whitney	ca030a5c43	fix: change log level since this is a known case (#13029)	2 years ago
Ashwanth	1f5291a4a3	fix(indexstats): do not collect stats from "IndexStats" lookups for other query types (#12978)	2 years ago
Kaviraj Kanagaraj	88e545fc95	feat(cache): Add `Cache-Control: no-cache` support for Loki instant queries. (#12896) ... Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	2 years ago
Shantanu Alshi	e7fdeb974a	perf: Improve Detected labels API (#12816)	2 years ago
Shantanu Alshi	3cc28aaf0e	fix: panics when ingester response is nil (#12946)	2 years ago
jackyin	a46d14fb05	fix: Optimize regular initialization (#12926)	2 years ago
Dylan Guedes	18a558c7fd	docs: Don't allow running new and old querier worker grpc clients (#12916)	2 years ago
Sven Grossmann	19fef9355f	feat(detectedFields): Support multiple parsers to be returned for a single field (#12899)	2 years ago
Dylan Guedes	7b6f0577c3	feat: Querier: Split gRPC client into two. (#12726) ... **What this PR does / why we need it**: Split the gRPC client used by the querier into two, one for the communication with the scheduler, the other for communicating with the query-frontend. - This change is retrocompatible: you don't have to change anything to keep existing behavior. - To configure the custom scheduler grpc client, you can use the new `query_scheduler_grpc_client` config or the new CLI flag `querier.scheduler-grpc-client` - If you'd like to configure your frontend grpc client using a better named section, you can use the new `query_frontend_grpc_client` instead of the old `grpc_client_config`. Just make sure you don't use both at the same time, it will result in an error. This work is necessary for configuring custom behavior between `querier<->scheduler` vs `querier<->frontend`. A use case is configuring mTLS when a different certificate is used by queriers, schedulers and frontends. You can only configure a single `server_name` with our current setup, making it impossible.	2 years ago
Owen Diehl	93aaf29e68	fix(spans): corrects early-close for a few spans (#12887)	2 years ago
Owen Diehl	c1d56c11d6	chore(instrumentation): reintroduce span propagation across scheduler boundaries (#12880)	2 years ago
Sven Grossmann	2b3ae48d9b	feat(detectedFields): add parser to response (#12872)	2 years ago
Owen Diehl	5a643c7115	chore: reduces span footprint + double recording (#12864) ... Trying to remove some cruft from traces.	2 years ago
Owen Diehl	bc78d13d9b	feat(blooms): compute chunks once (#12664) ... Signed-off-by: Owen Diehl <ow.diehl@gmail.com>	2 years ago
benclive	7b8533e435	feat: Add step param to Patterns Query API (#12703)	2 years ago
Trevor Whitney	af09f53a33	ci: release workflows get build image from makefile (#12778)	2 years ago
Shantanu Alshi	587a6d20e9	feat: Detected labels from store (#12441)	2 years ago
Trevor Whitney	f68d1f7faf	fix: make detected fields work for both json and proto (#12682)	2 years ago
Seiya	0eba448fc7	fix: crrect initialization of a few slices (#12674) ... Co-authored-by: Callum Styan <callumstyan@gmail.com>	2 years ago
Trevor Whitney	6c33809015	feat: split detected fields queries (#12491)	2 years ago
Owen Diehl	9c25985b97	feat(blooms): record time spent resolving shards (#12636)	2 years ago
Christian Haudum	2f24b670cb	chore: Restructure `indexgateway` component package (#12630) ... This PR moves code for the index gateway server and client components into the `pkg/indexgateway` directory, so it that the index gateway has its own top-level package like other components, such as ingester, distributor, querier, ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago