Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Christian Haudum 27411cff08 Introduce worker queue in bloom gateway (#10976) ... Instead of calling the bloom store directly on each and every request to filter chunk refs based on the given filters, we want to queue requests in per-tenant queues and process batches of requests that can be multiplexed to avoid excessive seeking in the bloom block queriers when checking chunk matches. This PR re-uses the request queue implementation used in the query scheduler. To do so, it moves the queue related code from the scheduler into a separate package `pkg/queue` and renames occurrences of "querier" to "consumer" to be more generic. The bloom gateway instantiates the request queue when starting the service. The gRPC method `FilterChunkRefs` then enqueues incoming requests to that queue. **Special notes for your reviewer**: For testing purposes, this PR also contains a dummy implementation of the workers. The worker implementation - which includes multiplexing of multiple tasks - is subject to a separate PR. --------- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>		2 years ago
..
analytics	Update dskit to 7b512eb. (#10927)	2 years ago
bloomcompactor	Unify ring managers across components (#10931)	2 years ago
bloomgateway	Introduce worker queue in bloom gateway (#10976)	2 years ago
canary	clients,pkg: use http.NewRequestWithContext (#10616)	2 years ago
chunkenc	Format + Library for building bloom filter "blocks" from chunks (#10780)	2 years ago
compactor	Unify ring managers across components (#10931)	2 years ago
configs	Upgrade dskit to use packages migrated from weaveworks/common (#10164)	2 years ago
distributor	Unify ring managers across components (#10931)	2 years ago
ingester	Add basic structure of bloom gateways (#10782)	2 years ago
iter	renamed `non indexed labels` feature to `structured metadata` (#10432)	2 years ago
logcli	chore(storage): Restructure shipper packages (#10729)	2 years ago
loghttp	Support protobuf `QueryRequest` in querier. (#10858)	2 years ago
logproto	Adjust bloom gateway request structure (#10926)	2 years ago
logql	Support case insensetive logql keywords (#10733)	2 years ago
logqlanalyzer	fixed logql-analyzer (#8258)	2 years ago
logqlmodel	renamed `non indexed labels` feature to `structured metadata` (#10432)	2 years ago
loki	Unify ring managers across components (#10931)	2 years ago
lokifrontend	Introduce worker queue in bloom gateway (#10976)	2 years ago
push	chore(deps): update module golang.org/x/net to v0.17.0 [security] (main) (#10831)	2 years ago
querier	Loki: introduce an exponential backoff on failed query retries. (#10959)	2 years ago
queue	Introduce worker queue in bloom gateway (#10976)	2 years ago
ruler	ruler: Support `writeNotify` on Loki ruler (#10906)	2 years ago
runtime	Loki: Implement initial phase of `limited_log_push_errors` (#9556)	2 years ago
scheduler	Introduce worker queue in bloom gateway (#10976)	2 years ago
server	Upgrade dskit to use packages migrated from weaveworks/common (#10164)	2 years ago
sizing	fix xss vulnerability (#10559)	2 years ago
storage	Add NewBlockOptions constructor (#10955)	2 years ago
tracing	Promtail: Add basic tracing support (#7414)	3 years ago
util	Introduce worker queue in bloom gateway (#10976)	2 years ago
validation	Add basic structure of bloom gateways (#10782)	2 years ago