76 Commits (867ce3d711f3b9e823e8eb9b61c076acca339096)

Author	SHA1	Message	Date
Shantanu Alshi	867ce3d711	chore(level_detection): Make log level detection configurable (#14784)	7 months ago
Karsten Jeschkies	7b53f20f70	feat: Introduce shardable probabilistic topk for instant queries. (#14243) ... Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Callum Styan <callumstyan@gmail.com>	7 months ago
Trevor Whitney	c1fde26730	feat: move metric aggregation to a per-tenant config (#14709)	7 months ago
Trevor Whitney	f2a16f43b2	feat: add app_name as a service label (#13660)	7 months ago
Nikolay Andreev	b7ac5b4dcd	docs: add info about remotewrite client config in ruler (#14401) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	7 months ago
Ashwanth	8bca2e7608	feat(ruler): enables ruler store that uses clients from thanos-io/objstore pkg (#11713)	7 months ago
Vladyslav Diachenko	a962edba33	feat(loki): include structured_metadata size while asserting rate limit (#14571) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	7 months ago
Ashwanth	cff9f43dd6	fix(s3): disable client retries when congestion control is enabled (#14588)	7 months ago
Salva Corts	673ede16a5	feat: New bloom planning using chunk size TSDB stats (#14547)	7 months ago
Ashwanth	b405ae8557	chore: hide docs for thanos clients + restore original cli prefix (#14545)	7 months ago
Joao Marcal	c059ace53e	feat(storage): GCS backend using thanos.io/objstore (#11132) ... Signed-off-by: Joao Marcal <jmarcal@redhat.com> Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Signed-off-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Signed-off-by: Ashwanth Goli <iamashwanth@gmail.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: Ashwanth <iamashwanth@gmail.com>	7 months ago
Paul Rogers	71d1c6bcd4	docs: Pre-format example for named_stores_config (#14524)	7 months ago
Salva Corts	ab5e6eaaee	feat: Extract task computing into a strategy interface (#13690)	7 months ago
benclive	e2a209c076	feat(kafka): Add support for SASL auth to Kafka (#14487)	7 months ago
benclive	61aa418bb5	chore: Rename new querier flag to use dashes (#14438)	8 months ago
benclive	633bb5eb7e	feat(kafka): Enable querier to optionally query partition ingesters (#14418)	8 months ago
benclive	39b57ec4ea	feat(kafka): Replay kafka from last commit before allowing ingesters to become ready (#14330)	8 months ago
Christian Haudum	46f61fd5ad	chore: Remove ring client pool from JumpHashClientPool (#14367) ... The ring client pool has functionality, such as periodic health checking of the servers and removing of stale clients, which is not needed in the JumpHashClientPool. The removal of stale clients was problematic, because it compared the original server list (which is a list of CNAME records from the DNS lookup) with the client cache, which uses the IP of the server as key. Therefore it removed all cached clients on every check interval. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Cyril Tovena	1a4436c417	feat(ingester): implement partition shuffle sharding for ingester (#14304)	8 months ago
Cyril Tovena	f80d68a1ed	feat(distributors): Use a pool of worker to push to ingesters. (#14245)	8 months ago
Cyril Tovena	b6e9945f83	feat(kafka): Add Ingestion from Kafka in Ingesters (#14192) ... Co-authored-by: Joao Marcal <joao.marcal12@gmail.com> Co-authored-by: benclive <ben.clive@grafana.com>	8 months ago
benclive	7c78232ad3	feat: Optionally require writes to kafka on Push requests (#14186)	8 months ago
Christian Haudum	2840d48b92	chore: Clean up unused bloom filter related code (#14183) ... This PR tries to eliminate dead code in the bloom package, mainly related to line tokenization. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	8 months ago
Vladyslav Diachenko	31368806a9	feat: add backoff mechanism to the retention process (#14182) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	8 months ago
Cyril Tovena	44958c4b8b	chore(kafka): Refactor configurations and remove old modules (#14161)	8 months ago
Cyril Tovena	d178f4c7e2	feat: Implement WAL segment ingestion via Kafka with partition ring (#14043) ... Co-authored-by: George Robinson <george.robinson@grafana.com>	8 months ago
Sven Grossmann	0780456662	feat(max-allowed-line-length): add config to set `max-allowed-line-length` in pattern ingester (#14070) ... Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	9 months ago
Paul Rogers	73cbbb0f22	feat: add retries for s3 ObjectExists calls (#14062) ... **What this PR does / why we need it**: It was determined via careful examination that Loki would issue retries for S3 `GetObject` calls, but would not retry calls to `ObjectExists`. For transient issues (e.g. rate-limiting), it makes sense to retry the command to see if an object does exist. If the object is not found (meaning, a 404 return code, and a successful query of the S3 storage to show the object does not exist), the retries are not leveraged, as it is not needed.	9 months ago
Trevor Whitney	4f962ef7af	fix: enable service detection for otlp endoint (#14036) ... Co-authored-by: Sven Grossmann <Svennergr@gmail.com> Co-authored-by: Ashwanth <iamashwanth@gmail.com> Co-authored-by: JordanRushing <rushing.jordan@gmail.com>	9 months ago
benclive	33c26f4dd1	feat: Add initial support for a kafka-based ingest path (#13992) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	9 months ago
Ned Andreev	f9824b7895	chore: update dskit and thanos/objstore (#13998)	9 months ago
Christian Haudum	b75eacc288	chore(blooms)!: Remove bloom compactor component (#13969) ... **What this PR does / why we need it**: This commit removes the code related to the bloom compactor which is superseded by the bloom planner and builders. A handful of CLI arguments of per-tenant settings changed their prefix from `-bloom-compactor.*` to `-bloom-build.*`. Other settings for the compactor component itself, also prefixed with `-bloom-compactor.*` were removed. See upgrade docs for further information. **Special notes for your reviewer**: ✔️ Part of https://github.com/grafana/loki/issues/13957 📔 Documentation update https://github.com/grafana/loki/pull/13965 ⚠️ Integrating the bloom planner and builder into the `backend` target is done in a follow-up PR. --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	9 months ago
Salva Corts	b5ac6a0258	feat: Limit to block ingestion until configured date (#13958)	9 months ago
Paul Rogers	8fb7b488bd	chore(deps): update dskit 20240819 (#13924)	9 months ago
Trevor Whitney	913e9f9347	feat: aggregate byte and count metrics (#13731)	9 months ago
Trevor Whitney	c6ab6b31e8	chore: remove initial metric aggregation experiment (#13729)	9 months ago
Vladyslav Diachenko	bb257f54b3	feat(loki): add ability to disable AWS S3 dualstack endpoints usage (#13785) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	10 months ago
George Robinson	62c5c5c641	fix: add missing flush op timeout (#13679)	10 months ago
benclive	7553775d72	chore: Remove client header interceptors from metastore client (#13659)	10 months ago
benclive	3a99b69ae5	feat: Add baseline rf1 querier implementation (#13639) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	10 months ago
Cyril Tovena	0b474981dc	feat: Bootstrap metastore for wal segments (#13550)	10 months ago
benclive	c0f5fb6e4d	chore: Clean up old streams periodically in RF-1 ingester (#13511)	10 months ago
George Robinson	c4405fe1c4	feat: WAL Manager configuration options (#13531)	10 months ago
Trevor Whitney	2c053ee00c	feat: downsample aggregated metrics (#13449)	11 months ago
Salva Corts	2cc901ad69	refactor(blooms): Apply retention in planner (#13484)	11 months ago
Cyril Tovena	e08b4a7f88	feat: Pattern ingesters add a limiter for high eviction rate (#13464)	11 months ago
Salva Corts	47f6ea53fc	feat(loki): Do not enforce max-query-bytes-read and max-querier-bytes-read in limited tripperware (#13406)	11 months ago
George Robinson	7f35179cd3	feat: Ingester RF-1 (#13365)	11 months ago
Paul Rogers	40ee766724	feat: Collect duplicate log line metrics (#13084)	11 months ago
Salva Corts	8ebce009f3	refactor(blooms): Implement retry in builder (#13306)	11 months ago