79 Commits (bc1794e9725e74bf38ad22dfd07b0f1133587110)

Author	SHA1	Message	Date
loki-gh-app[bot]	6eca16218e	docs: adding exceptions to Vale rule (backport release-3.3.x) (#15446) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	1 year ago
loki-gh-app[bot]	3161fdcc6d	fix: Improve docs for min and max table offsets (backport k227) (#14929) ... Co-authored-by: Salva Corts <salva.corts@grafana.com>	1 year ago
loki-gh-app[bot]	1f6828b25c	feat(blooms): disk-backed queue for the bloom-planner (backport k227) (#14927) ... Co-authored-by: Salva Corts <salva.corts@grafana.com>	1 year ago
loki-gh-app[bot]	98ad8c8b4a	refactor(blooms): Extract planner queue into pkg (backport k227) (#14925) ... Co-authored-by: Salva Corts <salva.corts@grafana.com>	1 year ago
loki-gh-app[bot]	02eb02458e	feat: Introduce shardable probabilistic topk for instant queries. (backport k227) (#14765) ... Co-authored-by: Karsten Jeschkies <karsten.jeschkies@grafana.com>	1 year ago
Trevor Whitney	c1fde26730	feat: move metric aggregation to a per-tenant config (#14709)	1 year ago
Trevor Whitney	f2a16f43b2	feat: add app_name as a service label (#13660)	1 year ago
Nikolay Andreev	b7ac5b4dcd	docs: add info about remotewrite client config in ruler (#14401) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	1 year ago
Ashwanth	8bca2e7608	feat(ruler): enables ruler store that uses clients from thanos-io/objstore pkg (#11713)	1 year ago
Vladyslav Diachenko	a962edba33	feat(loki): include structured_metadata size while asserting rate limit (#14571) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	1 year ago
Ashwanth	cff9f43dd6	fix(s3): disable client retries when congestion control is enabled (#14588)	1 year ago
Salva Corts	673ede16a5	feat: New bloom planning using chunk size TSDB stats (#14547)	1 year ago
Ashwanth	b405ae8557	chore: hide docs for thanos clients + restore original cli prefix (#14545)	1 year ago
Joao Marcal	c059ace53e	feat(storage): GCS backend using thanos.io/objstore (#11132) ... Signed-off-by: Joao Marcal <jmarcal@redhat.com> Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Signed-off-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Signed-off-by: Ashwanth Goli <iamashwanth@gmail.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: Ashwanth <iamashwanth@gmail.com>	1 year ago
Paul Rogers	71d1c6bcd4	docs: Pre-format example for named_stores_config (#14524)	1 year ago
Salva Corts	ab5e6eaaee	feat: Extract task computing into a strategy interface (#13690)	1 year ago
benclive	e2a209c076	feat(kafka): Add support for SASL auth to Kafka (#14487)	1 year ago
benclive	61aa418bb5	chore: Rename new querier flag to use dashes (#14438)	1 year ago
benclive	633bb5eb7e	feat(kafka): Enable querier to optionally query partition ingesters (#14418)	1 year ago
benclive	39b57ec4ea	feat(kafka): Replay kafka from last commit before allowing ingesters to become ready (#14330)	1 year ago
Christian Haudum	46f61fd5ad	chore: Remove ring client pool from JumpHashClientPool (#14367) ... The ring client pool has functionality, such as periodic health checking of the servers and removing of stale clients, which is not needed in the JumpHashClientPool. The removal of stale clients was problematic, because it compared the original server list (which is a list of CNAME records from the DNS lookup) with the client cache, which uses the IP of the server as key. Therefore it removed all cached clients on every check interval. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Cyril Tovena	1a4436c417	feat(ingester): implement partition shuffle sharding for ingester (#14304)	1 year ago
Cyril Tovena	f80d68a1ed	feat(distributors): Use a pool of worker to push to ingesters. (#14245)	1 year ago
Cyril Tovena	b6e9945f83	feat(kafka): Add Ingestion from Kafka in Ingesters (#14192) ... Co-authored-by: Joao Marcal <joao.marcal12@gmail.com> Co-authored-by: benclive <ben.clive@grafana.com>	1 year ago
benclive	7c78232ad3	feat: Optionally require writes to kafka on Push requests (#14186)	1 year ago
Christian Haudum	2840d48b92	chore: Clean up unused bloom filter related code (#14183) ... This PR tries to eliminate dead code in the bloom package, mainly related to line tokenization. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Vladyslav Diachenko	31368806a9	feat: add backoff mechanism to the retention process (#14182) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	1 year ago
Cyril Tovena	44958c4b8b	chore(kafka): Refactor configurations and remove old modules (#14161)	1 year ago
Cyril Tovena	d178f4c7e2	feat: Implement WAL segment ingestion via Kafka with partition ring (#14043) ... Co-authored-by: George Robinson <george.robinson@grafana.com>	1 year ago
Sven Grossmann	0780456662	feat(max-allowed-line-length): add config to set `max-allowed-line-length` in pattern ingester (#14070) ... Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	1 year ago
Paul Rogers	73cbbb0f22	feat: add retries for s3 ObjectExists calls (#14062) ... **What this PR does / why we need it**: It was determined via careful examination that Loki would issue retries for S3 `GetObject` calls, but would not retry calls to `ObjectExists`. For transient issues (e.g. rate-limiting), it makes sense to retry the command to see if an object does exist. If the object is not found (meaning, a 404 return code, and a successful query of the S3 storage to show the object does not exist), the retries are not leveraged, as it is not needed.	1 year ago
Trevor Whitney	4f962ef7af	fix: enable service detection for otlp endoint (#14036) ... Co-authored-by: Sven Grossmann <Svennergr@gmail.com> Co-authored-by: Ashwanth <iamashwanth@gmail.com> Co-authored-by: JordanRushing <rushing.jordan@gmail.com>	1 year ago
benclive	33c26f4dd1	feat: Add initial support for a kafka-based ingest path (#13992) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	1 year ago
Ned Andreev	f9824b7895	chore: update dskit and thanos/objstore (#13998)	1 year ago
Christian Haudum	b75eacc288	chore(blooms)!: Remove bloom compactor component (#13969) ... **What this PR does / why we need it**: This commit removes the code related to the bloom compactor which is superseded by the bloom planner and builders. A handful of CLI arguments of per-tenant settings changed their prefix from `-bloom-compactor.*` to `-bloom-build.*`. Other settings for the compactor component itself, also prefixed with `-bloom-compactor.*` were removed. See upgrade docs for further information. **Special notes for your reviewer**: ✔️ Part of https://github.com/grafana/loki/issues/13957 📔 Documentation update https://github.com/grafana/loki/pull/13965 ⚠️ Integrating the bloom planner and builder into the `backend` target is done in a follow-up PR. --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Salva Corts	b5ac6a0258	feat: Limit to block ingestion until configured date (#13958)	1 year ago
Paul Rogers	8fb7b488bd	chore(deps): update dskit 20240819 (#13924)	1 year ago
Trevor Whitney	913e9f9347	feat: aggregate byte and count metrics (#13731)	1 year ago
Trevor Whitney	c6ab6b31e8	chore: remove initial metric aggregation experiment (#13729)	1 year ago
Vladyslav Diachenko	bb257f54b3	feat(loki): add ability to disable AWS S3 dualstack endpoints usage (#13785) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	1 year ago
George Robinson	62c5c5c641	fix: add missing flush op timeout (#13679)	1 year ago
benclive	7553775d72	chore: Remove client header interceptors from metastore client (#13659)	1 year ago
benclive	3a99b69ae5	feat: Add baseline rf1 querier implementation (#13639) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	1 year ago
Cyril Tovena	0b474981dc	feat: Bootstrap metastore for wal segments (#13550)	1 year ago
benclive	c0f5fb6e4d	chore: Clean up old streams periodically in RF-1 ingester (#13511)	1 year ago
George Robinson	c4405fe1c4	feat: WAL Manager configuration options (#13531)	1 year ago
Trevor Whitney	2c053ee00c	feat: downsample aggregated metrics (#13449)	1 year ago
Salva Corts	2cc901ad69	refactor(blooms): Apply retention in planner (#13484)	1 year ago
Cyril Tovena	e08b4a7f88	feat: Pattern ingesters add a limiter for high eviction rate (#13464)	1 year ago
Salva Corts	47f6ea53fc	feat(loki): Do not enforce max-query-bytes-read and max-querier-bytes-read in limited tripperware (#13406)	1 year ago