3052 Commits (29a37d5dcdab33d62615a79aefe97ea2a80dea03)

Author	SHA1	Message	Date
benclive	740551bb31	fix: Correctly encode step when translating proto to http internally (#13171)	12 months ago
Callum Styan	691b174138	fix: properly return http status codes from ingester to querier for RPC function calls (#13134) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	12 months ago
Ed Welch	bb864b3ad6	fix: add retry middleware to the "limited" query roundtripper (#13161) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	12 months ago
benclive	6a0fdd0880	feat: Add new Drain tokenizer that splits on most punctuation (#13143)	12 months ago
Sven Grossmann	9981e9e40d	fix(orFilters): fix multiple or filters would get wrong filtertype (#13169)	12 months ago
Salva Corts	c99634978c	fix: Fix bloom deleter PR after merge (#13167)	12 months ago
Salva Corts	9c96d26895	refactor(blooms): Delete outdated metas (#13153)	12 months ago
Owen Diehl	fbe7c559b5	feat(blooms): Blooms/v2 encoding multipart series (#13093)	12 months ago
Owen Diehl	41c5ee21fc	fix(regression): reverts grafana/loki#13039 to prevent use-after-free corruptions (#13162)	12 months ago
Christian Haudum	fc264310ce	perf: Introduce fixed size memory pool for bloom querier (#13039) ... This PR introduces a fixed size memory pool for bloom pages that are loaded in the block querier. The aim of a fixed size pool of `[]byte` buffers is to reduce the amount of allocations, as well as to control the maximum heap size to prevent OOMing of the bloom gateways. Also, with the current usage of a `sync.Pool`, the query parallelism (`bloom-gateway.worker-concurrency` and `bloom-gateway.block-query-concurrency`) was defined by the `bloom.max-query-page-size` (and vice versa), because the max page size could be loaded `workers * concurrency` times at the same time. Most of the time, though, smaller pages are loaded, and therefore concurrency is not optimized. With the new fixed size memory pool, this problem should be solved. The pool is divided into slabs of different sizes holding different amounts of buffers; a larger amount of small sized buffers and a smaller amount of large sized buffers. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	12 months ago
Cyril Tovena	86b119ac7b	fix: Add copyString function to symbolizer to avoid retaining memory (#13146)	12 months ago
Salva Corts	f7887269f8	refactor(blooms): Limit task retries in bloom planner (#13139)	12 months ago
benclive	30df31e28b	feat: Tune Patterns query drain instance (#13137)	12 months ago
Salva Corts	6e119aaef5	refactor(blooms): Forward created metas from builder to planner (#13133)	12 months ago
Owen Diehl	ad279e518c	fix(blooms): bloomshipper no longer returns empty metas on fetch (#13130) ... Traced some bloom compactor problems to this store interface returning empty `Metas` (with the exception of the reference key) on fetch when the object does not exist in storage. I originally found this due to a panic in the outdated meta removal code because empty `Metas` don't have any source TSDBs. Fixes the impl to only return metas which existed which have their contents populated.	12 months ago
Salva Corts	cd64d6ddbd	refactor(blooms): Implement retry mechanisms in planner (#13064)	12 months ago
Sven Grossmann	8be8364435	feat(detected-labels): include labels with cardinality > 1 (#13128) ... Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	12 months ago
Christian Haudum	d9cc513fd2	fix: Do not filter out chunks for store when `From==Through` and `From==start` (#13117) ... This PR fixes a bug where chunks are incorrectly filtered out when their `From` timestamp is equal to their `Through` timestamp (which happens when there is a single log line) and the `From` timestamp is equal to the `from` time of the of the request. How to reproduce: 1. Insert a single log line with a timestamp exactly at point of an hour 2. Flush ingester 3. Query log line with a split interval of 1h Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Ed Welch <edward.welch@grafana.com>	12 months ago
benclive	6df81db978	feat: Support negative numbers in LogQL (#13091)	12 months ago
Salva Corts	fa2c78936f	refactor(blooms): Build new metas and blocks (#13074)	12 months ago
Dylan Guedes	47f0236ea8	feat: Introduce `index audit` to `lokitool` (#13008) ... Adds a new `index audit` command to the `lokitool` cmd. The new `index audit` validates that all chunks required by a given index are available at the object storage. This is useful to validate if you're missing data after a backfill or when migrating data from one Loki instance to another. See `pkg/tool/audit/README.md` for usage instructions.	12 months ago
Kaviraj Kanagaraj	71507a2b64	feat(canary): Add test to check query results with and without cache. (#13104) ... Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	12 months ago
Yuri Kotov	808425953f	feat: API: Expose optional label matcher for label names API (#11982) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	12 months ago
Ed Welch	00d3c7a52d	feat: add profile tagging to ingester (#13068) ... Signed-off-by: Edward Welch <edward.welch@grafana.com> Co-authored-by: poyzannur <poyzannur.taneli@grafana.com> Co-authored-by: Poyzan <31743851+poyzannur@users.noreply.github.com>	1 year ago
benclive	f6f8babf83	feat: Add utf8 support to Pattern Lexer to support utf8 chars (#13085)	1 year ago
benclive	2923a7d958	fix: Update expected patterns when pruning (#13079)	1 year ago
benclive	797bb64173	feat: Add tokenizer interface for Drain Training (#13069)	1 year ago
Karsten Jeschkies	6e4555010e	fix: Introduce feature flag for [last|first]_over_time sharding. (#13067)	1 year ago
洪阿南	670cd89aa8	fix: Fix incorrect sorting of chunks in bloom-filtered response since `ChunkRef.Cmp` method is used in reverse (#12999) ... The `v1.ChunkRef.Cmp()` method is used in reverse, and this can lead to chunks in bloom filtered result be sorted in descending but not ascending.	1 year ago
Salva Corts	ab7af0575d	refactor(blooms): Builder retrieves tasks from planner (#13046)	1 year ago
George Robinson	cc3694eecd	feat: Add ingester_chunks_flush_failures_total (#12925) ... Signed-off-by: George Robinson <george.robinson@grafana.com>	1 year ago
benclive	d0a285926b	feat: Increase drain max depth from 8 -> 30 (#13063)	1 year ago
Christian Haudum	d6374bc2ce	feat(blooms): Add counter metric for blocks that are not available at query time (#12968) ... When filtering chunks on the bloom gateway, bloom block may not be available and they will be downloaded asynchronously in the background. This new metric `loki_bloom_gateway_blocks_not_available_total` counts the blocks that are not available at query time. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
benclive	2171f6409f	fix: Fix panic on requesting out-of-order Pattern samples (#13010)	1 year ago
Salva Corts	f6529c293e	refactor(blooms): Add RPC service for bloom-planner (#13015)	1 year ago
Vladyslav Diachenko	4901a5c452	fix: not owned stream count (#13030) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	1 year ago
Trevor Whitney	ca030a5c43	fix: change log level since this is a known case (#13029)	1 year ago
Vladyslav Diachenko	1111595179	feat: new stream count limiter (#13006) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com> Co-authored-by: JordanRushing <rushing.jordan@gmail.com>	1 year ago
Salva Corts	efd8f5dc1b	refactor(blooms): Add queue to bloom planner and enqueue tasks (#13005)	1 year ago
Salva Corts	3195036435	refactor(bloom planner): Compute gaps and build tasks from metas and TSDBs (#12994)	1 year ago
Ashwanth	bf8a278879	chore: remove duplicate imports (#13001)	1 year ago
Ashwanth	1f5291a4a3	fix(indexstats): do not collect stats from "IndexStats" lookups for other query types (#12978)	1 year ago
Christian Haudum	75ccf2160b	feat(blooms): Separate page buffer pools for series pages and bloom pages (#12992) ... Series pages are much smaller than bloom pages and therefore can make use of a separate buffer pool with different buckets. The second commit fixes a possible panic. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Salva Corts	8978ecf0c8	feat: Boilerplate for new bloom build planner and worker components. (#12989)	1 year ago
Kaviraj Kanagaraj	88e545fc95	feat(cache): Add `Cache-Control: no-cache` support for Loki instant queries. (#12896) ... Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	1 year ago
Karsten Jeschkies	88c671162f	fix: Track bytes discarded by ingester. (#12981) ... **What this PR does / why we need it**: Only the distributor was tracking discarded bytes. The ingester was missing the tracker and calls. **Checklist** - [ ] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [x] Tests updated - [x] Title matches the required conventional commits format, see [here](https://www.conventionalcommits.org/en/v1.0.0/) - **Note** that Promtail is considered to be feature complete, and future development for logs collection will be in [Grafana Alloy](https://github.com/grafana/alloy). As such, `feat` PRs are unlikely to be accepted unless a case can be made for the feature actually being a bug fix to existing behavior. - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/setup/upgrade/_index.md` - [ ] For Helm chart changes bump the Helm chart version in `production/helm/loki/Chart.yaml` and update `production/helm/loki/CHANGELOG.md` and `production/helm/loki/README.md`. [Example PR](d10549e3ec) - [ ] If the change is deprecating or removing a configuration option, update the `deprecated-config.yaml` and `deleted-config.yaml` files respectively in the `tools/deprecated-config-checker` directory. [Example PR](0d4416a4b0)	1 year ago
Cyril Tovena	87288d37f9	feat(reporting): Report cpu usage (#12970)	1 year ago
benclive	4a5edf1a2a	perf: Replace channel check with atomic bool in tailer.send() (#12976)	1 year ago
Shantanu Alshi	e7fdeb974a	perf: Improve Detected labels API (#12816)	1 year ago
benclive	bc53b33721	feat: Add metrics for number of patterns detected & evicted (#12918)	1 year ago