3052 Commits (29a37d5dcdab33d62615a79aefe97ea2a80dea03)

Author	SHA1	Message	Date
Callum Styan	29a37d5dcd	fix: special case the return values from a sharded first/last_over_time query (#13578) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	10 months ago
洪阿南	bd20171975	fix(blooms): Improve error wrap to make ignoreNotFound work when fetching blocks (#13656) ... Fix an issue where the `options.ignoreNotFound` of the fetcher is not effective. The root cause of this issue is that the error returned by `fmt.Errorf()` in `BloomClient` loses the underlying cause. As a result, `S3ObjectClient.IsObjectNotFoundErr()` fails to determine if the underlying cause of the returned error is of type `awserr.Error`.	10 months ago
benclive	7553775d72	chore: Remove client header interceptors from metastore client (#13659)	10 months ago
George Robinson	2dfc13bb73	feat: add loki_ingester_rf1_segment_age_seconds metric (#13653)	10 months ago
Sven Grossmann	4f534d7317	feat(detected-labels): remove cardinality filter (#13652)	10 months ago
George Robinson	9f197b68cc	chore: move timestamps into SegmentWriter (#13644)	10 months ago
benclive	d9c441efcc	feat: Implement GetObjectRange for all storage providers (#13650)	10 months ago
Sven Grossmann	2642718d50	fix: remove limit middleware for `detected_labels` (#13643)	10 months ago
benclive	3a99b69ae5	feat: Add baseline rf1 querier implementation (#13639) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	10 months ago
George Robinson	7ed63ea7f4	feat: remove mutexes from wal.SegmentWriter (#13641)	10 months ago
Cyril Tovena	8cb19a2e3c	feat(rf1): Add query path for the metastore (#13636)	10 months ago
George Robinson	4abb5a404c	feat: Calculate the age of a WAL segment (#13637)	10 months ago
Cyril Tovena	5f5fd4e4ab	feat(rf1): Store index ref in metastore (#13613)	10 months ago
Christian Haudum	2624a4bdd4	fix(blooms): Use correct key to populate blockscache at startup (#13624) ... The cache key for block directories in the blocks cache are the block's address without the directory prefix. This is how the directory is put to the LRU cache after downloading and extracting the block tarball. This PR fixes the incorrect cache key used to populate the cache from disk on startup, which contained the file system directory prefix. Since the cached item from startup is never used, it gets evicted first in case of a full cache, or due to its TTL. This causes also the underlying directory on disk to be deleted, which can however still be referenced from the correct cache key for that directory from a later download. That caused the error `getting index reader: opening series file: open /path/to/block/series: no such file or directory` when trying to query the block, because the correct cache key was still present. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	10 months ago
Salva Corts	784e7d562f	fix: Keep blocks referenced by newer metas (#13614)	10 months ago
Christian Haudum	64215e1849	fix(blooms): Cleanup temp blockdir in bloom compactor (#13622) ... A follow up to #13522 This PR fixes the missing cleanup function call to remove temporary blocks from the filesystem. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	10 months ago
Sven Grossmann	ce02cc254a	feat(structured-metadata-api): add structured metadata to `/detected_fields` API (#13604)	10 months ago
Ed Welch	10083159a7	fix: remove retries on the stats handlers because they already retry (#13608) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	10 months ago
Cyril Tovena	ce88286147	feat: Instrument rf1 write path with tracing (#13599)	10 months ago
Cyril Tovena	04613b492f	feat: Instrument metastore GRPC calls (#13598)	10 months ago
Christian Haudum	39a52974af	chore: Remove excessive logging from bloom gateway (#13603) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	10 months ago
Ed Welch	d3e1edbf11	fix: fix retry code to handle grpc status codes. updated newer stats retries to be wrapped with spans (#13592) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	10 months ago
Ed Welch	7232795e1f	fix: add a retry middleware to all the stats handlers (#13584) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	10 months ago
Ashwanth	65697676e6	chore: do not shard log queries with empty filter (#13568)	10 months ago
Ed Welch	6631c0f01d	chore: shard limited queries with a fixed sharding factor (#13576) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	10 months ago
George Robinson	71cb767727	chore: replace pkg/errors with errors (#13583)	10 months ago
George Robinson	757bde0cb5	chore: replace pkg/errors with errors (#13582)	10 months ago
George Robinson	95c49a3677	chore: replace pkg/errors with errors (#13581)	10 months ago
Cyril Tovena	0b474981dc	feat: Bootstrap metastore for wal segments (#13550)	10 months ago
Christian Haudum	c9950e394d	fix(blooms): Fix eviction of multiple blockcache items (#13573) ... This commit fixes a bug in the eviction of least recently used items. When an element from the doubly-linked-list of the cache is removed, then the element's prev and next items become nil. Therefore the call elem.Prev() always broke the loop's condition for checking entries to be evicted. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	10 months ago
Salva Corts	0029d46c23	feat: Track when builders are doing work with a gauge (#13570)	10 months ago
benclive	e23598d710	fix: Dedup pattern tokens on output (#13534)	10 months ago
benclive	5fa9c4bd56	fix: Retain original values in logfmt pattern tokenizer (#13535)	10 months ago
George Robinson	dbff69a2e9	fix: Fix panic in ingester.go (#13557)	10 months ago
George Robinson	d3d9923410	chore: Rename PendingItem to PendingSegment and clean up flush.go (#13554)	10 months ago
George Robinson	d8eb9dd9be	chore: Remove redundant comments (#13553)	10 months ago
Christian Haudum	7aa7c15f21	chore: Use filesystem backed writer for blooms (#13522) ... The DirectoryBlockWriter and DirectoryBlockReader are used to avoid OOMing of compactors/builders. The tradeoff is that the writer/reader needs to be cleaned up and that it is I/O bound. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	10 months ago
Salva Corts	aeb23bb7fc	fix: Fix log line for fingerprint not found (#13555)	10 months ago
benclive	c0f5fb6e4d	chore: Clean up old streams periodically in RF-1 ingester (#13511)	10 months ago
George Robinson	8ef86f8d8b	chore: refactor WAL Manager (#13551)	10 months ago
George Robinson	e2cbde884f	chore: Clean up manager_test.go (#13549)	10 months ago
George Robinson	6acb51d485	chore: Use github.com/coder/quartz instead of time (#13542)	10 months ago
George Robinson	fac8ddafcd	chore: Remove unused const (#13544)	10 months ago
George Robinson	e1f9eb5fa9	chore: Remove size and duration logs now we have metrics (#13547)	10 months ago
George Robinson	47d057854f	chore: Fix not ready error message in RF-1 Ingester (#13546)	10 months ago
Cyril Tovena	4451d56d6b	fix: Fixes span name of serializeRounTripper (#13541)	10 months ago
George Robinson	a03e3d39d4	chore: Use pool of bytes.Buffer instead of io.Pipe (#13543)	10 months ago
George Robinson	8ca03a2a3d	feat: Remove flush loop and queue from Ingester RF-1 (#13538)	10 months ago
Salva Corts	b44517a9f1	test: Add logging for empty blooms (#13537)	10 months ago
George Robinson	d4179aa04f	feat: Add metrics for Ingester RF-1 (#13510)	10 months ago