Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

afayngelerindbx 36109eb09a compactor: prefetch existing compacted user index files in parallel (#6803) ... **What this PR does / why we need it**: Before this change, these files are fetched while [holding a table global lock](a1e75da970/pkg/storage/stores/shipper/index/compactor/table_compactor.go (L195)), serializing fetches. I chose the approach of prefetching index files over attempting to change the locking pattern to allow parallel, on-demand fetches because the complexity of parallelizing on-demand fetches outweighed the benefits of avoiding extra fetches. More specifically, this patch trades off fetching idle, non-compactable index files in favor of avoiding blocking during compactions. The extra fetches are parallelized and so should incur a negligible wall clock penalty even for large numbers of tenants(e.g. 1k idle tenants at 50 threads and 500ms to fetch is ~10s). **Which issue(s) this PR fixes**: This should help with #6775, without completely resolving it. **Checklist** This change does not introduce any settings, metrics etc. It should be transparent from a user perspective. Therefore, I don't believe it merits documentation/changelog updates. - [x] Tests updated		3 years ago
..
bucket	feat: Add support for Azure user assigned identity (#5891)	4 years ago
chunk	[fix panic] s3: fix object nil point (#6970)	3 years ago
config	use the configured index prefixes while building table names for tsdb index (#6436)	4 years ago
errors	Refactoring of the Loki storage (#5833)	4 years ago
hack	Refactoring of the Loki storage (#5833)	4 years ago
stores	compactor: prefetch existing compacted user index files in parallel (#6803)	3 years ago
async_store.go	[TSDB] Ingester Index Sampling (#6852)	3 years ago
async_store_test.go	store: fix bug in getting chunk ids from ingesters when using boltdb-shipper (#5945)	4 years ago
batch.go	Bump prometheus dependency (#6403)	4 years ago
batch_test.go	`metrics.go` support for metadata queries(labels and series) (#5971)	4 years ago
factory.go	Make TSDB store singleton resettable (#6950)	3 years ago
factory_test.go	Refactoring of the Loki storage (#5833)	4 years ago
lazy_chunk.go	Refactoring of the Loki storage (#5833)	4 years ago
lazy_chunk_test.go	Introduce a ChunkRef type as part of logproto (#5643)	4 years ago
store.go	add metric for measuring overall index query latency (#6880)	3 years ago
store_test.go	use the configured index prefixes while building table names for tsdb index (#6436)	4 years ago
util_test.go	Bump prometheus dependency (#6403)	4 years ago