Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Salva Corts 4248825ad2 Bloom-compactor Sharding (#11154) ... **What this PR does / why we need it**: This PR adds tenant and fingerprint (FP) sharding to bloom compactors. Note that the bloom-compactor doesn't yet perform any compaction, but iterates through all tables, tenants, and series checking if the compactor owns the tenant and the series (by the series FP). Actual compaction will be implemented with https://github.com/grafana/loki/pull/11115. A new structure `Job` is added which will carry around all the context for a compaction job such as the tenant ID, the table name, and the series FP. The sharding strategy has two methods: - `OwnsTenant(tenant string)`: Checks if the compactor shard owns the tenant. - `OwnsJob(job Job)`: Checks (again) if the compactor owns the job's tenant. Then, it checks if the compactor owns the job's fingerprint by looking inside the tenant subring. We add a new per-tenant limit: `bloom_compactor_shard_size`. If it's 0, the tenant can use all compactors (i.e. `OwnsTenant` will always return `true`), otherwise, only `bloom_compactor_shard_size` out of the total number of compactors will own the tenant. A given job's FP will be owned by exactly one compactor within the tenant shard. **Special notes for your reviewer**: - Added a bunch of metrics in `metrics.go` - Added a test for the sharding strategy		2 years ago
..
alert	Remove that the Ruler WAL is a coming soon feature (#10732)	2 years ago
community	Build loki-build-image for multiple architectures. (#11130)	2 years ago
configure	Bloom-compactor Sharding (#11154)	2 years ago
get-started	feat(logstash): clients logstash output structured metadata support (#10899)	2 years ago
operations	Update changed metrics in docs (#11109)	2 years ago
query	[Style] Update timeseries to time series. (#11125)	2 years ago
reference	Add note - LogQL syntax required (#10740)	2 years ago
release-notes	[release-2.8.x] add release notes for 2.8.6 (#10929)	2 years ago
send-data	feat(logstash): clients logstash output structured metadata support (#10899)	2 years ago
setup	Fix S3 Helm example (#11180)	2 years ago
storage	Remove shared_store and shared_store_key_prefix from shipper and compactor (#10840)	2 years ago
visualize	[Style] Data source as two words. (#11124)	2 years ago
_index.md	[Docs] Revise Loki Overview topic (#10457)	2 years ago
logo.png	Sync docs to website (#2378)	6 years ago
logo_and_name.png	Sync docs to website (#2378)	6 years ago