Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Kaviraj Kanagaraj bbfb13c3e4 Pin `chunk` and `index` format to `schema` version. (#10213) ... We pin all three `Chunk`, `HeadBlock` and `TSDB` Version to `schema` version in period config. This is the following mapping (after being discussed with @owen-d and @sandeepsukhani ) `v12` (current existing schema) - ChunkFormatV3 (UnorderedHeadBlock) + TSDBv2 `v13` (introducing new schema) - ChunkFormatV4 (UnorderedWithNonIndexedLabelsHeadBlockFmt) + TSDBv3 Note the new schema `v13` supports the latest chunk and index format. **NOTES for Reviewer** 1. General approach is we removed the idea of `index.LiveFormat`, `chunkenc.DefaultChunkFormat` and `chunkenc.DefaultHeadBlockFmt` and made following two changes. These variables were used before to tie chunk and tsdb formats specific to Loki versions. This PR remove that coupling and pin these formats to `schema` version instead. 1. These variables were replaced with explicit chunk and index formats within those packages (and it's tests) 2. If these variables were used outside it's own packages say by ingester, compactor, etc. Then we extract correct chunk and index versions from the `schema` config. 2. Add two methods to `periodConfig`. (1) `ChunkFormat()` returning chunk and head format tied to schema (2) `TSDBFormat()` returning tsdb format tied to schema. 2. Other ideas I thought of doing but didn't end up doing is make `ChunkFormat` and `IndexFormat` as separate type (rather than `byte` and `int` currently. Similar to `HeadBlockFmt` type). But didnt' do it eventually to keep the PR small and don't want to complicate with lots of changes. 4. Moved couple of test cases from `chunkenc` to `config` package, because the test case was actually testing methods on `schemaconfig` and it was creating cycling dependencies. --------- Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>		2 years ago
..
bucket	Storage: Remove `SignatureVersionv2` from the AWS S3 API request authentication. (#10295)	2 years ago
chunk	Pin `chunk` and `index` format to `schema` version. (#10213)	2 years ago
common/aws	S3 Storage Class Configuration (#8532)	3 years ago
config	Pin `chunk` and `index` format to `schema` version. (#10213)	2 years ago
errors	Refactoring of the Loki storage (#5833)	4 years ago
hack	Pin `chunk` and `index` format to `schema` version. (#10213)	2 years ago
stores	Pin `chunk` and `index` format to `schema` version. (#10213)	2 years ago
async_store.go	Allow volume to be aggregated by label (#9988)	3 years ago
async_store_test.go	Pin `chunk` and `index` format to `schema` version. (#10213)	2 years ago
batch.go	Loki: simplify the FetchChunks method and optimize the experimental l2 cache a little more (#10160)	2 years ago
batch_test.go	Pin `chunk` and `index` format to `schema` version. (#10213)	2 years ago
factory.go	Refactored forGivenIngestors to use DoUntilQuorum instead of Do (#9984)	2 years ago
factory_test.go	config: ensure storage config defaults apply to named stores (#9650)	3 years ago
lazy_chunk.go	Upgrade `golangci-lint` and fix linting errors (#9601)	3 years ago
lazy_chunk_test.go	Pin `chunk` and `index` format to `schema` version. (#10213)	2 years ago
store.go	Dynamic client-side throttling to avoid object storage rate-limits (GCS only) (#10140)	2 years ago
store_test.go	Pin `chunk` and `index` format to `schema` version. (#10213)	2 years ago
util_test.go	Pin `chunk` and `index` format to `schema` version. (#10213)	2 years ago