3318 Commits (c4ced3fc57136dcb363fa8fe136018d88230efd6)

Author	SHA1	Message	Date
George Robinson	f3cbb1f5aa	chore: delete old Ingester RF-1 code that is no longer used (#14818)	7 months ago
George Robinson	ed5ea97f67	chore: remove initialization of Ingester RF-1 (#14814)	7 months ago
George Robinson	ca06d21ece	chore: delete unusued Querier RF-1 code (#14815)	7 months ago
George Robinson	9a1fe95c11	chore: remove initialization of RF-1 client (#14810)	7 months ago
Cyril Tovena	28c9645d10	chore: Introduce logql/syntax go module (#14790)	7 months ago
Salva Corts	66e6b1c1df	perf(bloom): Compute chunkrefs for series right before sending task to builder (#14808)	7 months ago
Christian Haudum	3b20cb0a2b	chore: Fix regression in bloom gateway that caused nothing to be filtered (#14807) ... Pull request #14661 added the series labels to the `FilterChunkRefs` request in order to be able to filter out full series that do not contain the filter key when using bloom filters. However, this change incorrectly assumed that `Chunk.Metric` from the `GetChunks()` call contains the labels of the stream. This information is only populated once the chunk is fetched, though. Therefore the list of labels was empty, and no chunk refs were filtered. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
George Robinson	c02068ed17	chore: remove initialization of Querier RF-1 (#14791)	7 months ago
Owen Diehl	a90b74d6b1	refactor(indexshipper): removes unnecessary seeker impl from index storage client (#14802)	7 months ago
Dylan Guedes	9e7d2f2982	fix: logcli: Check for errors before checking for `exists` when fetching data (#14780)	7 months ago
George Robinson	ada4b7b871	chore: revert "chore: remove initialization of RF-1 components from pkg/loki" (#14792)	7 months ago
George Robinson	9f6ba80a03	chore: remove initialization of RF-1 components from pkg/loki (#14787)	7 months ago
Ned Andreev	0d6d68d9bf	feat: add per-tenant time sharding for long out-of-order ingestion (#14711)	7 months ago
Salva Corts	766938525f	fix(blooms): Do not restart builders when planner disconnects (#14783)	7 months ago
Shantanu Alshi	867ce3d711	chore(level_detection): Make log level detection configurable (#14784)	7 months ago
Christian Haudum	03f7eab9c0	chore(blooms): Add number of skipped bloom blocks to stats-report log line (#14771) ... We already log the number of processed blocks, so we also want to know the number of skipped blocks, because they have not been available. This will give better insights on a per-query basis, additionally to the metric of overall skipped unavailable blocks `loki_bloom_gateway_blocks_not_available_total`. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Salva Corts	76d35cc97f	fix(blooms): Skip multi-tenant TSDBs during bloom planning (#14770)	7 months ago
Christian Haudum	57f16a0a26	perf(blooms): Replace JSON lib for encoding/decoding metas (#14767) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Robert Fratto	8eca826795	chore(storage/bloom): support simplifiable regexp matchers (#14622) ... This adds support for basic regexps which can be simplified into a sequence of OR matchers, such as: * `key=~"value" becomes key="value" * `key=~"value1|value2" becomes key="value1" or key="value2". * `key=~".+" checks for the presence of key. This is currently the only way to check if a key exists. Only the cases above are "officially" supported. However, we technically support basic concatenations and character classes due to how regexp/syntax parses and simplifies expressions such as `value1|value2` into `value[12]`. To prevent unbounded cardinality, we limit regexp expansion to 25 matchers; otherwise a regexp like `value[0-9][0-9][0-9][0-9]` would expand into 10,000 matchers (too many!). Closes grafana/loki-private#1106. Co-authored-by: J Stickler <julie.stickler@grafana.com>	7 months ago
Karsten Jeschkies	7b53f20f70	feat: Introduce shardable probabilistic topk for instant queries. (#14243) ... Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Callum Styan <callumstyan@gmail.com>	7 months ago
Owen Diehl	1c993f9bb0	chore(TSDB): add hooks for in-memory only tsdb creation (#14734) ... Signed-off-by: Owen Diehl <ow.diehl@gmail.com>	7 months ago
Owen Diehl	831c0d56b8	feat(TSDB): allow tsdb index creation in memory only (#14732)	7 months ago
Christian Haudum	022847b607	chore: Update targets list in documentation (#14567) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Christian Haudum	0760095a3e	chore: Add bool to metrics.go log line whether query used bloom filters (#14645) ... Better observability of which queries use bloom filters for chunk filtering. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
George Robinson	19ba8a1a22	chore: update thanos-io/objstore to cfdd0e5 (#14727)	7 months ago
Trevor Whitney	80aec25482	feat: Improve pattern ingester tracing (#14707)	7 months ago
Trevor Whitney	c1fde26730	feat: move metric aggregation to a per-tenant config (#14709)	7 months ago
Trevor Whitney	f2a16f43b2	feat: add app_name as a service label (#13660)	7 months ago
George Robinson	e6cf42396f	fix: move partition_id into label to make PromQL easier (#14714)	7 months ago
George Robinson	a142b3d540	feat: add gauge to track the partition_id (#14713)	7 months ago
Nikolay Andreev	b7ac5b4dcd	docs: add info about remotewrite client config in ruler (#14401) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	7 months ago
Salva Corts	3af0004cb4	feat(blooms): Only write key and key=value to blooms (#14686)	7 months ago
Salva Corts	d1668f6a11	fix(blooms): Exclude label filters where label name is part of the series labels. (#14661)	7 months ago
George Robinson	ebbbccfdaf	chore: move readerMetrics to separate file metrics.go (#14681)	7 months ago
George Robinson	f5b0fb6b99	feat: add gauge loki_ingest_storage_reader_phase (#14679)	7 months ago
Ed Welch	08416d4a28	chore: improve error message when can't find remote schemaconfig file (#14496) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	7 months ago
Salva Corts	31eea9042a	fix: Add tenant limits as dependency to pattern ingester (#14665)	7 months ago
Christian Haudum	baaaa83c78	chore: Add chunk count from `GetChunkRef` call to stats context (#14636) ... This PR improves the observability of the GetChunkRef call, especially for when bloom filters are enabled. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Ashwanth	8bca2e7608	feat(ruler): enables ruler store that uses clients from thanos-io/objstore pkg (#11713)	7 months ago
Jason Tackaberry	4d3f9f5a7b	feat(logcli): add gzip compression option (#14598) ... Passing `--compress` to logcli will enable (or more accurately not disable) compression on the `http.Transport`, allowing Loki to return gzip-compressed payloads. This improves overall execution time and reduces data transfer by 10-15x. Signed-off-by: Jason Tackaberry <tack@urandom.ca>	7 months ago
Christian Haudum	601f549656	fix(blooms): Check length of tasks before accessing first element in slice (#14634) ... This PR adds a length check for the partitioned series before accessing the first element of the resulting slice. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
benclive	ea798e0f2a	fix: More correctly report starting phase during kafka-reader startup (#14632)	7 months ago
Callum Styan	f411a0795a	fix: fix bug in query result marshaling for invalid utf8 characters (#14585) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	7 months ago
jinjiadu	99c423a1f5	chore: fix some function names (#14628) ... Co-authored-by: Paul Rogers <129207811+paul1r@users.noreply.github.com>	7 months ago
Joao Marcal	b87224647d	feat(storage): AWS backend using thanos.io/objstore (#11221) ... Co-authored-by: Ashwanth Goli <iamashwanth@gmail.com>	7 months ago
Salva Corts	51c42e8645	feat: Do not add empty blooms to offsets (#14577)	7 months ago
Joao Marcal	5824e3d35c	feat(storage): Azure backend using thanos.io/objstore (#11315) ... Co-authored-by: Ashwanth Goli <iamashwanth@gmail.com>	7 months ago
Vladyslav Diachenko	a962edba33	feat(loki): include structured_metadata size while asserting rate limit (#14571) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	7 months ago
Ashwanth	cff9f43dd6	fix(s3): disable client retries when congestion control is enabled (#14588)	7 months ago
Salva Corts	673ede16a5	feat: New bloom planning using chunk size TSDB stats (#14547)	7 months ago