3254 Commits (867ce3d711f3b9e823e8eb9b61c076acca339096)

Author	SHA1	Message	Date
Shantanu Alshi	867ce3d711	chore(level_detection): Make log level detection configurable (#14784)	7 months ago
Christian Haudum	03f7eab9c0	chore(blooms): Add number of skipped bloom blocks to stats-report log line (#14771) ... We already log the number of processed blocks, so we also want to know the number of skipped blocks, because they have not been available. This will give better insights on a per-query basis, additionally to the metric of overall skipped unavailable blocks `loki_bloom_gateway_blocks_not_available_total`. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Salva Corts	76d35cc97f	fix(blooms): Skip multi-tenant TSDBs during bloom planning (#14770)	7 months ago
Christian Haudum	57f16a0a26	perf(blooms): Replace JSON lib for encoding/decoding metas (#14767) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Robert Fratto	8eca826795	chore(storage/bloom): support simplifiable regexp matchers (#14622) ... This adds support for basic regexps which can be simplified into a sequence of OR matchers, such as: * `key=~"value" becomes key="value" * `key=~"value1|value2" becomes key="value1" or key="value2". * `key=~".+" checks for the presence of key. This is currently the only way to check if a key exists. Only the cases above are "officially" supported. However, we technically support basic concatenations and character classes due to how regexp/syntax parses and simplifies expressions such as `value1|value2` into `value[12]`. To prevent unbounded cardinality, we limit regexp expansion to 25 matchers; otherwise a regexp like `value[0-9][0-9][0-9][0-9]` would expand into 10,000 matchers (too many!). Closes grafana/loki-private#1106. Co-authored-by: J Stickler <julie.stickler@grafana.com>	7 months ago
Karsten Jeschkies	7b53f20f70	feat: Introduce shardable probabilistic topk for instant queries. (#14243) ... Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Callum Styan <callumstyan@gmail.com>	7 months ago
Owen Diehl	1c993f9bb0	chore(TSDB): add hooks for in-memory only tsdb creation (#14734) ... Signed-off-by: Owen Diehl <ow.diehl@gmail.com>	7 months ago
Owen Diehl	831c0d56b8	feat(TSDB): allow tsdb index creation in memory only (#14732)	7 months ago
Christian Haudum	022847b607	chore: Update targets list in documentation (#14567) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Christian Haudum	0760095a3e	chore: Add bool to metrics.go log line whether query used bloom filters (#14645) ... Better observability of which queries use bloom filters for chunk filtering. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
George Robinson	19ba8a1a22	chore: update thanos-io/objstore to cfdd0e5 (#14727)	7 months ago
Trevor Whitney	80aec25482	feat: Improve pattern ingester tracing (#14707)	7 months ago
Trevor Whitney	c1fde26730	feat: move metric aggregation to a per-tenant config (#14709)	7 months ago
Trevor Whitney	f2a16f43b2	feat: add app_name as a service label (#13660)	7 months ago
George Robinson	e6cf42396f	fix: move partition_id into label to make PromQL easier (#14714)	7 months ago
George Robinson	a142b3d540	feat: add gauge to track the partition_id (#14713)	7 months ago
Nikolay Andreev	b7ac5b4dcd	docs: add info about remotewrite client config in ruler (#14401) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	7 months ago
Salva Corts	3af0004cb4	feat(blooms): Only write key and key=value to blooms (#14686)	7 months ago
Salva Corts	d1668f6a11	fix(blooms): Exclude label filters where label name is part of the series labels. (#14661)	7 months ago
George Robinson	ebbbccfdaf	chore: move readerMetrics to separate file metrics.go (#14681)	7 months ago
George Robinson	f5b0fb6b99	feat: add gauge loki_ingest_storage_reader_phase (#14679)	7 months ago
Ed Welch	08416d4a28	chore: improve error message when can't find remote schemaconfig file (#14496) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	7 months ago
Salva Corts	31eea9042a	fix: Add tenant limits as dependency to pattern ingester (#14665)	7 months ago
Christian Haudum	baaaa83c78	chore: Add chunk count from `GetChunkRef` call to stats context (#14636) ... This PR improves the observability of the GetChunkRef call, especially for when bloom filters are enabled. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Ashwanth	8bca2e7608	feat(ruler): enables ruler store that uses clients from thanos-io/objstore pkg (#11713)	7 months ago
Jason Tackaberry	4d3f9f5a7b	feat(logcli): add gzip compression option (#14598) ... Passing `--compress` to logcli will enable (or more accurately not disable) compression on the `http.Transport`, allowing Loki to return gzip-compressed payloads. This improves overall execution time and reduces data transfer by 10-15x. Signed-off-by: Jason Tackaberry <tack@urandom.ca>	7 months ago
Christian Haudum	601f549656	fix(blooms): Check length of tasks before accessing first element in slice (#14634) ... This PR adds a length check for the partitioned series before accessing the first element of the resulting slice. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
benclive	ea798e0f2a	fix: More correctly report starting phase during kafka-reader startup (#14632)	7 months ago
Callum Styan	f411a0795a	fix: fix bug in query result marshaling for invalid utf8 characters (#14585) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	7 months ago
jinjiadu	99c423a1f5	chore: fix some function names (#14628) ... Co-authored-by: Paul Rogers <129207811+paul1r@users.noreply.github.com>	7 months ago
Joao Marcal	b87224647d	feat(storage): AWS backend using thanos.io/objstore (#11221) ... Co-authored-by: Ashwanth Goli <iamashwanth@gmail.com>	7 months ago
Salva Corts	51c42e8645	feat: Do not add empty blooms to offsets (#14577)	7 months ago
Joao Marcal	5824e3d35c	feat(storage): Azure backend using thanos.io/objstore (#11315) ... Co-authored-by: Ashwanth Goli <iamashwanth@gmail.com>	7 months ago
Vladyslav Diachenko	a962edba33	feat(loki): include structured_metadata size while asserting rate limit (#14571) ... Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	7 months ago
Ashwanth	cff9f43dd6	fix(s3): disable client retries when congestion control is enabled (#14588)	7 months ago
Salva Corts	673ede16a5	feat: New bloom planning using chunk size TSDB stats (#14547)	7 months ago
renovate[bot]	275c97cec7	fix(deps): update module github.com/fsouza/fake-gcs-server to v1.50.2 (#14313) ... Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com> Co-authored-by: Paul Rogers <paul.rogers@grafana.com>	7 months ago
Ned Andreev	99ef9009e5	fix: lint errors (#14574)	7 months ago
Salva Corts	6aa979d29e	refactor: Extract common functionality to test utils pkg (#14549)	7 months ago
Robert Fratto	bf54cf1496	chore(bloom): remove unused code from blooms (#14539)	7 months ago
Salva Corts	70508975fd	feat: Configurable list of json fields to mine patterns (#14528)	7 months ago
Christian Haudum	f568dda136	chore: Improve logging of jumphash server selector (#14306) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Ashwanth	11c4fa253c	chore: thanos client remove `object-store.` prefix (#14546)	7 months ago
Ashwanth	b405ae8557	chore: hide docs for thanos clients + restore original cli prefix (#14545)	7 months ago
Cyrill Troxler	bcfd0d1ad1	fix(logcli): create new tail response for every line (#14525) ... When tailing with logcli, the loghttp.TailResponse is created outside of the loop, resulting in stale labels within the TailResponse LabelSet as the unmarshal does not clear the map. Signed-off-by: Cyrill Troxler <cyrill@nine.ch>	7 months ago
Robert Fratto	8ffd4da6bb	chore(indexgateway): log trace ID in calls to GetChunkRef (#14536)	7 months ago
Joao Marcal	c059ace53e	feat(storage): GCS backend using thanos.io/objstore (#11132) ... Signed-off-by: Joao Marcal <jmarcal@redhat.com> Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Signed-off-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Signed-off-by: Ashwanth Goli <iamashwanth@gmail.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: Ashwanth <iamashwanth@gmail.com>	7 months ago
Robert Fratto	99f12e50d3	test(bloombuild/planner/strategies): use require.ElementsMatch in test (#14521)	7 months ago
benclive	524ed81395	feat(kafka): Start ingester flush loop before trying to catch up from Kafka (#14505)	7 months ago
Salva Corts	ab5e6eaaee	feat: Extract task computing into a strategy interface (#13690)	7 months ago