6501 Commits (658fcb710302f1ce844ed0c2dacaf6eb84db5c82)

 

All Branches   

Search

Author	SHA1	Message	Date
Christian Haudum	a0fce39169	feat(bloom-gw): Make num multiplexing tasks configurable, and other adjustments (#12169) ... * We want to be able to change the amount of dequeued items per iterations to test different configurations. * Ignore block pages that are magnitues bigger than the target page size. * Increase download queue capacity to avoid blocking when enqueueing Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Owen Diehl	e95cc6cc09	chore(blooms): Adds basic tracing implementation to bloom-gw (#12175) ... Also * removes unused `SyncMap` * adds a `BlockRefFrom` helper	1 year ago
Periklis Tsirakidis	c1f17764ef	fix(operator): Fix managed auth features annotation for community-openshift bundle (#12157)	1 year ago
Christian Haudum	f6cfff5356	refactor(bloomstore): Introduce fetch option for blocks fetcher (#12160) ... Requests to the bloom gateway should not wait for blocks to be downloaded into cache first, but should operate on readily available blocks. This PR introduces fetch options for the bloom store that specify how the store should behave when requesting blocks from block refs. `WithIgnoreMissing`: Ignore errors from blocks that could not be found in object storage, and instead return a `nil` value in the response. `WithFetchAsync`: Return only the blocks that are available locally in cache and dispatch downloading of blocks to the blocks downloader, that operates in the background, and make them available for subsequent requests. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Owen Diehl	f4b2c5d69b	fix(blooms): bloom-gw chunk merging improvements (#12162)	1 year ago
wellweek	e71964cca4	docs: fix some typos (#12163) ... Signed-off-by: wellweek <xiezitai@outlook.com>	1 year ago
Robert Jacob	5fd5e06cfc	fix(operator): Update Go builder for size-calculator (#12161)	1 year ago
Salva Corts	49f8f7b3ee	refactor: Chunkref as alias to logproto.ShortRef (#12159)	1 year ago
Periklis Tsirakidis	e09a0b4dba	feat(operator): Upgrade build and runtime dependencies (#12104)	1 year ago
Owen Diehl	9a993ca690	chore(blooms): Ordering & Unless iterator (#12154)	1 year ago
Zirko	336c90920a	feat: add ciliumnetworkpolicy for world egress for table-manager (#12143) ... Signed-off-by: QuantumEnigmaa <thibaud@giantswarm.io> Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com>	1 year ago
Periklis Tsirakidis	a993a0a747	fix(operator): Use correct field name for remote write client timeout (#11928)	1 year ago
Owen Diehl	8f3767c4ad	chore(blooms): block_query_latency_seconds rename (#12152)	1 year ago
Owen Diehl	3658dc922a	perf(blooms): removes pendingTasks impl with an atomic.Int64 (#12151)	1 year ago
Owen Diehl	30a240b470	fix(blooms): filter out nil blocks (#12150)	1 year ago
Owen Diehl	fd702f6691	chore(blooms): remove unused helper from bloomgateway (#12148)	1 year ago
Owen Diehl	102e3ea07f	chore(blooms): use the right iter reference in blockLoadingIter.loadNext (#12146)	1 year ago
Travis Patterson	bf11a7e2b4	fix: make it possible to wire up the request wrapper and created object store clients from enterprise logs (#12134)	1 year ago
Christian Haudum	1556cc0c68	chore(blooms): Remove unnecessary sorting of fingerprints (#12139) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Owen Diehl	9235229b9e	refactor(bloom-gw): todos and comments (#12135)	1 year ago
Paul Rogers	0ddf6fc49d	test: Fix for a few data races (#12129)	1 year ago
Owen Diehl	63e0bcb84b	fix(blooms): embeddedcache size panic (#12130)	1 year ago
Bayan Taani	9fdb810a61	fix(operator): Fix encoding of blocked query pattern in configuration (#12097) ... Co-authored-by: Robert Jacob <rojacob@redhat.com> Co-authored-by: Periklis Tsirakidis <periklis@redhat.com>	1 year ago
Zirko	0d505bb440	fix: fix backend-world-egress CNP (#12128) ... Signed-off-by: QuantumEnigmaa <thibaud@giantswarm.io>	1 year ago
Robert Jacob	5b145ab2d7	feat(operator): Allow setting explicit CredentialMode in LokiStack storage spec (#12106)	1 year ago
Salva Corts	f7710ad7aa	feat: (blooms) Configurable number of tokens (#12125)	1 year ago
Christian Haudum	38e2d7be4a	chore(blooms): Various bloom gateway fixes/improvements (#12120) ... * Response order of `FetchBlocks` is deterministic The response keeps the order of the refs from the request. * Update reference documentation * Skip not found blocks * Unify error messages with object key in bloom client * Change default value for bloom gateway shard size to 0 * Use only 16 tokens per ring instance * Add debug log line to each request in the bloom gateway client Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Paul Rogers	97ae790f36	test: Update chunk/cache/mock to have a GetKeys() function (#12122)	1 year ago
Owen Diehl	17988d5965	fix(blooms): measurable compaction progress (#12101)	1 year ago
Zirko	c1084a144a	feat: add additional ciliumNetworkPolicies in loki helm chart for world egress for read, write and backend (#12066) ... Signed-off-by: QuantumEnigmaa <thibaud@giantswarm.io> Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com>	1 year ago
Travis Patterson	b0478e61c8	feat: add the ability to inject log parsers to the distributor (#12029)	1 year ago
Robert Jacob	e39515ee45	fix(operator): Extend status to show difference between running and ready (#11968)	1 year ago
Christian Haudum	4cae003ece	chore(blooms): Make blocks cache preloading less verbose (#12107) ... The warnings suggest something going wrong where it's not the case. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Salva Corts	a8aa3f68cb	feat: Bloom filter regexes (#12096)	1 year ago
Christian Haudum	90bcaea724	chore(blooms): Add more instrumentation to bloom gateway and bloom store (#12048) ... * Add metric for size of metas/blocks fetched Getting the distribution of the uncompressed size of metas and blocks, grouped by their source (cache/filesystem/storage). * Move blocks/metas fetched metrics into bloomstore * Add minimal logging to bloom gateway processor * Observe queue duration of tasks The histogram metric gives us the insight about how long tasks spend their time enqueued waiting to be processed. * Remove queueMetrics field from bloom gateway struct The metrics are only used by the queue instance, which is part of the bloom gateway struct as well. * Move various bloom gateway metrics into separate file This commit introduces a new metrics struct that contains both the metrics specific the server/handler and the metrics specific to the worker. This has the advantage that metrics can be instantiated and accessed from one single place. --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Paul Rogers	77a2580052	fix: Add data race protection for the tm.wg var (#12100)	1 year ago
J Stickler	b24d48d2f6	docs: Update READMEs (#12061)	1 year ago
J Stickler	0ac42e78c2	docs: restore links, update procedure in Quick Start (#12068) ... Co-authored-by: Jack Baldry <jack.baldry@grafana.com>	1 year ago
Trevor Whitney	c1fbab5228	chore(release-2.8.x): release 2.8.9 and 2.8.10 (#12089) ... Co-authored-by: loki-gh-app[bot] <160051081+loki-gh-app[bot]@users.noreply.github.com>	1 year ago
J Stickler	c39786bd51	docs: update storage topic to include azure (#12063)	1 year ago
Christian Haudum	184d1de4db	chore(blooms): Use `bloomshipper.Interval` instead of `model.Interval` (#12079) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Christian Haudum	637c292cd8	fix(blooms): Fix issue when loading cache on startup if directory does not exist (#12080) ... The check `!dirEntry.IsDir()` panicked in case `dirEntry` is `nil`, which is the case when the root directory does not exist. The PR also adds more logging. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Danny Kopping	b5f488caec	fix(query/query-frontend): correct congestion control stats aggregation (#12072) ... Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	1 year ago
Danny Kopping	609fdb3214	feat(querier/query-frontend): track and log congestion control latency (#12058) ... Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	1 year ago
Shantanu Alshi	b1a61b3df6	chore: Change local setup under dev to use tsdb and v13 schema (#12057) ... Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Owen Diehl	60f75f3395	fix(blooms): closes chunk iterator (#12053)	1 year ago
Christian Haudum	cb7e016d64	chore(blooms): Populate blocks cache on startup (#12056) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Karsten Jeschkies	6578a00481	feat: Support usage trackers for received and discarded bytes. (#11840)	1 year ago
Christian Haudum	2f54f8d5be	chore(blooms): Implement BloomStore as a service (#12044) ... The bloomstore service is instantiated once at startup and used as dependency for both the bloom compactor and the bloom gateway. This will prevent instantiating the store in different ways. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	1 year ago
Owen Diehl	7c8992f4e4	fix(blooms): fix reference leak and resulting race condition in BloomPageDecoder (#12050)	1 year ago