6645 Commits (a0f358fcc8295d93ee38b67738e8d90045c50dab)

 

All Branches   

Search

Author	SHA1	Message	Date
Christian Haudum	a0f358fcc8	fix(blooms): Fully deduplicate chunks from FilterChunkRef responses (#12807) ... This PR aims for full de-duplication of chunks and series from filter requests from the index gateway to the bloom gateway. Whenever we merge/de-duplicate slices, the inputs need to be sorted. It appears that the Removals (chunks) from the v1.Output are not guaranteed to be sorted. When comparing ShortRefs, both From, Through, and Checksum need to be used. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Owen Diehl	1665e853a0	fix(blooms): dont break iterator conventions (#12808) ... Followup to #12806 which exposes skipped pages more explicitly than as an error. * refactors skip logic for bloom pages that are too large * s/Seek/LoadOffset/ for LazyBloomIter * removes unused code	2 years ago
TheRealNoob	af5be90076	feat(helm): Allow extraObject items as multiline strings (#12397) ... Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com>	2 years ago
Michel Hollands	c9b6604b38	ci: Add lokitool to the dist target (#12830) ... Signed-off-by: Michel Hollands <michel.hollands@gmail.com>	2 years ago
Owen Diehl	bc78d13d9b	feat(blooms): compute chunks once (#12664) ... Signed-off-by: Owen Diehl <ow.diehl@gmail.com>	2 years ago
Sandeep Sukhani	c3a3bc396f	docs: hint on line and timestamp functions in docs for line_format stage (#12740) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
benclive	74db5dda3c	docs: Add info about step param for Patterns API (#12803)	2 years ago
Tanat Lokejaroenlarb	8892dc8923	feat: parameterise the MaximumEventAgeInSeconds, LogGroupName, and IAMRoleName for lambda-promtail CloudFormation template (#12728)	2 years ago
Quentin Bisson	51a841f20d	fix: loki-operational.libsonnet (#12789)	2 years ago
Lars Falk-Petersen	6e1680b9d1	docs: Fix typo in structured-metadata.md (#12818)	2 years ago
Dmitriy Okladin	2d62fca05d	fix(ksonnet): Do not generate rbac for consul if you are using memberlist (#12688)	2 years ago
Owen Diehl	eac56224b8	feat(blooms): limit bloom size during creation (#12796)	2 years ago
Jonas L. B	c0113db4e8	fix(promtail): Handle docker logs when a log is split in multiple frames (#12374)	2 years ago
Salva Corts	76ba24e3d8	fix(blooms): Reset error on LazyBloomIter.Seek (#12806)	2 years ago
Ned Andreev	40479029d7	feat: Generic logline placeholder replacement and tokenization (#12799) ... This code allows us to preprocess generic logs and replace highly variable dynamic data (timestamps, IPs, numbers, UUIDs, hex values, bytesizes and durations) with static placeholders for easier pattern extraction and more efficient and user-friendly matching by the Drain algorithm. Additionally, there is logic that splits generic log lines into discrete tokens that can be used with Drain for better results than just naively splitting the logs on every whitespace. The tokenization here handles quote counting and emits quoted strings as a part of the same token. On the other side, it also handles likely JSON logs without any white spaces in them better, by trying to split `{"key":value}` pairs (without actually parsing the JSON). All of this is done without using regular expressions and without actually parsing the log lines in any specific format. That's why it works very efficiently in terms of CPU usage and allocations, and should handle all log formats and unformatted logs equally well.	2 years ago
Michel Hollands	151d0a58ac	fix: add missing parentheses in meta monitoring dashboards (#12802) ... Signed-off-by: Michel Hollands <michel.hollands@gmail.com>	2 years ago
Michel Hollands	33e82ec133	fix: remove unused parameter causing lint error (#12801) ... Signed-off-by: Michel Hollands <michel.hollands@gmail.com>	2 years ago
Michel Hollands	ec1a057a32	feat: Add a version of the mixin dashboards for meta monitoring (#12700) ... Signed-off-by: Michel Hollands <michel.hollands@gmail.com>	2 years ago
benclive	7b8533e435	feat: Add step param to Patterns Query API (#12703)	2 years ago
Christian Haudum	3bf2d1fea0	fix(blooms): Deduplicate filtered series and chunks (#12791) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Christian Haudum	807d692444	chore(loki-mixin): Fixes for `loki-reads` dashboard (#12788) ... * Update HTTP and GRPC routes * Add QPS and latency panels for Index Gateway * Rename row Index to TSDB Index and BoltDB Shipper to BoltDB Index for consistency Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Paul Rogers	4cc3a73172	test: Add mutex and setter/getter for addresses in test (#12793)	2 years ago
Owen Diehl	da8ee7e7f2	chore(blooms): Instrument source bytes added to blooms directly (#12782)	2 years ago
Paulin Todev	39a7181a60	fix: promtail; clean up metrics generated from logs after a config reload. (#11882)	2 years ago
Dylan Guedes	1933f0e5e9	docs: Helm: Don't show defaults for `loki` section (#12747)	2 years ago
Trevor Whitney	a47df1ebfd	docs: update release docs (#12511)	2 years ago
Trevor Whitney	4404f7d2f7	docs: order configuration template fileds alphabetically (#12771)	2 years ago
Jay Clifford	6ebfbe658b	feat: Updated best practises for labels (#12749) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
Trevor Whitney	af09f53a33	ci: release workflows get build image from makefile (#12778)	2 years ago
J Stickler	3cbdd95e76	docs: Update storage topics (v3.0) (#12768)	2 years ago
Owen Diehl	fb9b0e80a7	chore(blooms): adds more instrumentation to block building (#12779)	2 years ago
Christian Haudum	ecefb49508	fix(blooms): Fix a regression introduced with #12774 (#12776) ... This PR fixes a regression introduced with #12774 where series where wrongly identified as "skipped" even though there were part of blocks. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Christian Haudum	c36b1142c7	fix(blooms): Correctly return unfiltered chunks for series that are not mapped to any block (#12774) ... This PR fixes a conceptual mistake in the code of resolving blocks on the index gateways. Currently, a series does not resolve to any block is discarded instead of being kept for the response. This change adds the chunks of the skipped series to the bloom querier response. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Jay Clifford	282e38548c	feat: Update getting started demo to Loki 3.0 (#12723) ... Co-authored-by: J Stickler <julie.stickler@grafana.com>	2 years ago
Lukas Juozas Janusaitis	72534449a0	fix(workflows): don't run metric collector on forks (#12687)	2 years ago
Trevor Whitney	ae180d6e07	fix(nix): lambda-promtail vendor hash (#12763)	2 years ago
Callum Styan	dce86bfada	ci: add a github workflow to verify that the release workflows are correct (#12603) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	2 years ago
Travis Patterson	1161846e19	fix(docs): Move promtail configuration to the correct doc (#12737)	2 years ago
Trevor Whitney	210ea93a69	feat: add detected-fields command to logcli (#12739)	2 years ago
Shantanu Alshi	587a6d20e9	feat: Detected labels from store (#12441)	2 years ago
J Stickler	904ef6eacd	docs: fix broken link (#12757)	2 years ago
Christian Haudum	8b63b66c71	docs: Update supported and deprecated type in Manage > Storage (#12742) ... Make distinction between supported and deprecated store types more visible on this page, similar to what's listed under Configure > Storage. Also updated the list of supported object store backends. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Paul Rogers	c178cc62df	test: Data race updates for memchunk tests (#12752)	2 years ago
Dylan Guedes	521d40a96a	fix: helm: Set compactor addr for distributed mode. (#12748)	2 years ago
dependabot[bot]	ff2063bcaf	chore(deps): bump golang.org/x/net from 0.17.0 to 0.23.0 in /pkg/push (#12694) ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Periklis Tsirakidis <periklis@redhat.com>	2 years ago
dependabot[bot]	0e8a247b58	chore(deps): bump golang.org/x/net from 0.17.0 to 0.23.0 in /tools/lambda-promtail (#12696) ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Periklis Tsirakidis <periklis@redhat.com>	2 years ago
dependabot[bot]	e31900336f	chore(deps): bump golang.org/x/net from 0.21.0 to 0.23.0 in /operator (#12698) ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Periklis Tsirakidis <periklis@redhat.com>	2 years ago
dependabot[bot]	746ca2aee5	chore(deps): bump golang.org/x/net from 0.22.0 to 0.23.0 (#12699) ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Periklis Tsirakidis <periklis@redhat.com>	2 years ago
Christian Haudum	5540c92d50	perf(blooms): Resolve bloom blocks on index gateway and shard by block address (#12720) ... This pull request changes how data is sharded across bloom gateways. Currently, chunks are grouped by series and shared by the fingerprint of the series across the available bloom gateways using jumphash algorithm. This however, leads to over-querying bloom blocks, because bloom blocks have consecutive fingerprint ranges, whereas sharding keys are evenly distributed across keyspace. This PR changes the sharding in the way that bloom blocks for series are already resolved on the index gateways and that their address is used for sharding data. This has the advantage that the grouped series can be mapped to the correct bloom blocks on the client side. Sending the block ref along with the grouped series to the bloom gateway allows for efficient querying of the data because each bloom gateway therefore owns exactly 1/nth of the blocks. --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Joshua Pare	a00f1f1b0b	fix(promtail): Fix UDP receiver on syslog transport (#10708) ... Co-authored-by: Callum Styan <callumstyan@gmail.com>	2 years ago