25 Commits (main)

Author	SHA1	Message	Date
Trevor Whitney	89396c190f	chore: use tenant instead of service_name for pattern_ingester_metric_samples (#20033)	2 weeks ago
Trevor Whitney	71e2e01ee2	feat: implement volume-based pattern filtering (#18838)	3 months ago
Trevor Whitney	c690827c6a	fix: limit volume and frequency of persisted patterns (#18362) ... Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	5 months ago
Robert Fratto	86c57c8616	chore: consistently use new labels.Labels API (#18490)	5 months ago
Christian Haudum	c167800b3f	fix(pattern): Fix feature flag for enabling pattern persistence (#18216) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	6 months ago
Trevor Whitney	fd7321c88b	feat: persist patterns as aggregated metrics (#17737) ... Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com>	7 months ago
Oleg Zaytsev	c8a15f451c	refactor: Use OTel tracing library (#17859) ... Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>	7 months ago
Trevor Whitney	4b0aaaaf2e	fix: hide __aggregated_metric__ in /series and /labels (#14677)	8 months ago
Trevor Whitney	66033bb967	fix: pattern ingester pushes detected level as structured metadata (#16924)	9 months ago
Cyril Tovena	90c5dbf0d3	chore: Revert syntax module (#14831)	1 year ago
Cyril Tovena	28c9645d10	chore: Introduce logql/syntax go module (#14790)	1 year ago
Trevor Whitney	80aec25482	feat: Improve pattern ingester tracing (#14707)	1 year ago
Salva Corts	70508975fd	feat: Configurable list of json fields to mine patterns (#14528)	1 year ago
Trevor Whitney	c001a1d93a	fix: allow any level for aggregated metrics (#14255)	1 year ago
Paul Rogers	18cef217fc	chore: Linting updates in prep for Go 1.23 (#14071)	1 year ago
Trevor Whitney	913e9f9347	feat: aggregate byte and count metrics (#13731)	1 year ago
Trevor Whitney	c6ab6b31e8	chore: remove initial metric aggregation experiment (#13729)	1 year ago
Cyril Tovena	e08b4a7f88	feat: Pattern ingesters add a limiter for high eviction rate (#13464)	1 year ago
Cyril Tovena	bc01e6fd64	feat: Drain uses different tokenizer based on log format (#13384)	2 years ago
Christian Haudum	d8cc1cea83	chore: Make dedicated iterator package (#13273) ... Iterators of various types are widely used throughout the Loki code base. With the recent code additions of the bloom filters, a new set of utility functions for iterators emerged in `github.com/grafana/loki/v3/pkg/storage/bloom/v1`. The package defines interfaces for various common types, but also provides implementations to create and compose new iterators that implement these interfaces. This new package uses Go Generics. - However, at the current state, there are multiple iterator interfaces and implementations, which adds cognitive overhead in understanding how they work and which ones should be used. The idea is to unify them into a single iterator lib for Loki. - As a first step towards a single iterator library for the Loki code base, this PR moves the utilities from the `pkg/storage/bloom/v1` package to the `pkg/iter/v2` package. - Second, it changes the existing `EntryIterator` and `SampleIterator` iterators to "inherit" `v2.CloseIterator` in order to expose the same function names. - And lastly, naming conventions of iterator interfaces and structs are unified. The basic iterator interface (defined in `pkg/iter/v2/interface.go`) looks like so: ```go // Usage: // // for it.Next() { // curr := it.At() // // do something // } // if it.Err() != nil { // // do something // } type Iterator[T any] interface { Next() bool Err() error At() T } ``` --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
benclive	bf1d6e36f7	perf: Gather aggregate per-line and per-tenant metrics for Drain patterns (#13368)	2 years ago
Trevor Whitney	467eb1bb1b	feat: collect and serve pre-aggregated bytes and counts (#13020) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	2 years ago
benclive	bc53b33721	feat: Add metrics for number of patterns detected & evicted (#12918)	2 years ago
benclive	7b8533e435	feat: Add step param to Patterns Query API (#12703)	2 years ago
Cyril Tovena	491d2513e7	feat: add log patterns ingestion and query API. (#12403) ... Signed-off-by: Edward Welch <edward.welch@grafana.com> Co-authored-by: Anton Kolesnikov <anton.e.kolesnikov@gmail.com> Co-authored-by: Sven Grossmann <svennergr@gmail.com> Co-authored-by: Edward Welch <edward.welch@grafana.com>	2 years ago