63 Commits (7c85dd9e2d2b463d8d362aecefecfb2be02adaaf)

Author	SHA1	Message	Date
Karsten Jeschkies	75593e0ed7	refactor(stringlabels): Support stringlabels in loghttp, pattern and ruler tests. (#17102)	9 months ago
Trevor Whitney	66033bb967	fix: pattern ingester pushes detected level as structured metadata (#16924)	9 months ago
Paul Rogers	24c260e3e4	chore(deps): Update dskit (#16782)	10 months ago
Paul Rogers	27431b7e7e	chore: Linting update for new golangci (#16572)	10 months ago
Trevor Whitney	86d50ad7dd	fix: don't send empty aggregated metric payloads (#15756)	12 months ago
Paul Rogers	606f2f1a4d	test: Increase buffer size to prevent timeouts in tests (#15498)	1 year ago
Ned Andreev	5d8220c3e9	fix: data race / nil channel read in pattern aggregation push (#15410)	1 year ago
Paul Rogers	f2c2a22bdc	chore: Preparation for incoming static code analysis CI check (#15164) ... Co-authored-by: Danny Cooper <danny.cooper@grafana.com>	1 year ago
Eng Zer Jun	062d1e9ca4	refactor: replace experimental `maps` and `slices` with stdlib (#15051) ... Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>	1 year ago
Shantanu Alshi	215f994d0e	fix(metric_aggregation): Fix duplicate metrics registration (#15142)	1 year ago
Trevor Whitney	dea5d7883a	feat: add lines skipped metric to pattern ingesters (#14997)	1 year ago
Shantanu Alshi	d3d31f1842	chore(aggregated_metrics): Add metrics to aggreated metrics (#14986)	1 year ago
Cyril Tovena	90c5dbf0d3	chore: Revert syntax module (#14831)	1 year ago
Cyril Tovena	28c9645d10	chore: Introduce logql/syntax go module (#14790)	1 year ago
Trevor Whitney	80aec25482	feat: Improve pattern ingester tracing (#14707)	1 year ago
Trevor Whitney	c1fde26730	feat: move metric aggregation to a per-tenant config (#14709)	1 year ago
Salva Corts	70508975fd	feat: Configurable list of json fields to mine patterns (#14528)	1 year ago
Trevor Whitney	b5462b6639	chore: remove copied loop vars (#14383)	1 year ago
Ravishankar	41fafd8793	feat: Apply patterns line length limit to json message key (#14296)	1 year ago
Trevor Whitney	c001a1d93a	fix: allow any level for aggregated metrics (#14255)	1 year ago
Cyril Tovena	ae955ed30d	fix(pattern): Fixes latency metric namespace for tee to pattern (#14241)	1 year ago
Sven Grossmann	63e84b476a	fix(aggregated-metrics): correctly create logfmt string (#14124)	1 year ago
Sven Grossmann	0780456662	feat(max-allowed-line-length): add config to set `max-allowed-line-length` in pattern ingester (#14070) ... Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	1 year ago
Paul Rogers	18cef217fc	chore: Linting updates in prep for Go 1.23 (#14071)	1 year ago
Paul Rogers	8fb7b488bd	chore(deps): update dskit 20240819 (#13924)	1 year ago
Trevor Whitney	d2474fa989	fix: split the error and agg metric cases for clarity (#13913)	1 year ago
Trevor Whitney	913e9f9347	feat: aggregate byte and count metrics (#13731)	1 year ago
Travis Patterson	feee240f46	chore: remove unused pattern tokenization form Loki (#13783)	1 year ago
Trevor Whitney	c6ab6b31e8	chore: remove initial metric aggregation experiment (#13729)	1 year ago
Ned Andreev	7683a79191	fix: Include whitespaces in extracted tokens (#13738) ... Co-authored-by: Travis Patterson <travis.patterson@grafana.com>	1 year ago
Marco Pracucci	b88583da7d	feat: upgrade prometheus (#13671) ... Signed-off-by: Marco Pracucci <marco@pracucci.com> Signed-off-by: Vladyslav Diachenko <vlad.diachenko@grafana.com> Co-authored-by: Vladyslav Diachenko <vlad.diachenko@grafana.com>	1 year ago
George Robinson	757bde0cb5	chore: replace pkg/errors with errors (#13582)	1 year ago
benclive	e23598d710	fix: Dedup pattern tokens on output (#13534)	1 year ago
benclive	5fa9c4bd56	fix: Retain original values in logfmt pattern tokenizer (#13535)	1 year ago
Ned Andreev	ac284ca00e	feat: improve placeholder replacement of byte sizes (#13508)	1 year ago
Trevor Whitney	2c053ee00c	feat: downsample aggregated metrics (#13449)	1 year ago
Cyril Tovena	e08b4a7f88	feat: Pattern ingesters add a limiter for high eviction rate (#13464)	1 year ago
Cyril Tovena	7c86e651ac	fix: Fixes pattern pruning stability (#13429)	2 years ago
Christian Haudum	5ebd24dfb2	chore: Convert iterators in pattern module to `v2.Iterator` interface (#13407) ... This is first follow up to #13273 It changes the iterator from the pattern module to use the `v2.CloseIterator` to avoid re-implementing the iterator logic. With this change, the function `Error()` on the pattern iterator is renamed to `Err()` to conform with the `v2.Iterator` interface. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Cyril Tovena	bc01e6fd64	feat: Drain uses different tokenizer based on log format (#13384)	2 years ago
benclive	e612dd3dfe	feat: exclude in pattern tokens (#13397)	2 years ago
benclive	8c8454b9db	feat: exclude and from creating new tokens in patterns (#13395)	2 years ago
benclive	a1efafdad2	perf: Limit tokens per pattern to 128 (#13376)	2 years ago
Christian Haudum	d8cc1cea83	chore: Make dedicated iterator package (#13273) ... Iterators of various types are widely used throughout the Loki code base. With the recent code additions of the bloom filters, a new set of utility functions for iterators emerged in `github.com/grafana/loki/v3/pkg/storage/bloom/v1`. The package defines interfaces for various common types, but also provides implementations to create and compose new iterators that implement these interfaces. This new package uses Go Generics. - However, at the current state, there are multiple iterator interfaces and implementations, which adds cognitive overhead in understanding how they work and which ones should be used. The idea is to unify them into a single iterator lib for Loki. - As a first step towards a single iterator library for the Loki code base, this PR moves the utilities from the `pkg/storage/bloom/v1` package to the `pkg/iter/v2` package. - Second, it changes the existing `EntryIterator` and `SampleIterator` iterators to "inherit" `v2.CloseIterator` in order to expose the same function names. - And lastly, naming conventions of iterator interfaces and structs are unified. The basic iterator interface (defined in `pkg/iter/v2/interface.go`) looks like so: ```go // Usage: // // for it.Next() { // curr := it.At() // // do something // } // if it.Err() != nil { // // do something // } type Iterator[T any] interface { Next() bool Err() error At() T } ``` --- Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
benclive	bf1d6e36f7	perf: Gather aggregate per-line and per-tenant metrics for Drain patterns (#13368)	2 years ago
benclive	5ef18cff92	perf: Prune unused pattern branches (#13329)	2 years ago
Cyril Tovena	41fbacdce7	feat(wal): Add sizing information to writer and reader. (#13267)	2 years ago
Trevor Whitney	467eb1bb1b	feat: collect and serve pre-aggregated bytes and counts (#13020) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	2 years ago
benclive	6a0fdd0880	feat: Add new Drain tokenizer that splits on most punctuation (#13143)	2 years ago
benclive	30df31e28b	feat: Tune Patterns query drain instance (#13137)	2 years ago