apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Sandeep Sukhani	a707ced67f	index cleanup fixes while applying retention (#4741 ) * Add metric name to the label if missing for building index entries for deletion * fix calculation of table interval from table name * add changelog * add test for series cleanup without __name__ label	4 years ago
Cameron McDermott	5dc3af01fc	Add northflank to the adopters list (#4729 ) Signed-off-by: Champ-Goblem <cameron_mcdermott@yahoo.co.uk>	4 years ago
Cyril Tovena	81e67f89b3	Add GELF support for Promtail. (#4744 ) * Add Gelf support for Promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Changelog Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move change to MAIN Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update graylog to grafana remote. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add a test and check mod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add log messages around startup and shutdown Co-authored-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Karsten Jeschkies	1e796b070f	Give more context to rule parser errors. (#4730 ) Summary: - Give record and group name for failing parsing.	4 years ago
Karsten Jeschkies	c19a6c5bbc	Join contain filters into one. (#4528 ) * Join contain filters into one. * Update pkg/logql/log/filter.go Co-authored-by: Dylan Guedes <djmgguedes@gmail.com> * Test Filter method. * Test old and new filter consturctors. * Remove comment. * Define more benchmark cases. * Take care of empty contain filters. * Satisfy linter. * USe different method to filter. * Simplify all filter concat. * Format code. * Push regex filters to the end. * Remove unused test. * Add a few more tests. * Make filters private again. * Fix test failure. * Only accumulate successive contain filters. * Reverse accumulation. * Satisfy linter. * Remove old version. Co-authored-by: Dylan Guedes <djmgguedes@gmail.com>	4 years ago
Sandeep Sukhani	02d88462f3	allow applying retention at different interval than compaction with a config (#4736 ) * allow applying retention at different interval than compaction with a config * add changelog entry	4 years ago
Cyril Tovena	11071d4c31	Improves memchunk benchmark to account for block size. (#4645 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Callum Styan	0ee476b758	Simplify chunk flush rate % query. (#4711 ) Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Cyril Tovena	d81f757ecb	Refactor and simplify stats package. (#4712 ) * Refactor and simplify stats package. This PR refactors the stats package and make it smaller and simpler to work with. - It doesn't expose the context which can causes race when mutating it. - Uses concurrency primitive to ensure correctness - Replace trailers with in-batch statistics to propagate ingesters stats. Fixes #3366 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fix tests and lint issues. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes moar tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * mod-check Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * More fixes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Owen Diehl	0116aa61c8	ensures components with required SRV lookups use the correct port (#4737 ) * ensures components with required SRV lookups use the correct port naming (_grpclb prefix) * Update production/ksonnet/loki/query-frontend.libsonnet Co-authored-by: Ed Welch <ed@oqqer.com> Co-authored-by: Ed Welch <ed@oqqer.com>	4 years ago
Jiří Sejkora	925de9e102	Docs: Fix a typo (#4726 )	4 years ago
Cyril Tovena	2f1e2fc3d2	Fixes Promtail User-Agent. (#4716 ) This was because promtail client was still user the old version.Version which is initialized at run-time via init. But if we use it also at init time there's no guarantee that the version will be set. So intead I'm using the original version variable stamped in the binary and not at runtime. Fixes #4686 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Karen Miller	6d520f95b3	Docs: small v2.4.1 release notes edits (#4718 )	4 years ago
Hiroki Sakamoto	1557dab34f	Add SASL&mTLS authentication support for Kafka in Promtail (#4663 ) * Add xdg-go module * Add mTLS, SASL/PLAIN, SASL/SCRAM authentication support * docs: Add authentication configuration * Add test tools for kafka authentication * Add test stacks for SSL, SASL/PLAIN, SASL/SCRAM, SASL over TLS authentication * Fix shelllint	4 years ago
Karsten Jeschkies	9762b31418	Only execute benchmarks on main. (#4710 ) * Only execute benchmarks on main. * Remove condition. * Update .drone/drone.jsonnet * Generate .drone.yml.	4 years ago
Karsten Jeschkies	5b9f5b9efa	Run benchmarks in cron jobs. (#4636 ) * Run benchmarks in cron jobs. * Increase benchmark timeout. * Trigger every four hours.	4 years ago
Ed Welch	413ffab235	update everything for 2.4.1 (#4701 )	4 years ago
Sandeep Sukhani	20726e6ba1	fix flaky retention tests (#4697 )	4 years ago
Ed Welch	90d5d24998	Project: Loki 2.4.1 release notes (#4688 ) * add 2.4.1 bug fixes * update changelog	4 years ago
Owen Diehl	e52e805144	Adds replication_factor doc to common config (#4683 ) Oops, looks like we missed adding this to the configuration docs.	4 years ago
Owen Diehl	4d8009cacc	overrides checks for nil tenant limits on AllByUserID (#4687 )	4 years ago
Ed Welch	fbebf67588	Loki: check new Read target when initializing boltdb-shipper store (#4681 ) * make sure to check for new `Read` target when setting up boltdb-shipper * also need to make sure ingester querier is added as a dep for Read target * improve the comment on why we shorten the cache validity. * fix shellcheck errors * apply smart defaults to chunk retain period to avoid query gaps. * typo	4 years ago
Karen Miller	c538171d65	Docs: revise v2.4 release notes (#4675 )	4 years ago
Ed Welch	5602a49489	update references to new 2.4.0 image (#4672 )	4 years ago
Ed Welch	3fef08ca1a	2.4 release notes, changelog, upgrade guide (#4658 ) * update changelog, release notes, and upgrade guide for 2.4 * tweak release notes a little * make path relative for kafka config * update upgrade guide * more docs fix the cache size not applied to results cache. * fix prefix name in ring_config	4 years ago
Trevor Whitney	bfc77118a1	Update local and docker config for simple scalable deployment (#4660 ) * first draft of local config * remove a few more defaults * interface names fix means we do not need lifecycler ip * update rings to use collectors/ prefix fix replication factor chunks-retain-period default to 0s fix a bug introduced with a Go upgrade? on printing the schema date. * simplify the config for the ruler, synthesize the local directory * simplify loki-docker-config.yaml * change common filesystem config to have chunks and rules directory * now that we are calling register flags on the common ring config we set more values and some of the tests needed to be tweaked. updated a few paths as well. * fix tests Co-authored-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Dylan Guedes	90c4821dd3	Docs: Document the common ring section (#4664 ) * Document the common ring section. - Create a new <ring_config> section that document the pkg/util/ring_config.go - Rewrite ruler and scheduler_ring docs to make usage of <ring_config> section - Document new ring under common section * Update docs/sources/configuration/_index.md Co-authored-by: Ed Welch <ed@oqqer.com>	4 years ago
Dylan Guedes	910d604a73	Document duplicated protos warning occurence. (#4650 )	4 years ago
Susana Ferreira	895d144303	Fix dskit/ring metric with 'cortex_' prefix (#4656 )	4 years ago
Cyril Tovena	72292cbab3	Add a test to verify goroutine leak in compression pools. (#4653 ) * Add a test to verify goroutine leak in compression pools. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Account for other goroutine tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve test with eventually. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Ed Welch	4e2812b9f3	no longer publish `latest` tag on every push to main (#4651 ) publish `latest` tag when building tagged release	4 years ago
Callum Styan	678495a972	Instrument s3 client DeleteObject requests. (#4649 ) Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Karen Miller	e95d193acf	Docs: revise modes of operation section (#4646 )	4 years ago
Trevor Whitney	3f9d067e07	compactor depends on memberlist for memberlist ring option (#4643 )	4 years ago
Ed Welch	89ee022c21	Loki: fix handling of tail requests when using target `all` or `read` (#4642 ) * better handling of tail requests when the frontend and querier are running in the same process * adding function to determine if a module is enable based on the target supplied to Loki * fix tests and incorrect registering of tail routes * renamed function and made check for active recursive	4 years ago
Susana Ferreira	2d24e2ea64	Migration to dskit/ring (#4641 )	4 years ago
Ed Welch	2ac409c23e	Build: simplify how protos are built (#4639 ) * we always seem to be chasing our tails with how protos are generated and Makes use of timestamps to determine if files should be recompiled. Instead of touching files and altering timestamps always delete the compiled proto files when calling `protos` to make sure they are compiled every time. Removed targets to build protos, yaccs, and ragel files when trying to build loki or the canary. This isn't necesary, if you are changing these files you would know you need to build them and the `check-generated-files` should catch any changes to them not committed. * rm -rf * we have a race between check-generated-files and our other steps, so let that run first. also removing `check-generated-files` from the `all` target because its redundant with a separate step and could also race with the parallel lint * remove TOUCH_PROTOS * more cleanup of TOUCH_PROTOS	4 years ago
Cyril Tovena	c8f3df33cf	Promtail Kafka target (#4568 ) * Adds a kafka target manager in promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add validations. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Working on tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Moar test for the fanout client. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Finishing off tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * final adjustement Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adding topics discovery. Still needs to finish tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Finishing off testing it. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Revert config changes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add group id as discovered label Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * linter Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add tools for running kafka and testing locally. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * got linted shell Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update sarama to compile in ARM. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation for kafka target. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve code comment. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add a few s's * Better cancellation support. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * adds `__meta_kafka_` suffix to discovered labels. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Trevor Whitney	07ea1ed99c	Add common ring configuration (#4617 ) * add ring section to common config Co-Authored-By: Dylan Guedes <djmgguedes@gmail.com> * fix compactor test to append loopback interface it ifnames in test if present * add loopback interface to compactor ring iface names * clean-up from PR review Co-authored-by: Dylan Guedes <djmgguedes@gmail.com> * only appy ingester config to rings with no non-default properties Co-authored-by: Dylan Guedes <djmgguedes@gmail.com>	4 years ago
Dylan Guedes	0d66319a1f	Revert distributor defaulting to inmemory. (#4638 ) - [PR 4440](https://github.com/grafana/loki/pull/4440/files) modified the distributor setup to use inmemory by default (instead of consul). That was necessary because, by changing the default rate limiting to global, a ring was necessary, and since by default the ring was set to consul, the project couldn't run with the default configs. That's not the case anymore: right now we are reusing the same config set for the ingester (which users already have properly configured otherwise they wouldn't be able to run the project). List of changes: - Remove changelog entries - Remove upgrading guide entries - Remove added tests (unnecessary checks) - Remove value overriding	4 years ago
Sandeep Sukhani	2564a810c5	Logs deletion fixes (#4625 ) * check all tables when we have delete requests to process since chunks could span multiple tables * upload modified index when the it is modified without dropping the chunk * fix broken test * lint * Fix modified check Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> * suggested changes from PR review * add changelog Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Roger Steneteg	3b66d94e0f	resolve issue with promtail not scraping target if only path changed in a simpler way that dont need mutex to sync threads (#4599 ) Signed-off-by: Roger Steneteg <rsteneteg@ea.com>	4 years ago
Cyril Tovena	6319af1ac6	Fixes the operational dashboard using an old metric. (#4634 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Owen Diehl	0e0d0b7897	dont try to use the scheduler ring when a downstream url is configured (#4635 )	4 years ago
Kaviraj	d53aef63b1	Add changelog and upgrade guide for #4556 (#4631 ) Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Owen Diehl	91d5cce8ad	index-gw sts doc fix. closes #4583 (#4616 ) * index-gw sts doc fix. closes #4583 * Update docs/sources/operations/storage/boltdb-shipper.md Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com> Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Owen Diehl	e8bd3cb579	Default wal to enabled in jsonnet lib (#4629 ) * default wal to enabled * update changelog & upgrade.md	4 years ago
Christian Haudum	929c8e4923	Allow HTTP POST requests on ring pages (#4630 ) The ring pages offer the ability to "forget" instances of the ring and this is implemented by a HTTP `form` element, which does a `POST` request on itself. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Danny Kopping	5b30589acf	Documenting recording rules per-tenant WAL (#4566 ) * WIP Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Document ruler config options Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Self-review updates Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Clarifying WAL benefit in response to review Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding dashboard link Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Update docs/sources/configuration/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Ensuring ruler and ingester default WAL paths do not conflict Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
SurDaft - Jack Stupple	3dd0702b7c	Fix typo in docs (#4612 ) Fix a typo in the documentation	4 years ago

1 2 3 4 5 ...

2665 Commits (a707ced67f40554ddb1c2c771064ac9bca9292cf) All Branches Search

2665 Commits (a707ced67f40554ddb1c2c771064ac9bca9292cf)

All Branches