apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Ed Welch	5602a49489	update references to new 2.4.0 image (#4672 )	4 years ago
Ed Welch	3fef08ca1a	2.4 release notes, changelog, upgrade guide (#4658 ) * update changelog, release notes, and upgrade guide for 2.4 * tweak release notes a little * make path relative for kafka config * update upgrade guide * more docs fix the cache size not applied to results cache. * fix prefix name in ring_config	4 years ago
Trevor Whitney	bfc77118a1	Update local and docker config for simple scalable deployment (#4660 ) * first draft of local config * remove a few more defaults * interface names fix means we do not need lifecycler ip * update rings to use collectors/ prefix fix replication factor chunks-retain-period default to 0s fix a bug introduced with a Go upgrade? on printing the schema date. * simplify the config for the ruler, synthesize the local directory * simplify loki-docker-config.yaml * change common filesystem config to have chunks and rules directory * now that we are calling register flags on the common ring config we set more values and some of the tests needed to be tweaked. updated a few paths as well. * fix tests Co-authored-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Dylan Guedes	90c4821dd3	Docs: Document the common ring section (#4664 ) * Document the common ring section. - Create a new <ring_config> section that document the pkg/util/ring_config.go - Rewrite ruler and scheduler_ring docs to make usage of <ring_config> section - Document new ring under common section * Update docs/sources/configuration/_index.md Co-authored-by: Ed Welch <ed@oqqer.com>	4 years ago
Dylan Guedes	910d604a73	Document duplicated protos warning occurence. (#4650 )	4 years ago
Susana Ferreira	895d144303	Fix dskit/ring metric with 'cortex_' prefix (#4656 )	4 years ago
Cyril Tovena	72292cbab3	Add a test to verify goroutine leak in compression pools. (#4653 ) * Add a test to verify goroutine leak in compression pools. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Account for other goroutine tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve test with eventually. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Ed Welch	4e2812b9f3	no longer publish `latest` tag on every push to main (#4651 ) publish `latest` tag when building tagged release	4 years ago
Callum Styan	678495a972	Instrument s3 client DeleteObject requests. (#4649 ) Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Karen Miller	e95d193acf	Docs: revise modes of operation section (#4646 )	4 years ago
Trevor Whitney	3f9d067e07	compactor depends on memberlist for memberlist ring option (#4643 )	4 years ago
Ed Welch	89ee022c21	Loki: fix handling of tail requests when using target `all` or `read` (#4642 ) * better handling of tail requests when the frontend and querier are running in the same process * adding function to determine if a module is enable based on the target supplied to Loki * fix tests and incorrect registering of tail routes * renamed function and made check for active recursive	4 years ago
Susana Ferreira	2d24e2ea64	Migration to dskit/ring (#4641 )	4 years ago
Ed Welch	2ac409c23e	Build: simplify how protos are built (#4639 ) * we always seem to be chasing our tails with how protos are generated and Makes use of timestamps to determine if files should be recompiled. Instead of touching files and altering timestamps always delete the compiled proto files when calling `protos` to make sure they are compiled every time. Removed targets to build protos, yaccs, and ragel files when trying to build loki or the canary. This isn't necesary, if you are changing these files you would know you need to build them and the `check-generated-files` should catch any changes to them not committed. * rm -rf * we have a race between check-generated-files and our other steps, so let that run first. also removing `check-generated-files` from the `all` target because its redundant with a separate step and could also race with the parallel lint * remove TOUCH_PROTOS * more cleanup of TOUCH_PROTOS	4 years ago
Cyril Tovena	c8f3df33cf	Promtail Kafka target (#4568 ) * Adds a kafka target manager in promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add validations. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Working on tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Moar test for the fanout client. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Finishing off tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * final adjustement Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adding topics discovery. Still needs to finish tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Finishing off testing it. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Revert config changes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add group id as discovered label Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * linter Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add tools for running kafka and testing locally. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * got linted shell Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update sarama to compile in ARM. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation for kafka target. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve code comment. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add a few s's * Better cancellation support. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * adds `__meta_kafka_` suffix to discovered labels. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Periklis Tsirakidis	c3e282e030	Fix local kind deployments (#101 )	4 years ago
Trevor Whitney	07ea1ed99c	Add common ring configuration (#4617 ) * add ring section to common config Co-Authored-By: Dylan Guedes <djmgguedes@gmail.com> * fix compactor test to append loopback interface it ifnames in test if present * add loopback interface to compactor ring iface names * clean-up from PR review Co-authored-by: Dylan Guedes <djmgguedes@gmail.com> * only appy ingester config to rings with no non-default properties Co-authored-by: Dylan Guedes <djmgguedes@gmail.com>	4 years ago
Dylan Guedes	0d66319a1f	Revert distributor defaulting to inmemory. (#4638 ) - [PR 4440](https://github.com/grafana/loki/pull/4440/files) modified the distributor setup to use inmemory by default (instead of consul). That was necessary because, by changing the default rate limiting to global, a ring was necessary, and since by default the ring was set to consul, the project couldn't run with the default configs. That's not the case anymore: right now we are reusing the same config set for the ingester (which users already have properly configured otherwise they wouldn't be able to run the project). List of changes: - Remove changelog entries - Remove upgrading guide entries - Remove added tests (unnecessary checks) - Remove value overriding	4 years ago
Sandeep Sukhani	2564a810c5	Logs deletion fixes (#4625 ) * check all tables when we have delete requests to process since chunks could span multiple tables * upload modified index when the it is modified without dropping the chunk * fix broken test * lint * Fix modified check Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> * suggested changes from PR review * add changelog Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Roger Steneteg	3b66d94e0f	resolve issue with promtail not scraping target if only path changed in a simpler way that dont need mutex to sync threads (#4599 ) Signed-off-by: Roger Steneteg <rsteneteg@ea.com>	4 years ago
Cyril Tovena	6319af1ac6	Fixes the operational dashboard using an old metric. (#4634 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Owen Diehl	0e0d0b7897	dont try to use the scheduler ring when a downstream url is configured (#4635 )	4 years ago
Kaviraj	d53aef63b1	Add changelog and upgrade guide for #4556 (#4631 ) Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Owen Diehl	91d5cce8ad	index-gw sts doc fix. closes #4583 (#4616 ) * index-gw sts doc fix. closes #4583 * Update docs/sources/operations/storage/boltdb-shipper.md Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com> Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Owen Diehl	e8bd3cb579	Default wal to enabled in jsonnet lib (#4629 ) * default wal to enabled * update changelog & upgrade.md	4 years ago
Christian Haudum	929c8e4923	Allow HTTP POST requests on ring pages (#4630 ) The ring pages offer the ability to "forget" instances of the ring and this is implemented by a HTTP `form` element, which does a `POST` request on itself. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Danny Kopping	5b30589acf	Documenting recording rules per-tenant WAL (#4566 ) * WIP Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Document ruler config options Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Self-review updates Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Clarifying WAL benefit in response to review Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding dashboard link Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Update docs/sources/configuration/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Ensuring ruler and ingester default WAL paths do not conflict Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
SurDaft - Jack Stupple	3dd0702b7c	Fix typo in docs (#4612 ) Fix a typo in the documentation	4 years ago
Ed Welch	de4993f921	explicitly define allowed HTTP methods on HTTP endpoints (#4627 )	4 years ago
Christian Haudum	5c99962161	Disable chunk transfers in jsonnet lib (#4624 ) Since the WAL is now enabled by default and incompatible with chunk transfer, the latter needs to be disabled (setting to `0`). The default of `max_transfer_retries` is `0` and therefore the setting can be removed. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Callum Styan	5640cd0f7c	Simplify standard label selectors (datsource, cluster, namespace) on (#4618 ) multiple dashboards + fix broken logs dashboard. Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
James Callahan	a92541bd84	Promtail: no need for GCP promtail_instance label now that loki supports out-of-order writes (#4556 ) Closes #4474	4 years ago
Trevor Whitney	62ee399e48	default ingester final sleep to 0 unless otherwise specified (#4608 ) * default ingester final sleep to 0 unless otherwise specified * add changelog and upgrading * update config docs	4 years ago
Ed Welch	fe8bc9144f	Loki: query scheduler should send shutdown to frontends when ReplicationSet changes (#4614 ) * make sure we send a shutdown message to frontends from the scheduler when the ReplicationSet changes so that inflight queries are canceled and retried in the frontends. * use Write so we find an instance incase one is unhealthy	4 years ago
Owen Diehl	308af871cf	uses ring.Write instead of ring.WriteNoExtend for compactor ring checks (#4615 )	4 years ago
Kaviraj	1e0386e9e6	Fix `ip` matcher lexer to differentiate filter from identifier (#4598 ) * Fix `ip` matcher lexer to differentiate filter from identifier Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Revert small fmt fix on expr.y Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks from Cyril Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add ip line filter parser test in mix with ip as label Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Garrett	1c7df620c4	add date time sprig template functions in logql label/line formatter (#4603 ) * add date time sprig template functions in logql label/line formatter With date time sprig template functions, we will be able to filter test jobs which create time is 1 day before as the following: ``` {job="test"} \| label_format nowEpoch=`{{(unixEpoch now)}}`,createDateEpoch=`{{unixEpoch (toDate "2006-01-02" .createDate)}}` \| label_format dateTimeDiff="{{sub .nowEpoch .createDateEpoch}}" \| dateTimeDiff > 86400 ``` * add documents for date time sprig template functions * resolve comments * add golang datetime layout doc reference * update CHANGELOG.md accordingly to include this PR	4 years ago
Karen Miller	96130ae389	Docs: revise incendiary language added in PR 4507 (#4611 )	4 years ago
Ed Welch	289c946667	put Karen back in charge of the docs! (#4609 )	4 years ago
Owen Diehl	84220c4b02	improves scheduler & compactor ringwatcher checks (#4607 )	4 years ago
Ed Welch	0c9beadaaa	Loki: Add a ring to the compactor used to control concurrency when not running standalone (#4574 ) * add a ring to the compactor * wiring up the start/stop functionality * add some monitoring for multiple compactors running at the same time. * Add compactor to `read` target * fix tests/validation requirements * Update pkg/storage/stores/shipper/compactor/compactor_ring.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update pkg/storage/stores/shipper/compactor/compactor_ring.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update pkg/storage/stores/shipper/compactor/compactor_ring.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * used a shared ring_config between scheduler and compactor to avoid some duplication * fix lint * better handling of the tokens file with a way to easily tell all the rings to persist tokens * fix query scheduler replication factor * removing "scheduler" from log line which may be called by components other than a scheduler in the future. * update changelog Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Kaviraj	cf2dacf70f	Update PR template to include `changelog` update in the checklist (#4604 ) Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Mustafa Can Sevinç	2a1d8005dc	docs: fix promtail docs links in loki installation page (#4601 ) * docs: fix promtail docs links in loki installation page fixes link to "syslog-reciever" and "systemd-journal" config docs Signed-off-by: Mustafa Can Sevinç <mcansevinc@gmail.com> * docs: fix relative links in helm docs Signed-off-by: Mustafa Can Sevinç <mcansevinc@gmail.com>	4 years ago
Hiroki Sakamoto	1ff95fc025	Respect gRPC context error when handling errors (#4593 ) * Respect rpc status when handling http errors * Format by goimport * Update pkg/util/errors.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update pkg/util/errors.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update pkg/util/errors.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Add some tests * context, rpc cancelled and another error case * context, rpc deadline exceeded and another error case Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Owen Diehl	6eab7be5b4	a few doc fixes in preparation for 2.4 (#4597 )	4 years ago
Hiroki Sakamoto	0e21f02d76	Respect shard number in series api (#4577 ) * Respect shard number in series api * Refactor codes * remove duplicate logic in instance * format with goimport * Improve complexity of getting all fingerprints	4 years ago
Owen Diehl	0c97afadbc	cleans up redundant setting of stream.unorderedWrites=true when replaying wal (#4595 )	4 years ago
Owen Diehl	633b4cab53	ignore validity window during wal replay (#4596 )	4 years ago
Owen Diehl	45113cb375	Enable unordered_writes by default (#4594 ) * enable unordered_writes by default * removes out_of_orders from transfer test * update changelog	4 years ago
Owen Diehl	cd80bc5e7e	introduces "entry too far behind" instrumentation for unordered writes (#4592 )	4 years ago

... 3 4 5 6 7 ...

2954 Commits (40f56c629134e8f29e6617320432247bd15a5865) All Branches Search

2954 Commits (40f56c629134e8f29e6617320432247bd15a5865)

All Branches