apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Ed Welch	413ffab235	update everything for 2.4.1 (#4701 )	4 years ago
Ed Welch	90d5d24998	Project: Loki 2.4.1 release notes (#4688 ) * add 2.4.1 bug fixes * update changelog	4 years ago
Owen Diehl	e52e805144	Adds replication_factor doc to common config (#4683 ) Oops, looks like we missed adding this to the configuration docs.	4 years ago
Karen Miller	c538171d65	Docs: revise v2.4 release notes (#4675 )	4 years ago
Ed Welch	5602a49489	update references to new 2.4.0 image (#4672 )	4 years ago
Ed Welch	3fef08ca1a	2.4 release notes, changelog, upgrade guide (#4658 ) * update changelog, release notes, and upgrade guide for 2.4 * tweak release notes a little * make path relative for kafka config * update upgrade guide * more docs fix the cache size not applied to results cache. * fix prefix name in ring_config	4 years ago
Dylan Guedes	90c4821dd3	Docs: Document the common ring section (#4664 ) * Document the common ring section. - Create a new <ring_config> section that document the pkg/util/ring_config.go - Rewrite ruler and scheduler_ring docs to make usage of <ring_config> section - Document new ring under common section * Update docs/sources/configuration/_index.md Co-authored-by: Ed Welch <ed@oqqer.com>	4 years ago
Dylan Guedes	910d604a73	Document duplicated protos warning occurence. (#4650 )	4 years ago
Karen Miller	e95d193acf	Docs: revise modes of operation section (#4646 )	4 years ago
Cyril Tovena	c8f3df33cf	Promtail Kafka target (#4568 ) * Adds a kafka target manager in promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add validations. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Working on tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Moar test for the fanout client. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Finishing off tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * final adjustement Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adding topics discovery. Still needs to finish tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Finishing off testing it. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Revert config changes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add group id as discovered label Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * linter Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add tools for running kafka and testing locally. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * got linted shell Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update sarama to compile in ARM. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation for kafka target. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve code comment. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add a few s's * Better cancellation support. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * adds `__meta_kafka_` suffix to discovered labels. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Dylan Guedes	0d66319a1f	Revert distributor defaulting to inmemory. (#4638 ) - [PR 4440](https://github.com/grafana/loki/pull/4440/files) modified the distributor setup to use inmemory by default (instead of consul). That was necessary because, by changing the default rate limiting to global, a ring was necessary, and since by default the ring was set to consul, the project couldn't run with the default configs. That's not the case anymore: right now we are reusing the same config set for the ingester (which users already have properly configured otherwise they wouldn't be able to run the project). List of changes: - Remove changelog entries - Remove upgrading guide entries - Remove added tests (unnecessary checks) - Remove value overriding	4 years ago
Kaviraj	d53aef63b1	Add changelog and upgrade guide for #4556 (#4631 ) Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Owen Diehl	91d5cce8ad	index-gw sts doc fix. closes #4583 (#4616 ) * index-gw sts doc fix. closes #4583 * Update docs/sources/operations/storage/boltdb-shipper.md Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com> Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Owen Diehl	e8bd3cb579	Default wal to enabled in jsonnet lib (#4629 ) * default wal to enabled * update changelog & upgrade.md	4 years ago
Danny Kopping	5b30589acf	Documenting recording rules per-tenant WAL (#4566 ) * WIP Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Document ruler config options Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Self-review updates Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Clarifying WAL benefit in response to review Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding dashboard link Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Update docs/sources/configuration/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Ensuring ruler and ingester default WAL paths do not conflict Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
SurDaft - Jack Stupple	3dd0702b7c	Fix typo in docs (#4612 ) Fix a typo in the documentation	4 years ago
James Callahan	a92541bd84	Promtail: no need for GCP promtail_instance label now that loki supports out-of-order writes (#4556 ) Closes #4474	4 years ago
Trevor Whitney	62ee399e48	default ingester final sleep to 0 unless otherwise specified (#4608 ) * default ingester final sleep to 0 unless otherwise specified * add changelog and upgrading * update config docs	4 years ago
Garrett	1c7df620c4	add date time sprig template functions in logql label/line formatter (#4603 ) * add date time sprig template functions in logql label/line formatter With date time sprig template functions, we will be able to filter test jobs which create time is 1 day before as the following: ``` {job="test"} \| label_format nowEpoch=`{{(unixEpoch now)}}`,createDateEpoch=`{{unixEpoch (toDate "2006-01-02" .createDate)}}` \| label_format dateTimeDiff="{{sub .nowEpoch .createDateEpoch}}" \| dateTimeDiff > 86400 ``` * add documents for date time sprig template functions * resolve comments * add golang datetime layout doc reference * update CHANGELOG.md accordingly to include this PR	4 years ago
Karen Miller	96130ae389	Docs: revise incendiary language added in PR 4507 (#4611 )	4 years ago
Ed Welch	0c9beadaaa	Loki: Add a ring to the compactor used to control concurrency when not running standalone (#4574 ) * add a ring to the compactor * wiring up the start/stop functionality * add some monitoring for multiple compactors running at the same time. * Add compactor to `read` target * fix tests/validation requirements * Update pkg/storage/stores/shipper/compactor/compactor_ring.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update pkg/storage/stores/shipper/compactor/compactor_ring.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update pkg/storage/stores/shipper/compactor/compactor_ring.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * used a shared ring_config between scheduler and compactor to avoid some duplication * fix lint * better handling of the tokens file with a way to easily tell all the rings to persist tokens * fix query scheduler replication factor * removing "scheduler" from log line which may be called by components other than a scheduler in the future. * update changelog Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Mustafa Can Sevinç	2a1d8005dc	docs: fix promtail docs links in loki installation page (#4601 ) * docs: fix promtail docs links in loki installation page fixes link to "syslog-reciever" and "systemd-journal" config docs Signed-off-by: Mustafa Can Sevinç <mcansevinc@gmail.com> * docs: fix relative links in helm docs Signed-off-by: Mustafa Can Sevinç <mcansevinc@gmail.com>	4 years ago
Owen Diehl	6eab7be5b4	a few doc fixes in preparation for 2.4 (#4597 )	4 years ago
Owen Diehl	45113cb375	Enable unordered_writes by default (#4594 ) * enable unordered_writes by default * removes out_of_orders from transfer test * update changelog	4 years ago
Owen Diehl	a0b7b3dfb0	improves grouping docs examples (#4590 )	4 years ago
lingpeng0314	76e2a14029	add group_{left,right} to LogQL (#4510 ) * Add group_left/group_right support * Update docs/sources/logql/_index.md * Minor change for a test case * removes CardManyToMany * removes now-unused IsSetOperator helper Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Dylan Guedes	96e64750e0	Tune Loki execution modes image. (#4579 ) - Change modes reordering in modes image to "monolithic" -> "simple scalable" -> "microservices" - Add a subtitle with the name of each component to the modes image - Rename "monolythic" to "monolithic" (typo) - Change read components background fill from hachure to solid - Remove old modes of operation image	4 years ago
Trevor Whitney	ed025e0cd6	Change a few default config values and improve application of common storage config (#4543 ) * further config simplifications and better defaults * default ruler api to on * register defaults for storage configs in the common config (ie. signature version for S3) * enable ingester wal by default * disable chunk retries by default * allow common path prefix to include or omit trailing slash * allow partial storage config to be defined for overriding things like bucket names per component * fix tests * add changelog and upgrade docs * explain impact of wal change in upgrading.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * rename add WithPrefix to RegisterFlags * fix (frontend OR worker) and scheduler boot order when both are running (#4545) Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Christopher Moyer	7fdece94e7	update curl post example (#4559 )	4 years ago
Dylan Guedes	0b40cc953d	Rename hybrid mode to simple scalable mode. (#4576 )	4 years ago
Dylan Guedes	331fa6d7b0	Docs: Add virtual targets docs (#4565 ) * Add CHANGELOG entry and updated modes diagram. * Update documentation with the new hybrid mode. - Update targets with new 'read' and 'write' options - Add new docker-compose yaml that exemplifies how to use new 'read' and 'write' targets * Add missing targets to configuration docs. - Missing ones: index-gateway, ingester-querier, query-scheduler	4 years ago
Callum Styan	e49e318b42	Improve lambda-promtail docs based on Owens review. (#4548 ) * Improve lambda-promtail docs based on Owens review. Signed-off-by: Callum Styan <callumstyan@gmail.com> * One last lambda-promtail docs improvement. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix bolding in lambda-promtail docs + include link to drop filter promtail pipeline stage.	4 years ago
Sankalp Rangare	9e2acd656d	add static labels in stages (#4495 ) Signed-off-by: Sankalp Rangare <sankalprangare786@gmail.com>	4 years ago
Owen Diehl	a27aec37cf	only exports tenant limits which differ from defaults and export defa… (#4542 ) * only exports tenant limits which differ from defaults and export defaults under `loki_overrides_defaults` metric. * docs & changelog	4 years ago
Callum Styan	aa713f54f4	Modify lambda-promtail docs based on rewrite. (#4539 ) Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
李国忠	6fcd02bad4	[querier] s3: add getObject retry (#4453 ) * [querier] s3: add getObject retry * [querier] s3: add getObject retry * [querier] s3: add getObject retry #4452 * [querier] s3: add getObject retry * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry #4453 * [querier] s3: add getObject retry Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Dylan Guedes	e0b4e25962	Document the common config section (#4485 ) * Document the common_config section. * Apply suggestions from code review Fix subsection reference from `filesystem_storage_config` to `local_storage_config` Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
JordanRushing	8cb57424e3	Update CHANGELOG.md and /docs with info on new `overrides-exporter` module for Loki (#4540 ) * Update CHANGELOG.md and /docs with info on new overrides-exporter module for Loki * Apply small changes to `overrides-exporter` docs Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Dylan Guedes	77ea11724b	Loki: Enable FIFO cache by default (#4519 ) * Set default FIFO cache with reasonable defaults. Signed-off-by: Mauro Stettler <mauro.stettler@gmail.com> * Remove FIFO cache feature flag. - We noticed that we always want that behavior, so the logic is better implemented in the `ApplyDinamicConfig` method - Update documentation * Move FIFO cache default behavior. - Move FIFO cache default behavior implementation to ApplyDinamicConfig * Add tests for the new FIFO cache default behavior. - The tests tests the behavior of the four existing caches (query results, query index, write dedupe, and chunk results) - Add changelog entry - Fix lint issues regarding import order - Revert moving of EnableFifoCache check * Apply suggestions from code review - Change `EnableFifoCache` description to mention that it is only applied for chunk and query results cache Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Mauro Stettler <mauro.stettler@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Owen Diehl	b2ad709225	brings storage architecture up to date (#4521 ) * brings storage architecture up to date * pr feedback	4 years ago
Dylan Guedes	f4cfd284a6	Docs: Move rule storages configs to their own sections (#4493 ) * Move rule storages configs to their own sections. - Create new docs sections `azure_storage_config`, `gcs_storage_config`, `s3_storage_config`, and `swift_storage_config` with the docs configs from `ruler_config["storage"]` - Reference the new sections in the existing `ruler_config` section - Add missing periods at `ruler_config` configs * Update storages to have a CLI flag prefix - This way we can reuse these configs in different places (different from `-ruler.config`)	4 years ago
Katarina Yang	e3726a19ca	add missing quote to log_queries.md (#4527 )	4 years ago
Danny Kopping	703d68bc76	Promtail: allow for customisable stream lag labels (#4507 ) * Allow for customisable stream lag labels Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Updating test Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Allowing for multiple labels Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding field to docs Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Ed Welch	2b5f3000b6	Loki: Add a ring to the query scheduler to allow discovery via the ring as an alternative to DNS (#4424 ) * Fork the frontend and scheduler so we can add support for discovery via the ring. * Add a ring to the query scheduler which is then used by the frontend worker and querier workers to find the scheduler address as an alternative to using DNS * update some of the forked code to use dskit grpcclient and grpcutil since #4312 was merged after the original fork was created. * remove query scheduler dependency from querier Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * migrate logging package and make linter happy Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add SafeReadRing for instances when scheduler is not enabled on same instance * Doc changes from code review A few doc fixes Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * go mod tidy on go-kit dep * update changelog * remove ReadRing in favor of SafeReadRing Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Vincent Murphy	517ba7c7b1	Update _index.md (#4499 ) ListObjects is not an S3 permission, it is an API which uses the s3:ListBucket permission.	4 years ago
JordanRushing	afbbc2fc4f	Add metric prefix changes for chunk store and runtime config to upgrading.md (#4436 )	4 years ago
Karen Miller	c4562f19ed	Docs: correct the page parameter in the Grafana Cloud advertisement (#4486 )	4 years ago
Dylan Guedes	6498c8cb13	Loki: Change default limits to common values (#4415 ) * Change some default limits to reasonable values. - These new limits protect users from overwhelming their cluster with ingestion load - The new limits are: * ingestion_rate_strategy: global <- currently defaults to local * max_global_streams_per_user: 5000 <- current default is no limit * max_query_length: 721h <- current default is no limit * max_query_parallelism: 32 <- current default is 14 * max_streams_per_user: 0 <- current default is 10000 * reject_old_samples: true <-- current default is false * reject_old_samples_max_age: 168h <-- current default is 336h * Remove parameters from examples - They are not necessary anymore because of the new default values * Add new entries to CHANGELOG and upgrading guide * Apply suggestions from code review Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com> * Change changelog mark entry from '-' to '*' Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	4 years ago
Dylan Guedes	d3d63e1778	Loki: Override distributor's default ring KV store (#4440 ) * Override default KV store for the compactor. - Currently, the default KVstore is consul. This changes it to inmemory to make it easier for new users to run the project without dependencies. - Refactor default flag value tests. Now, it will check for a populated map instead of checking for flags during iteration. * Move distributor flag override to RegisterFlags. * Add missing CHANGELOG and upgrading guide entries.	4 years ago
Trevor Whitney	7118dc3272	Change default values for two GRPC setting we have to set so the queriers can connect to a frontend or scheduler (#4435 ) * change gprc server defaults Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add docs and changelog Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com>	4 years ago

1 2 3 4 5 ...

472 Commits (afb94b2df276c52d2168a30bc4b508ed24dfbc22)