apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Dylan Guedes	15f8f42295	Adapt queryTimeout to be a per-tenant configuration (#6835 ) What this PR does / why we need it: * Add a new per-tenant query timeout * Adds new middleware to query calls. This new middleware will timeout requests based on the new per-tenant query timeout * Add span logs to query calls missing it * Deprecate `engine.timeout` configuration The motivation to change this configuration to be per-tenant instead of global is that it makes sense to alleviate the timeout for particular tenants or make it more strict for others. Especially useful for scenarios where the Loki client doesn't handle context cancellations correctly; in such scenarios, since Loki would still process expensive queries that were canceled, this allows one to have small timeouts for most tenants, which will help mitigate unnecessary work without having a timeout that is too short for important tenants.	3 years ago
Salva Corts	7961ef6a4e	Evenly spread distributors across available nodes (#6964 ) * Evenly spread distributors across available nodes * Add note about reliability implications	3 years ago
Travis Patterson	d602c1331a	Clarify delete upgrade path (#6871 ) * Clarify delete upgrade path * more specificity	3 years ago
Travis Patterson	bd3d80ad80	Add ability to limit the impact of pathological delete requests. (#6854 ) * make per-tenant override the mode rather than binary on/off * Rely on overrides to configure deletion - Remove 'deletion_mode' flag * add ability to delete requests at any time * don't load requests from disabled tenants * review comments * fix tests * loadDeleteRequestsToProcess cleanup * lint * docs * review feedback * lint	3 years ago
Kaviraj Kanagaraj	7e3d2433ed	embedded-cache: Bring `fifocache` and `groupcache` into single tent. (#6821 ) * chore(groupcache): Rename groupcache into memcache{distributed: true} 1. Introduced new config called memorycache config. 2. It has flag `distributed`. By enabling it, we use groupcache Going forward. We will bring fifocache into memcache config(with distributed:false) This PR is just a POC. To show how we can simplify in-built memory cache config and bring it into single config. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Memorycache -> EmbeddedCache * Bring fifocache into embeddedcache tent Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix edge case with enabling fifocache Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix missing flags for embedded cache Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add changelog Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Warning message for fifocache config Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make linter happy Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fix listenport issue Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * idk. review remarks Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks 1. update changelog and upgrade guide 2. s/Embeddedcache/EmbeddedCache/g 3. /groupcache/ handler -> /embedded-cache/ 4. some typos 5. Fix some cache prefixes Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Fixing corresponding tests Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Support extra timeouts on embedded-cache Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove unwanted single struct field Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * fix(stats-collector): Let cache.New() wrap stats collector for distributed cache Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Deprecate max_size_items from fifocache Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks about the flag description Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Update docs/sources/upgrading/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Danny Kopping	66fdb3c572	Log stream flushes to see how many chunks we flush at a time (#6819 ) * Log stream flushes to see how many chunks we flush at a time Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Smuggling in an error wrapping which aides debugging Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Update docs/sources/upgrading/_index.md Co-authored-by: Ed Welch <ed@oqqer.com> * Removing unnecessary label Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Ed Welch <ed@oqqer.com>	3 years ago
Danny Kopping	305936a861	Update production-ready Loki in docker-compose (#6691 ) * Improved docker-compose setup: - S3-like storage - Interactive debugging by optionally exposing dlv ports - Improve performance - Use SSD mode (read/write) - GroupCache - Latest versions of loki, promtail, grafana - Scaling * Adding diagram & updated README Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Upgrade guide Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding steps to build debug image Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Add prometheus Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Add datasources and disable Grafana auth Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Vladyslav Diachenko	220d084fc4	manually backported upgrading guide from release 2.6.0 (#6631 )	4 years ago
Christian Simon	b8c9672de6	Update loki's default port to 3100 (#6349 ) * Update loki's default port to 3100 I was suprised this was not already the case. I think it would be a good change to make, but I am also contious of the breaking nature of this. * Add note to the changelong * Add upgrade note * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Salva Corts	1cfc30fb23	Evenly spread queriers across available nodes (#6415 ) * Evenly spread queriers across available nodes * Fix lint issue * Add entry to the CHANGELOG and the Upgrade Guide * Make topology spread configurable * Apply CR feedback	4 years ago
Christian Haudum	a56a88bd35	Add unwrapped aggregation `rate_counter()` (#6412 ) `rate_counter()` takes an unwrapped range as input, but unlike `rate()` it treats the values extracted from the log lines as "counter metric" like in Prometheus' `rate()` function. This is a replacement for the reverted change of #5013 Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Trevor Whitney	65c6e254bd	Add upgrade guide regarding azure container name change (#6118 ) * Add upgarde guide regarding azure container name change * Add loki header to master upgrade section	4 years ago
Ed Welch	4f75939efb	Revert "Loki: Change live tailing to only allow mutating the log line not the number of streams. (#6063 )" (#6097 ) This reverts commit `98fda9b0a0`.	4 years ago
Ed Welch	98fda9b0a0	Loki: Change live tailing to only allow mutating the log line not the number of streams. (#6063 ) * don't create more streams when live tailing logs, process the log line with the pipeline to allow mutating the content of the line but don't split it into new streams. Signed-off-by: Edward Welch <edward.welch@grafana.com> * update changelog Signed-off-by: Edward Welch <edward.welch@grafana.com> * don't mutate the incoming streams Signed-off-by: Edward Welch <edward.welch@grafana.com> * do not reuse the pipeline because it caches labels Signed-off-by: Edward Welch <edward.welch@grafana.com> * add note to upgrade guide Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Nicolas Vanheuverzwijn	f22dbc2190	Update _index.md (#5871 ) The new default for : - `chunk_retain_period` is `0s`, not `30s` - `chunk_idle_period` is `30m`, not `1h` - `chunk_target_size ` is `1572864`, not `1048576` According to https://grafana.com/docs/loki/v2.4/configuration/#ingester_config	4 years ago
Ed Welch	52bc0c64ae	2.5 changelog, release notes, and upgrade guide (#5819 ) * update changelog Signed-off-by: Ed Welch <edward.welch@grafana.com> * update the upgrade guide Signed-off-by: Ed Welch <edward.welch@grafana.com> Update docs/sources/upgrading/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * add release notes Signed-off-by: Ed Welch <edward.welch@grafana.com> Update docs/sources/release-notes/v2-5.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * udpate things to 2.5.0 Signed-off-by: Ed Welch <edward.welch@grafana.com> * Update docs/sources/release-notes/v2-5.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/release-notes/v2-5.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * cleanout wierd changelog union stuff Signed-off-by: Ed Welch <edward.welch@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Ed Welch	c158b2c5f5	Loki: Revert #4845 which changed the format of errors from the API (#5772 ) * This reverts the changes from #4845, unfortunately changing the content type from plain text to JSON is a breaking change of the API and we should wait to do this at a major release. Signed-off-by: Ed Welch <edward.welch@grafana.com> * fix tests which were updated after initial change. Signed-off-by: Ed Welch <edward.welch@grafana.com>	4 years ago
Ed Welch	4ca1fd0adb	set match_max_concurrent true by default (#5435 ) * set match_max_concurrent true by default Signed-off-by: Edward Welch <edward.welch@grafana.com> * add note to upgrade guide, fix up some of the existing notes Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Sandeep Sukhani	ff21fb063f	jsonnet: move boltdb-shipper configs set as compactor args to yaml config (#5393 ) * move boltdb-shipper configs set as compactor args to yaml config * update changelog * update upgrade guide	4 years ago
Ed Welch	91b0bcf36a	remove promtail_log_entries_bytes_bucket (#5377 ) Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Travis Patterson	d8780da454	Revert to working version of Azure client (#5413 ) * Revert "storage: update azure blobstore client to use new sdk (#5302)" This reverts commit `89b04a97b3`. * Fix Azure SDK Issue - Revert SDK to working version - Introduce patches to prevent deadlocks * make metrics global	4 years ago
Travis Patterson	89b04a97b3	storage: update azure blobstore client to use new sdk (#5302 ) * Update azure blobstore client to use new sdk * changelog * fix hardcoded maxretries * linter * more linting * Fix flaky test	4 years ago
Owen Diehl	91d837e79c	Refactor/remove global splitby (#5243 ) * cleans up internal limits struct, removes unnecessary logic * moves querier.split-queries-by-interval to limits, simplifies resulting code. * docs, changelog * flag supports model.duration instead of time.duration * lint and adds new error for deprecated field * reregisters queryrange flags * comment lint * ensures we validate queryrange config and simplifies embedded struct validate() * 0 still disables * simplify cache key generation and protect against divide by zero	4 years ago
Dylan Guedes	3d135e5338	Copy `cortex/pkg/configs` package dependency into Loki (#5139 ) * Fork cortex `configs` into Loki. * Use new forked `configs` package. * Remove duplicated import. * Fix lint issues. * Use new forked util/logger. * Drop support for promql rules v1. - This allow us to remove the `legacy_promql` implementation - If a rulesconfig is received in v1 format, we output a specific error, so we can differentiate between a unknown version and a v1 one. * Modify tests to expect error for legacy rules format. * Add changelog and upgrading guide. - Added them as we dropped support for legacy promql rules configuration which might be a breaking change for some environments. * Update vendor/modules after rebasing.	4 years ago
Trevor Whitney	3091ccd3eb	improve default config values (#5077 ) * improve default config values * change defaults for upstream query range package * update changelog * remove max_tranfer_retries fix as it is covered in another PR, 4792 * increase query ingesters within by 1h This provides an additional buffer on top of the max_chunk_age. Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * add comment reminder to remove query range config hack Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * rollback change to align_queries_with_step and parallelise_shardable_queries * add upgrading docs * re-enable parallelise_shardable_queries by default * add parallelise_shardable_queries back to upgrading doc Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Christian Haudum	e573a4d1a2	Change error responses from plain text to JSON (#4845 ) * Return HTTP errors consistently as JSON response The API returned errors in plain text where the error message was the response body. However, the content type header was set to `application/json`. To make the API responses consistent, errors are now returned as JSON as well. ``` { "message": string, "status": string, "code": int } ``` Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Return HTTP errors consistently as JSON response Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Return 404 Not Found responses as JSON Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Return 404 Not Found responses as JSON Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Danny Kopping	c263f3ed60	Adding upgrade guide for recording rules (#4751 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
James Callahan	21556efa87	Promtail: improve GCP labels (#4628 ) * Promtail: GCP resource label prefix is now '__gcp_resource_labels_' * Promtail: turn GCP 'resource_type' into the internal label '__gcp_resource_type' * Promtail: add internal label with logName * Add upgrade notes for gcplog changes	4 years ago
Ed Welch	413ffab235	update everything for 2.4.1 (#4701 )	4 years ago
Ed Welch	3fef08ca1a	2.4 release notes, changelog, upgrade guide (#4658 ) * update changelog, release notes, and upgrade guide for 2.4 * tweak release notes a little * make path relative for kafka config * update upgrade guide * more docs fix the cache size not applied to results cache. * fix prefix name in ring_config	4 years ago
Dylan Guedes	910d604a73	Document duplicated protos warning occurence. (#4650 )	4 years ago
Dylan Guedes	0d66319a1f	Revert distributor defaulting to inmemory. (#4638 ) - [PR 4440](https://github.com/grafana/loki/pull/4440/files) modified the distributor setup to use inmemory by default (instead of consul). That was necessary because, by changing the default rate limiting to global, a ring was necessary, and since by default the ring was set to consul, the project couldn't run with the default configs. That's not the case anymore: right now we are reusing the same config set for the ingester (which users already have properly configured otherwise they wouldn't be able to run the project). List of changes: - Remove changelog entries - Remove upgrading guide entries - Remove added tests (unnecessary checks) - Remove value overriding	4 years ago
Kaviraj	d53aef63b1	Add changelog and upgrade guide for #4556 (#4631 ) Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Owen Diehl	e8bd3cb579	Default wal to enabled in jsonnet lib (#4629 ) * default wal to enabled * update changelog & upgrade.md	4 years ago
Trevor Whitney	62ee399e48	default ingester final sleep to 0 unless otherwise specified (#4608 ) * default ingester final sleep to 0 unless otherwise specified * add changelog and upgrading * update config docs	4 years ago
Trevor Whitney	ed025e0cd6	Change a few default config values and improve application of common storage config (#4543 ) * further config simplifications and better defaults * default ruler api to on * register defaults for storage configs in the common config (ie. signature version for S3) * enable ingester wal by default * disable chunk retries by default * allow common path prefix to include or omit trailing slash * allow partial storage config to be defined for overriding things like bucket names per component * fix tests * add changelog and upgrade docs * explain impact of wal change in upgrading.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * rename add WithPrefix to RegisterFlags * fix (frontend OR worker) and scheduler boot order when both are running (#4545) Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
JordanRushing	afbbc2fc4f	Add metric prefix changes for chunk store and runtime config to upgrading.md (#4436 )	4 years ago
Dylan Guedes	6498c8cb13	Loki: Change default limits to common values (#4415 ) * Change some default limits to reasonable values. - These new limits protect users from overwhelming their cluster with ingestion load - The new limits are: * ingestion_rate_strategy: global <- currently defaults to local * max_global_streams_per_user: 5000 <- current default is no limit * max_query_length: 721h <- current default is no limit * max_query_parallelism: 32 <- current default is 14 * max_streams_per_user: 0 <- current default is 10000 * reject_old_samples: true <-- current default is false * reject_old_samples_max_age: 168h <-- current default is 336h * Remove parameters from examples - They are not necessary anymore because of the new default values * Add new entries to CHANGELOG and upgrading guide * Apply suggestions from code review Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com> * Change changelog mark entry from '-' to '*' Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	4 years ago
Dylan Guedes	d3d63e1778	Loki: Override distributor's default ring KV store (#4440 ) * Override default KV store for the compactor. - Currently, the default KVstore is consul. This changes it to inmemory to make it easier for new users to run the project without dependencies. - Refactor default flag value tests. Now, it will check for a populated map instead of checking for flags during iteration. * Move distributor flag override to RegisterFlags. * Add missing CHANGELOG and upgrading guide entries.	4 years ago
Trevor Whitney	7118dc3272	Change default values for two GRPC setting we have to set so the queriers can connect to a frontend or scheduler (#4435 ) * change gprc server defaults Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add docs and changelog Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com>	4 years ago
Trevor Whitney	b07920cb16	auto-apply memberlist ring config when join_members provided (#4400 ) * auto-apply memberlist ring config when join_members provided Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * move "memberlist" to a const Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add comment for memberlist config auto-apply, update changelog Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add docs Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com>	4 years ago
Karen Miller	24accf6a5b	Docs: correctly represent product name (#4416 ) The product name is Grafana Loki. The first use of the product name on each web page should be the full product name. After that, within each page, it is fine to use just Loki. This PR also set up some frontmatter with weights where it was missing on a few files, and correct where "Loki" was not capitalized.	4 years ago
Ed Welch	f2eb2eefec	Updating changelog, release notes and references to the previous release version. (#4112 )	4 years ago
raymonder jin	6d8939670e	fix typos (#3965 )	5 years ago
Karen Miller	475560ba13	Corrected capitalization and formatting of "Promtail" (#3860 )	5 years ago
Chance Zibolski	a419f9c1c9	docs/upgrading: Fix typo (#3478 )	5 years ago
Edward Welch	5047079420	2.2 release notes, changelog and upgrade notes add upgrade note about fix to query_frontend queueing.	5 years ago
Danny Kopping	6aba7098b3	Adding upgrade documentation related to #3404 (#3418 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	5 years ago
Edward Welch	ff224c3f72	update changelog and upgrade guide for 2.1.0	5 years ago
Owen Diehl	3e5e461efa	updates docs with delete permissions notice (#2819 ) * updates docs with delete permissions notice * delete ref for storage doc * boltdb ref * pr feedback	5 years ago

1 2

52 Commits (1e1c2470b51a0deda62cdc86559afe2e3f20b6bd)