130 Commits (ec516facaf9e3f855855df0971d96e65f5faf022)

Author	SHA1	Message	Date
Karen Miller	5b432e3d99	Docs: Fix bad links in the API section (#6688) ... * Docs: Fix a bad link in the API section * Fix 2 more of the same bad link	3 years ago
Karen Miller	27477bf5f5	Docs: improve API docs (#6485) ... * Docs: improve API docs * Implement review suggestions.	4 years ago
Michel Hollands	f80e487dcf	Remove whole stream deletion mode (#6435) ... * Remove whole-stream-deletion mode Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove whole-stream-deletion from docs Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update the changelog Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Sort changelog entries Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove link to wrong configuration Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix integration test Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Set default deletion mode to disabled Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove extra white line in documentation Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix default value in docs Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix changelog Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add DeletionEnabled method on mode Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Rename test Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	4 years ago
Karen Miller	167c95c320	Docs: revise multi-tenancy prose (#6355) ... * Docs: revise multi-tenancy prose * Update multi-tenancy docs using review comments	4 years ago
Michel Hollands	b4e6c59936	Compactor: add per tenant compaction delete enabled flag (#6410) ... * Add per tenant compaction delete enabled flag Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove changes in wrong place Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add compactor deletion enabled field Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Use limit in compactor Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Use http middleware and add test Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix lint issue Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add changelog Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Revert to default setting if no override Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add default value command line option Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update the docs Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Enable access to deletion API for integration test Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Rename flag to allow_deletes Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update per review comments Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	4 years ago
Karen Miller	ba7e36afd1	Docs: Edits for several PRs that did not have a docs review (#6398)	4 years ago
Karsten Jeschkies	ff5ce4e129	Document multi-tenant queries. (#5994) ... * Document multi-tenant queries. * Update docs/sources/operations/multi-tenancy.md Co-authored-by: Aleksey <a.alexey.lazarev@gmail.com> * Update docs/sources/operations/multi-tenancy.md Co-authored-by: JordanRushing <rushing.jordan@gmail.com> * Update docs/sources/operations/multi-tenancy.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/multi-tenancy.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Aleksey <a.alexey.lazarev@gmail.com> Co-authored-by: JordanRushing <rushing.jordan@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Karen Miller	0b947d956f	Docs: Reimplement PR 5649 on troubleshooting timeout errors (#6183)	4 years ago
Michael Sverdlik	5206e3acd0	Docs: Hint about potential high cardinality metrics (#5603) ... * Hint about potential high cardinality metrics Add warning about potential high cardinality metrics due to the file path being included in some of the metrics. Depending on the setup, such config can result in a very large amount of label values, which is not recommended by Prometheus. This can result in increased storage, slow down of queries, extra costs and so on. Address what has been discussed in #5553. * Reword observability.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Michel Hollands	e5eff96266	Change deletion_enabled setting to deletion_mode (#6190) ... * Change deletion_enabled setting to deletion_mode Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Empty commit	4 years ago
Daniel Kovacs	e9d2a30733	Fixed reader to support both authentication and tenant-id at the same time. (#5719)	4 years ago
Michel Hollands	f39552c7fa	Add docs for updated deletion api (#5763) ... * Add docs for updated deletion api Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix parameter name Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Clarify that only the delete requests for the current tenant are shown Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update docs/sources/api/_index.md Co-authored-by: Christian Simon <simon@swine.de> * Update docs/sources/operations/storage/logs-deletion.md Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * Update docs/sources/operations/storage/logs-deletion.md Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * Update docs/sources/operations/storage/logs-deletion.md Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * Specify all delete endpoints use authentication Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add description of delete modes Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Christian Simon <simon@swine.de> Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
arcosx	e2fdc3437b	Feat: add Baidu Cloud BOS as storage backends for Loki #4788 (#5848) ... * feat: add baidu bce bos storage support Signed-off-by: arcosx <arcosx@outlook.com> * add baidu bce bos as chunk storage backend Signed-off-by: arcosx <arcosx@outlook.com> * fix: some doc error && rewrite bad code Signed-off-by: arcosx <arcosx@outlook.com> * fix: add the `BceServiceError` source link Signed-off-by: arcosx <arcosx@outlook.com> * Update CHANGELOG.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Signed-off-by: arcosx <arcosx@outlook.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update pkg/storage/chunk/client/baidubce/bos_storage_client.go Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Karen Miller	2264b73311	Docs: remove Cortex references (#6079) ... * Docs: remove Cortex references * Bug fix: (after PR 6015) Cortex to Loki update	4 years ago
Karen Miller	c4ebfd3020	Docs: revise getting started guide (#5939) ... * Revise the getting started section * Docs: revise getting started guide * Intermediate commit of getting started material. * Intermediate revision of the getting started guide. Add instructions to download, configure, and deploy the test environment. * Add sample queries and instructions for breaking down the test env * Revise prose using reviewer comments. * update to use promtail and flog in the docker compose file Signed-off-by: Edward Welch <edward.welch@grafana.com> * Revise guide to put all parts into Docker containers. * Add README files for examples directory. Revise getting started instructions. * Address DylanGuedes review comments * Getting started guide: incorporate suggestions from ssncferreira Co-authored-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Ed Welch	c6c301ec27	Docs: Improve the new schema docs (#5869) ... * improve the new schema docs Signed-off-by: Edward Welch <edward.welch@grafana.com> * fix capitalization Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Ed Welch	a76fe22942	add some docs for working with the storage schema (#5863) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
李国忠	49c331aa6d	fix boltdb-shipper doc (#5796)	4 years ago
Nicolas Vanheuverzwijn	0950034890	Update retention.md (#5706) ... Retention policy actually accept suffix such as `d` and `w` but Go's time.ParseDuration does not. See a2dd731586/pkg/storage/chunk/table_manager.go (L93)	4 years ago
Ed Welch	91b0bcf36a	remove promtail_log_entries_bytes_bucket (#5377) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Arve Knudsen	a2dd731586	Chore: Add pkg/util/log package (#5187) ... * Chore: Add pkg/util/log package Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Add changelog entry Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Fix documentation of loki_log_messages_total Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 years ago
Sas Swart	205ad61b8c	Docs: Update memory ballast documentation (#5106) ... * Add memory ballast * Add changelog entry * Add documentation Add additional information to Flag description * Ensure that ballast_bytes can be configured from config file Add documentation * Add Operational scalability documentation related to memory ballast * Restore config.ballast-bytes cli flag * Move config.ballast-bytes cli flag declaration * Update memory ballast documentation as per https://github.com/grafana/loki/pull/5081\#pullrequestreview-848460132 Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Sas Swart	79c337e234	Add the option to configure memory ballast for Loki (#5081) ... * Add memory ballast * Add changelog entry * Add documentation Add additional information to Flag description * Ensure that ballast_bytes can be configured from config file Add documentation * Add Operational scalability documentation related to memory ballast * Restore config.ballast-bytes cli flag * Move config.ballast-bytes cli flag declaration Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Karen Miller	2a6ddffb49	Docs: Modify label names of configuration blocks (#4787) ... * Docs: Add label names of configuration blocks * Docs: Match configuration block name with docs subsection name	4 years ago
Karen Miller	35ebe967ea	Docs: fix broken links (#4770) ... * Docs: fix broken links * Docs: fix another link name	4 years ago
Ed Welch	3fef08ca1a	2.4 release notes, changelog, upgrade guide (#4658) ... * update changelog, release notes, and upgrade guide for 2.4 * tweak release notes a little * make path relative for kafka config * update upgrade guide * more docs fix the cache size not applied to results cache. * fix prefix name in ring_config	4 years ago
Owen Diehl	91d5cce8ad	index-gw sts doc fix. closes #4583 (#4616) ... * index-gw sts doc fix. closes #4583 * Update docs/sources/operations/storage/boltdb-shipper.md Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com> Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Danny Kopping	5b30589acf	Documenting recording rules per-tenant WAL (#4566) ... * WIP Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Document ruler config options Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Self-review updates Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Clarifying WAL benefit in response to review Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding dashboard link Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Update docs/sources/configuration/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Ensuring ruler and ingester default WAL paths do not conflict Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Christopher Moyer	7fdece94e7	update curl post example (#4559)	4 years ago
Owen Diehl	a27aec37cf	only exports tenant limits which differ from defaults and export defa… (#4542) ... * only exports tenant limits which differ from defaults and export defaults under `loki_overrides_defaults` metric. * docs & changelog	4 years ago
JordanRushing	8cb57424e3	Update CHANGELOG.md and /docs with info on new `overrides-exporter` module for Loki (#4540) ... * Update CHANGELOG.md and /docs with info on new overrides-exporter module for Loki * Apply small changes to `overrides-exporter` docs Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Vincent Murphy	517ba7c7b1	Update _index.md (#4499) ... ListObjects is not an S3 permission, it is an API which uses the s3:ListBucket permission.	4 years ago
Karen Miller	24accf6a5b	Docs: correctly represent product name (#4416) ... The product name is Grafana Loki. The first use of the product name on each web page should be the full product name. After that, within each page, it is fine to use just Loki. This PR also set up some frontmatter with weights where it was missing on a few files, and correct where "Loki" was not capitalized.	4 years ago
pr0PM	a140bc7700	Deduplicating the compactor docs (#4345) ... * deduplicating the compactor docs :D same list crept in twice! * Update wording. Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Karan Sharma	64e2a36199	docs: (logs-deletion.md) URL Encode curl command (#4294) ... Update the `cURL` command example to URL encode the `match` query param	4 years ago
Owen Diehl	0e622072e9	replaces old cortex_chunk_store prefix with loki_chunk_store (#4255)	4 years ago
Karen Miller	825c497b4f	Docs: minor improvements to Loki Canary docs (#4222) ... * Docs: correct path to Promtail configuration file * Docs: minor improvements to Loki Canary docs - reduce size of canary drawing - add a description of what Loki Canary does - update wording of the configuration options - minor grammar improvements throughout the section Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Karen Miller	11a0d28b61	Docs: first draft, Loki accepts out-of-order writes (#4237) ... * Docs: first draft, Loki accepts out-of-order writes * Update docs/sources/architecture/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Callum Styan	3ee8ed3b1d	Allow for loki-canary to generate a percentage of out of order log lines (#4126) ... * Allow for loki-canary to generate a percentage of log lines with out of order timestamps, percentage and out of order time range is all configurable. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Switch OoO min/max flags to time duration and properly calculate OoO percentage check. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Change some variable names + add comments to make it more obvious what various parts of the canary code are actually doing. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update pkg/canary/writer/writer.go * Add notes about usage of the out-of-order-percentage flag and the requirement to use pipeline stages. Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Owen Diehl	654b543e4e	updates unordered writes config docs (#4131) ... * updates unordered writes config docs * removes experimental flag * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Karen Miller	a60924792d	Docs: revise section header (out of order writes) (#4134)	4 years ago
Owen Diehl	ff59711a02	brief out of order docs (#4125)	4 years ago
Karsten Jeschkies	d36e11d04f	Document operation with the query scheduler. (#4100) ... * Support Cortex Frontend V2. * Format code. * Start query scheduler in Docker compose. * Model query flow in sequence diagram. * Model calls to downstreamer. * Move diagram to docs. * Embed generated SVG. * Descripe calls. * Launch Cortex query scheduler. * Disable sharding for now. * Log which framework is used. * Configure querier to use scheduler. * Remove unwanted docs. * Enable query splitting again. * Document scheduler address. * Document new scheduler options for frontend as well. * Document operation with the query scheduler. * Replace Cortex with Loki image. * Remove unused Corte config. * Correct merger errors. * Clear up confusing sentence. * Update docs/sources/operations/scalability.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Bearice Ren	5970ab9b1e	Update _index.md (#4029) ... As mentioned in #3259, permission `s3:ListObjects` is needed, updating the document.	4 years ago
Sandeep Sukhani	58f9d0c085	add config and documentation about index-gateway (#3956) ... * add config and documentation about index-gateway * Update docs/sources/operations/storage/boltdb-shipper.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/storage/boltdb-shipper.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Kristian Klausen	021a7fdc33	Doc: Remove removed --ingester.recover-from-wal option and fix out-of-date defaults (#3559) ... * Doc: Remove removed --ingester.recover-from-wal option Removed in: 8a9b94a8 ("removes recover flag (#3326)") * Doc: Fix out-of-date defaults 0b1dbe26 ("Promtail: Add a stream lagging metric (#2618)") d3bf21e7 ("Promtail: (and also fluent-bit) change the max batch size to 1MB (#2710)")	5 years ago
Karen Miller	7eceea082b	Docs: Make identification of experimental items consistent and more obvious. (#3911)	5 years ago
Sandeep Sukhani	7a7eeb0d63	skip applying retention when data in table is still within retention period and there are no overlapping delete requests (#3934)	5 years ago
Cyril Tovena	22dcfcde33	Add retention label to loki_distributor_bytes_received_total metrics (#3840) ... * Add retention label on the loki_distributor_bytes_received_total metrics. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/operations/observability.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Move ParseRequest to an apache2 package. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add retention label on the loki_distributor_bytes_received_total metrics. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fixes bad merge. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes bad merge. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	5 years ago
Sandeep Sukhani	12d418b7cc	docs for logs deletion feature (#3826) ... * docs for logs deletion feature * update doc Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	5 years ago