103 Commits (04ce1b87213d18f414f56a74e02a33e7b65fc8f1)

Author	SHA1	Message	Date
Danny Kopping	5b30589acf	Documenting recording rules per-tenant WAL (#4566) ... * WIP Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Document ruler config options Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Self-review updates Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Clarifying WAL benefit in response to review Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding dashboard link Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Update docs/sources/configuration/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Ensuring ruler and ingester default WAL paths do not conflict Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Christopher Moyer	7fdece94e7	update curl post example (#4559)	4 years ago
Owen Diehl	a27aec37cf	only exports tenant limits which differ from defaults and export defa… (#4542) ... * only exports tenant limits which differ from defaults and export defaults under `loki_overrides_defaults` metric. * docs & changelog	4 years ago
JordanRushing	8cb57424e3	Update CHANGELOG.md and /docs with info on new `overrides-exporter` module for Loki (#4540) ... * Update CHANGELOG.md and /docs with info on new overrides-exporter module for Loki * Apply small changes to `overrides-exporter` docs Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Vincent Murphy	517ba7c7b1	Update _index.md (#4499) ... ListObjects is not an S3 permission, it is an API which uses the s3:ListBucket permission.	4 years ago
Karen Miller	24accf6a5b	Docs: correctly represent product name (#4416) ... The product name is Grafana Loki. The first use of the product name on each web page should be the full product name. After that, within each page, it is fine to use just Loki. This PR also set up some frontmatter with weights where it was missing on a few files, and correct where "Loki" was not capitalized.	4 years ago
pr0PM	a140bc7700	Deduplicating the compactor docs (#4345) ... * deduplicating the compactor docs :D same list crept in twice! * Update wording. Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Karan Sharma	64e2a36199	docs: (logs-deletion.md) URL Encode curl command (#4294) ... Update the `cURL` command example to URL encode the `match` query param	4 years ago
Owen Diehl	0e622072e9	replaces old cortex_chunk_store prefix with loki_chunk_store (#4255)	4 years ago
Karen Miller	825c497b4f	Docs: minor improvements to Loki Canary docs (#4222) ... * Docs: correct path to Promtail configuration file * Docs: minor improvements to Loki Canary docs - reduce size of canary drawing - add a description of what Loki Canary does - update wording of the configuration options - minor grammar improvements throughout the section Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Karen Miller	11a0d28b61	Docs: first draft, Loki accepts out-of-order writes (#4237) ... * Docs: first draft, Loki accepts out-of-order writes * Update docs/sources/architecture/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Callum Styan	3ee8ed3b1d	Allow for loki-canary to generate a percentage of out of order log lines (#4126) ... * Allow for loki-canary to generate a percentage of log lines with out of order timestamps, percentage and out of order time range is all configurable. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Switch OoO min/max flags to time duration and properly calculate OoO percentage check. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Change some variable names + add comments to make it more obvious what various parts of the canary code are actually doing. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update pkg/canary/writer/writer.go * Add notes about usage of the out-of-order-percentage flag and the requirement to use pipeline stages. Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Owen Diehl	654b543e4e	updates unordered writes config docs (#4131) ... * updates unordered writes config docs * removes experimental flag * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Karen Miller	a60924792d	Docs: revise section header (out of order writes) (#4134)	4 years ago
Owen Diehl	ff59711a02	brief out of order docs (#4125)	4 years ago
Karsten Jeschkies	d36e11d04f	Document operation with the query scheduler. (#4100) ... * Support Cortex Frontend V2. * Format code. * Start query scheduler in Docker compose. * Model query flow in sequence diagram. * Model calls to downstreamer. * Move diagram to docs. * Embed generated SVG. * Descripe calls. * Launch Cortex query scheduler. * Disable sharding for now. * Log which framework is used. * Configure querier to use scheduler. * Remove unwanted docs. * Enable query splitting again. * Document scheduler address. * Document new scheduler options for frontend as well. * Document operation with the query scheduler. * Replace Cortex with Loki image. * Remove unused Corte config. * Correct merger errors. * Clear up confusing sentence. * Update docs/sources/operations/scalability.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Bearice Ren	5970ab9b1e	Update _index.md (#4029) ... As mentioned in #3259, permission `s3:ListObjects` is needed, updating the document.	4 years ago
Sandeep Sukhani	58f9d0c085	add config and documentation about index-gateway (#3956) ... * add config and documentation about index-gateway * Update docs/sources/operations/storage/boltdb-shipper.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/storage/boltdb-shipper.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Kristian Klausen	021a7fdc33	Doc: Remove removed --ingester.recover-from-wal option and fix out-of-date defaults (#3559) ... * Doc: Remove removed --ingester.recover-from-wal option Removed in: 8a9b94a8 ("removes recover flag (#3326)") * Doc: Fix out-of-date defaults 0b1dbe26 ("Promtail: Add a stream lagging metric (#2618)") d3bf21e7 ("Promtail: (and also fluent-bit) change the max batch size to 1MB (#2710)")	5 years ago
Karen Miller	7eceea082b	Docs: Make identification of experimental items consistent and more obvious. (#3911)	5 years ago
Sandeep Sukhani	7a7eeb0d63	skip applying retention when data in table is still within retention period and there are no overlapping delete requests (#3934)	5 years ago
Cyril Tovena	22dcfcde33	Add retention label to loki_distributor_bytes_received_total metrics (#3840) ... * Add retention label on the loki_distributor_bytes_received_total metrics. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/operations/observability.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Move ParseRequest to an apache2 package. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add retention label on the loki_distributor_bytes_received_total metrics. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fixes bad merge. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes bad merge. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	5 years ago
Sandeep Sukhani	12d418b7cc	docs for logs deletion feature (#3826) ... * docs for logs deletion feature * update doc Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	5 years ago
Karen Miller	0d27c21dd4	Doc updates: (#3823) ... - Revise section titles - Add weight metadata to specify ordering of subsections - Remove TOC info from content prose, as it is already in the right side navigation panel - Remove a redundant section about upgrading.	5 years ago
Cyril Tovena	71677dbc8f	Retention doc (#3775) ... * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Finish docs. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Addresses Karen's feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/operations/storage/retention.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/storage/retention.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/storage/retention.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/operations/storage/retention.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	5 years ago
Chris Miller	6a855dc037	Update boltdb-shipper.md (#3464)	5 years ago
Sandeep Sukhani	faff8b6632	Boltdb shipper doc fixes (#3265) ... * Remove incorrect value for boltdb_shipper.resync_interval in example doc which anyways has a default value of 5m * Update incorrect default value for resync_interval mentioned in docs * Add boltdb shipper configuration in config reference file	5 years ago
Owen Diehl	224e68a50b	WAL backpressure (#3218) ... * adds WAL replay backpressure * backpressure fn doesnt lock during passed fn for concurrency * replayController * replayController supports a RemoveFlushedChunks fn * custom wal flusher * encoding test determinism * standardizes recoveredBytesTotal to replayControllers ownership * linting * default wal memory threshold to 4gb, adds docs * fix test after v3 chunk schema change * more lenient expectCheckpoint function * replayController protects against flush race condition * adds replay_memory_ceiling to wal jsonnet * replay ceiling help msg	5 years ago
Hui Kang	1ffd4f641e	Doc: Add missing wal in configuration (#3162) ... * Doc: Add missing wal in configuration * Update docs/sources/configuration/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com>	5 years ago
Hui Kang	1f6fd5e45e	Doc: add missing type supported by table manager (#3148)	5 years ago
Owen Diehl	6dc8bee9b0	ingester/shutdown -> ingester/flush_shutdown (#3146)	5 years ago
Owen Diehl	ed649eec37	Don't fail writes due to full WAL disk (#3136) ... * dont fail writes on full wal disk * wal full failure will cause flush on shutdown * logs the first full WAL failure	5 years ago
Owen Diehl	ee9c629f51	wal docs (#3026)	5 years ago
Owen Diehl	3e5e461efa	updates docs with delete permissions notice (#2819) ... * updates docs with delete permissions notice * delete ref for storage doc * boltdb ref * pr feedback	5 years ago
Andreas Plesner	3b9222bf8c	Update _index.md (#2817)	5 years ago
Ed Welch	b0042d087a	Update helm and jsonnet to new release (#2809) ... * helm and ksonnet to use boltdb-shipper * updating image versions and chart versions * update the chart deps * updating reference to new version * fix helm config for boltdb-shipper	5 years ago
Ed Welch	6978ee5d73	Loki Release: update release notes and docs (#2808) ... * update release notes and docs! * add go and cortex version * tweaks * tweak wording * change paths * typo, thanks Cyril ;) * thanks Owen ;)	5 years ago
chenhao.li	e4e52285fe	reapir Example Configuration (#2772) ... The retention period must be a multiple of the index/chunks table period	5 years ago
Pablo Castellano	27693841a4	fix: typo in upgrade.md (#2762)	5 years ago
Douglas Hall	e64409540b	Doc: Vague link text. (#2698) ... * Fixes remove vague link text #2680 * Fix remaining 'docs' links. * Accept suggestion. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Change HTTP API to Ruler API. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Correct typo. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Capitalize Github. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Capitalize Promtail. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Add copy-edit suggestions from @achatterjee-grafana. * Incorporate @owen-d's changes. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>	5 years ago
Madhav Jivrajani	356e2765ff	[DOCS] change format of unordered lists in tech docs (#2724)	5 years ago
San Nguyen	c00c7ed252	docs: use repetitive numbering (#2699)	5 years ago
Sandeep Sukhani	2f7e0e50c2	rpc for querying ingesters to get chunk ids from its store (#2601) ... * rpc for querying ingesters to get chunk ids from its store * fix broken tests * separate out code from querier to query ingester to a new type called IngesterQuerier * add AsyncStore which helps with querying and merging results from both chunk store and ingesters * query ingesters local store for labels when active index type is boltdb-shipper or query store is true * better naming * add some tests * add test case for duplicate chunk ids from ingesters * add some logs and spans * check for nil fetcher * use require.Same to assert that two pointers are pointing to same object * some more improvements 1. query chunk-refs parallely from store and ingesters. 2. limit look back for chunk refs and labels from ingesters to start of schema when using boltdb-shipper. * fixes suggested from PR review * fix mode not being set before cortex_storage.NewStore is being called * add IngesterQuerier as a dependency for store when target is either ingester or querier * do not cache index from ingester * rename tests * fix broken tests * update upgrade guide to rollout ingesters before queriers * upgrade guide changes suggested in PR review * runtime check for whether active index store is boltdb-shipper * consider previous schema as well for boltdb-shipper for calculating max look back	5 years ago
Sandeep Sukhani	337db2fedf	revendor cortex to latest master (#2627)	5 years ago
Sandeep Sukhani	65b539c2ab	add compactor details and other boltdb-shipper doc improvments (#2622)	5 years ago
Ed Welch	1664a98111	Ran htmltest on the generated site and fixed all the broken links (#2600)	5 years ago
Owen Diehl	dd7d821b31	Website doc link fixes (#2566) ... * index file links * non _index.md links * path fix * base readme links * fixes drone badge	5 years ago
Ed Welch	3486889db9	Release 1.6.0 (#2502) ... * Updating changelog and release notes for 1.6.0 * updating version in documentation	5 years ago
Ed Welch	7a60efc100	Reduce querier parallelism to a more sane default value and add comments explaining how to set it. (#2452) ... Remove the default setting for storage_backend which was very misleading for anyone not using the defaults.	5 years ago
Sandeep Sukhani	d5c840bd66	enforce requirment for periodic config for index tables to be 24h when using boltdb shipper (#2166)	5 years ago