479 Commits (8154f3f2b4e7f40b81e4a8374ca31f4b51a92cbc)

Author	SHA1	Message	Date
Callum Styan	01d63c8ae8	[promtail] Refactor promtail client metrics so that we can't have duplicate metrics collected for the lag metric. (#5521) ... * Refactor promtail client metrics so that we can't have duplicate metrics collected for the lag metric. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Set up new metrics passing for other client types. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix lint issues. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update changelog and docs, also rename nested client configs struct to configs. Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Gábor Farkas	d74fc2c06d	Docs: update documentation about "limit" param (#5540)	4 years ago
Febrian Setianto	8d7dbc3e13	Docs: Fix broken link to "Matching IP addresses" (#5550)	4 years ago
Ivana Huckova	2eebdff2e2	Update metric_queries.md (#5525) ... Provided query is incorrect as it has extra `)`. This PR fixes it.	4 years ago
Lukas Monkevicius	3dc1319a36	Update Pub/Sub docs section (#5205) ... * Update Pub/Sub section * Update docs/sources/clients/promtail/gcplog-cloud.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * apply corrections * Update docs/sources/clients/promtail/gcplog-cloud.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/gcplog-cloud.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Cyril Tovena	95fefa6096	Align usage report config with Grafana (#5406) ... * Align usage report config with Grafana Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fixes tests * Update pkg/usagestats/reporter.go Co-authored-by: Christian Haudum <christian.haudum@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Christian Haudum <christian.haudum@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Karsten Jeschkies	ae39676cce	Stub multi tenant querier. (#5490) ... **What this PR does / why we need it**: - Introduce Queries interface and Querier API. - Configure a multi-tenant querier that just passes requests through. **Which issue(s) this PR fixes**: Closes #231 **Special notes for your reviewer**: **Checklist** - [x] Documentation added - [ ] Tests updated - [ ] Add an entry in the `CHANGELOG.md` about the changes.	4 years ago
Karen Miller	6f46a8ffeb	Docs: Fix links and formatting of HTTP API page (#5498)	4 years ago
Dylan Guedes	c3edeac990	Docs: fix link reference to "Step vs Interval" section. (#5495)	4 years ago
Karsten Jeschkies	ead9444d78	Document all support API timestamp formats. (#5439) ... Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Ivana Huckova	7320cb27ad	Update _index.md (#5458)	4 years ago
RangerCD	daacfd0b70	Fix two remote_timeout configs in ingester_client block (#5418) ... * Fix two remote_timeout configs in ingester_client block * Add default value of remote_timeout in document	4 years ago
Benoît Knecht	776e229e94	pkg/ruler/base: Add external_labels option (#5450) ... This option can be used to add a set of labels to all alerts emitted by the ruler. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>	4 years ago
Ed Welch	4ca1fd0adb	set match_max_concurrent true by default (#5435) ... * set match_max_concurrent true by default Signed-off-by: Edward Welch <edward.welch@grafana.com> * add note to upgrade guide, fix up some of the existing notes Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Sandeep Sukhani	ff21fb063f	jsonnet: move boltdb-shipper configs set as compactor args to yaml config (#5393) ... * move boltdb-shipper configs set as compactor args to yaml config * update changelog * update upgrade guide	4 years ago
Josh Risley	39e9c14611	Use output plugin grafana-loki (#5386) ... Reflects name change in v2.1.0. - If an ECS user configures `"Name": "loki"` then the native output plugin will be used and the task configuration crashes in ECS.	4 years ago
Ed Welch	91b0bcf36a	remove promtail_log_entries_bytes_bucket (#5377) ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Jonathan Bédard Schami	776d5c41c7	Lambda-promtail: Enhance lambda-promtail to support adding extra labels from an environment variable value (#5359) ... * updated with ability to add extra tags * updated CHANGELOG.md * simplified extra label env variable to a simple comma seperated list in the form of "name1,value1,name2,value2,..." * refactored parsing of extra labels into its own method. Added unit tests. * removed invalid test, exit early on parseExtraLabels, refactored apply extra labels code to utility method, replaced hardcoded string with const global var in module. * updated docs, terraform template and cloud formation template * updated fmt.Println to fmt.Printf with line termination * updated to validate extra labels and added unit test for extra label validation behaviour * removed unused ExtraLabel struct * updated to use the new applyExtraLabels * pull latest * updated lambda promtail docs with instructions and example on how to use extra labels.	4 years ago
Travis Patterson	d8780da454	Revert to working version of Azure client (#5413) ... * Revert "storage: update azure blobstore client to use new sdk (#5302)" This reverts commit 89b04a97b3. * Fix Azure SDK Issue - Revert SDK to working version - Introduce patches to prevent deadlocks * make metrics global	4 years ago
Michel Hollands	d8ed87d04c	Update dskit version (#5392) ... * Update dskit version Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * update changelog Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add debug printing to see interfaces in CI. This will be reverted Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add comment to remember to remove Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Use netutil.PrivateNetworkInterfacesWithFallback for the other rings Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Move import to place indicated by linter Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove debug printing Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Determine local interfaces in tests Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Rearrange import to satify linter Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update build image in CircleCI Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Change changelegog message to show customer visible changes Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add doc tag and use private network interfaces in common config Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add comment about filtered out non private IP addresses Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update the documentation of the interface names settings Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	4 years ago
Vladyslav Diachenko	0e518967a7	updated documentation for xk6-loki extension (#5321) ... * documented custom k6 metrics that xk6-loki extension reports for instant and range queries * Update docs/sources/clients/k6/query-scenario.md Co-authored-by: Christian Haudum <christian.haudum@gmail.com> * changed description * documented new metrics Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Karsten Jeschkies	b19ce6230a	Build and publish build image. (#5322)	4 years ago
Cyril Tovena	bbaef790db	Add usage report into Loki. (#5361) ... * Adds leader election process Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fluke Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fixes the kv typecheck * wire up the http client * Hooking into loki services, hit a bug * Add stats variable. * re-vendor dskit and improve to never fail service * Intrument Loki with the package * Add changelog entry Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes compactor test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add configuration documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/usagestats/reporter.go Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Add boundary check Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add log for success report. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/usagestats/reporter.go Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com>	4 years ago
Nate Walters	ffc87055b8	Delete docs/sources/copyright directory (#5325) ... Removing copyright notice per https://raintank-corp.slack.com/archives/CH34H23HD/p1643999482151029	4 years ago
Andre Ziviani	699fffe9e5	lambda-promtail: Add ability to ingest logs from S3 (#5065) ... * Add ability to ingest logs from S3 on lambda-promtail * fix ci * fix typo * bump golang and alpine version * update changelog * add s3 permissions on terraform * use for_each instead of count * fix typo * improve function naming * add documentation and an example of a s3 file path * refact logic to identify event type * add missing iam permission to allow lambda to run inside a vpc * fix typo * allow lambda to access only specified s3 buckets * configure a default log retention policy on log group * add missing depends_on to make sure iam role is created before lambda function * update docs * fix label naming convention * fix merge conflict * use new backoff lib and update dependencies * add option to limit batch size * cache s3 client * update docs and terraform * address some feedback on PR * fix typo	4 years ago
Karen Miller	d787a0fe28	Docs: remove "regular" from string definition (#5309)	4 years ago
Vladyslav Diachenko	f0ef4662fe	Documentation for load testing Loki with xk6-loki (#5182) ... * Add initial page for xk6-loki docs Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * added documentation for xk6-loki query scenario * Add simple installation and usage instructions Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add page about log generation with xk6-loki * Add documentation for k6 write scenario Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup: incorporate feedback from Karen Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fixup: incorporate feedback from Karen Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup: @ppcano's suggestions * fixup: @cyriltovena's suggestions * fixup: make read scenario more generic * Apply suggestions from code review Co-authored-by: Pepe Cano <pepe@loadimpact.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Use correct URL for git clone command Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Pepe Cano <pepe@loadimpact.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com>	4 years ago
Susana Ferreira	82fac990a1	Update promtail to support duration string formats (#5290) ... * Update promtail to support duration string formats * Address comments	4 years ago
Travis Patterson	89b04a97b3	storage: update azure blobstore client to use new sdk (#5302) ... * Update azure blobstore client to use new sdk * changelog * fix hardcoded maxretries * linter * more linting * Fix flaky test	4 years ago
Sashank Agarwal	c88734b72c	Link `replace` pipeline stage to doc (#5200)	4 years ago
Owen Diehl	96ff7f900b	Revert "Adding a docs page that helps users understand memberlist a bit more (#5186)" (#5286) ... This reverts commit 7e372cbc56.	4 years ago
Christian Haudum	57b384df8f	Auto-expire old items from FIFO cache (#5148) ... * Remove validity from FIFO cache We can remove the validity setting of 1h in 2.4 for the chunks cache because it doesn't reduce memory usage and instead leads to valid chunks being ignore when querying the cache. Chunks are immutable so it doesn't make sense to not return them if they are present in the cache. Closes #4922 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add periodic task to prune old FIFO cache elements As described in #4921 this PR adds a periodic task that prunes expired items from the FIFO cache to free up memory. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Jennifer Villa	7e372cbc56	Adding a docs page that helps users understand memberlist a bit more (#5186) ... * Added some new docs on memberlist. * Added a page with more memberlist info.	4 years ago
Dan Poltawski	379ca6b409	Promtail docs: Fix link to `unpack` LogQL documentation (#5274)	4 years ago
Ed Welch	09a5a2cee3	Logstash: Add config option which allows seting up an allowlist for labels to be mapped to Loki (#5244) ... * add a config called `include_fields` which lets you allowlist a specific set of fields which will be mapped to labels and sent to Loki. Signed-off-by: Edward Welch <edward.welch@grafana.com> * update docs Signed-off-by: Edward Welch <edward.welch@grafana.com> * restore path for Dockerfile so it works in CI Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Owen Diehl	91d837e79c	Refactor/remove global splitby (#5243) ... * cleans up internal limits struct, removes unnecessary logic * moves querier.split-queries-by-interval to limits, simplifies resulting code. * docs, changelog * flag supports model.duration instead of time.duration * lint and adds new error for deprecated field * reregisters queryrange flags * comment lint * ensures we validate queryrange config and simplifies embedded struct validate() * 0 still disables * simplify cache key generation and protect against divide by zero	4 years ago
Dylan Guedes	3d135e5338	Copy `cortex/pkg/configs` package dependency into Loki (#5139) ... * Fork cortex `configs` into Loki. * Use new forked `configs` package. * Remove duplicated import. * Fix lint issues. * Use new forked util/logger. * Drop support for promql rules v1. - This allow us to remove the `legacy_promql` implementation - If a rulesconfig is received in v1 format, we output a specific error, so we can differentiate between a unknown version and a v1 one. * Modify tests to expect error for legacy rules format. * Add changelog and upgrading guide. - Added them as we dropped support for legacy promql rules configuration which might be a breaking change for some environments. * Update vendor/modules after rebasing.	4 years ago
Florian Klink	ca2132d7cb	Update _index.md (#5241) ... We also fixes typo.	4 years ago
Nabeel Saad	d0c6e3d016	Update _index.md (#5159) ... Adding default value for line_format so customers know which is picked up if the option is not provided.	4 years ago
Karsten Jeschkies	4716eea0db	Provide Docker target and discovery in Promtail. (#4911) ... **What this PR does / why we need it**: This patch adds support to fetch Docker container logs through the Docker daemon API. This should be more robust than the Loki Docker driver or scraping the logs files. The new Docker target will also collect meta information of the scraped containers. **Which issue(s) this PR fixes**: Addresses #2361 Closes #4703 **Special notes for your reviewer**: **Checklist** - [x] Documentation added - [x] Tests updated - [x] Add an entry in the `CHANGELOG.md` about the changes.	4 years ago
Christian Haudum	2e6e050453	Improve docs on how to install logcli from source (#5126) ... * Improve docs on how to install logcli from source Closes #5108 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Improve docs on how to install logcli from source Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
aengusrooneygrafana	c9d49cea6f	Update to Unofficial clients for JS (#5180) ... Came across these packages for JS with help from Danny - I thought they would be useful to include in our docs for posterity. CC @dannykopping for info!	4 years ago
Trevor Whitney	99e046c42f	Default max_outstanding_per_tenant to 2048 (#5204) ... * Default max_outstanding_per_tenant to 2048 * Update changelog	4 years ago
Kaviraj Kanagaraj	0913ea5bf3	Update Loki Team members in the Governance doc. (#5219) ... Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago
Friterad Knäskål	4de90321fd	Update docker.md (#5213) ... Create the containers in detached mode and name the promtail container "promtail". Without this fix the first container must be stopped before the second one is started since they are running in foreground. The promtail container didn't have any "--name" flag so docker assigns a random name to it.	4 years ago
Arve Knudsen	a2dd731586	Chore: Add pkg/util/log package (#5187) ... * Chore: Add pkg/util/log package Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Add changelog entry Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Fix documentation of loki_log_messages_total Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 years ago
Sas Swart	205ad61b8c	Docs: Update memory ballast documentation (#5106) ... * Add memory ballast * Add changelog entry * Add documentation Add additional information to Flag description * Ensure that ballast_bytes can be configured from config file Add documentation * Add Operational scalability documentation related to memory ballast * Restore config.ballast-bytes cli flag * Move config.ballast-bytes cli flag declaration * Update memory ballast documentation as per https://github.com/grafana/loki/pull/5081\#pullrequestreview-848460132 Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Kaviraj	e5c514359b	Fix broken `template_variable` doc link (#4960)	4 years ago
Karsten Jeschkies	5f07e95fc8	Document query limit parameter default. (#5133)	4 years ago
Ed Welch	34a4b242bf	Update to 2.4.2 release (#5121) ... * update project to 2.4.2 release Signed-off-by: Edward Welch <edward.welch@grafana.com> * go.mod cleanup Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> Co-authored-by: Kaviraj <kavirajkanagaraj@gmail.com>	4 years ago