185 Commits (1e1c2470b51a0deda62cdc86559afe2e3f20b6bd)

Author	SHA1	Message	Date
Alex Close	288e644894	docs: Fixed examples within Loki and Promtail docs (#6591) ... * Updated the promtail install example to both fix the Daemonset yaml file and provide a more concrete example for deploying to kubernetes * Removed the sidecar documentation for promtail install as it was both broken and didn't do what it said it did * Updated the simple scalable chart docs to include an example of using a overrides values file and to point to a working example of deploying promtail in a k8s cluster * Updated promtail and loki SSD install docs based on PR feedback * Update docs/sources/clients/promtail/installation.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/installation/simple-scalable-helm.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/installation/simple-scalable-helm.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/installation/simple-scalable-helm.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/installation/simple-scalable-helm.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
carlospeon	171a09b822	Add support for journal matches (only conjuntions) (#6656)	3 years ago
Karen Miller	8ac08e65d9	Docs: improve wording and grammar (#6861)	3 years ago
Alexandre de Sá	6b47aab2de	promtail/client: add bot fields (#6828) ... * chore: add bot fields * Update CHANGELOG.md * chore: update cloudflare configuration section URI * docs: include BotScore and BotScoreSrc to all set of fields * Update CHANGELOG.md	3 years ago
Pablo	c9ef0621d1	Promtail: Add new target for receiving GCP PubSub Push messages (#6777)	3 years ago
Adam Brodziak	210b9ec461	Fix YAML syntax and ConfigMap reference (#6735)	3 years ago
Pablo	0e28452f1f	Targets: Add Heroku HTTPS drain target (#6448)	3 years ago
Dylan Guedes	f17d3d768c	Promtail: Add text encoding conversion to file targets (#6395) ... Adds support for text encoding conversion for file targets. To use it, add `encoding: <encoding_name>` into the scrapeconfig.	3 years ago
Benjamin P. Jung	56bf3a49a2	Fix documentation of environment variable defaults (#6536) ... For some reason, the `-` character was missing here in the documentation. After struggling for some time, I finally figured out that -- quite obviously -- envsubst default behavior applies and thus the documentation was wrong. :-)	4 years ago
Conor Evans	b65e11ec9b	fix(documentation): correct spelling and scrape_config (#6454) ... Signed-off-by: Conor Evans <coevans@tcd.ie>	4 years ago
Karen Miller	ba7e36afd1	Docs: Edits for several PRs that did not have a docs review (#6398)	4 years ago
Michał Jaroń	57d543eff7	Update _index.md - an unofficial Loki client added (#6312) ... I would like to add mjaron-tinyloki-java to unofficial Loki clients. It is standalone small library without any dependencies. It may be an alternative to other libraries which use many dependencies and require more configuration to send logs.	4 years ago
Jan-Otto Kröpke	a1e0298a57	Support tenant id from value (#6290) ... Signed-off-by: Jan-Otto Kröpke <mail@jkroepke.de>	4 years ago
Trevor Wood	0470e4e7d3	feat(fluentd): allow fluentd_thread label to be configurable (#6240) ... Signed-off-by: Trevor Wood <Trevor.G.Wood@gmail.com>	4 years ago
Christian Haudum	b2b4fdec71	Update docs for xk6-loki log formats (#6134) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Nicklas	6922190cde	Documentation: Explain --config.expand-env=true double slash with slash substitution (#6139) ... * docs: Promtail configuration explain expand-env slash pitfall * docs: link to correct envsubst go package Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com>	4 years ago
Callum Styan	b6ac00e1a3	[Promtail] drop lines with malformed json (#6099) ... * Refactor json pipeline stage to have a Run function Signed-off-by: Callum Styan <callumstyan@gmail.com> * Allow for dropping log lines in json pipeline stage if they are not valid json strings Signed-off-by: Callum Styan <callumstyan@gmail.com> * fix linting Signed-off-by: Callum Styan <callumstyan@gmail.com> * Clean up new malformed json test. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address some review feedback. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Refactor json pipeline stage test to use testify assert instead of t.Errorf Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update changelog and docs with new drop malformed option Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update CHANGELOG.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs based on Karen's comments. Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Christian Haudum	d5c337c4d3	docs: Fix broken link from unpack parser to pack stage (#6207) ... and make hyperlinks more obvious Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Artem Timchenko	ebb39db864	lambda-promtail: Add multi-tenancy support (#6102) ... * lambda-promtail: adding multi-tenancy support * update changelog and fix import order * fix import order * fix import order	4 years ago
Christian Haudum	7fff660144	Add UDP protocol support to Promtail's syslog target (#5790) ... Until now, the syslog target in Promtail did only support TCP. This PR adds support for sending syslog messages to Promtail (via ng-syslog or rsyslog) via UDP. UPD for syslogs can be used if you prefer speed over guaranteed delivery. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Corentin Altepe	d9327ecd0c	Added NLog-Targets-Loki as unofficial C# client to Loki (#6061) ... Added a link to the HTTP C# client [NLog-Targets-Loki](https://github.com/corentinaltepe/nlog.loki) in Loki's clients documentation in the unofficial clients sections, right next to its Serilog counterpart.	4 years ago
Paschalis Tsilias	179d741c5f	promtail: Add support for exclusion patterns in `static_config` (#5943) ... * PR base Signed-off-by: Paschalis Tsilias <paschalis.tsilias@grafana.com> * Add CHANGELOG entry; updated documentation for new label Signed-off-by: Paschalis Tsilias <paschalis.tsilias@grafana.com> * Follow logic from t.path in exlusion case; always handle matching Signed-off-by: Paschalis Tsilias <paschalis.tsilias@grafana.com> * Make error message unique Signed-off-by: Paschalis Tsilias <paschalis.tsilias@grafana.com> * Only run if t.pathExclude is set Signed-off-by: Paschalis Tsilias <paschalis.tsilias@grafana.com> * Revert "Only run if t.pathExclude is set" This reverts commit 17abb006ce141071c4bca4b7d133bea2aa314594.	4 years ago
Karen Miller	f031427bec	Docs: PR 5387 redo - Warn ECS users to avoid plain text creds (#6051)	4 years ago
Callum Styan	800b7c6345	[promtail] Mark promtail single client config flags and config file block as deprecated (#5842) ... * Mark promtail single client config flags and config file block as deprecated. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update some promtail docs examples that still use `client` instead of `clients`. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix imports. Signed-off-by: Callum Styan <callumstyan@gmail.com> * properly format url as an array item since we changed to clients from client Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Rastislav Barlik	3e17245743	Fix wrong indentation in example config (#5828)	4 years ago
FUKAYA Toshikuni	6b74422150	Promtail docs: fix metrics stage. (#5740) ... Signed-off-by: Toshikuni Fukaya <toshikuni-fukaya@cybozu.co.jp>	4 years ago
Karen Miller	c860fc6442	Docs: Document Promtail global rate limiting (#5737) ... * Docs: Document Promtail global rate limiting * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Jennifer Villa <jvilla2013@gmail.com> * Revise strings that explain the new configuration parameters * For rate limiting, limit_config becomes limits_config Co-authored-by: Jennifer Villa <jvilla2013@gmail.com>	4 years ago
李国忠	098b5a2d37	[new] promtail pipeline: Promtail Rate Limit stage #5048 (#5051) ... * [new] promtail pipeline: Promtail Rate Limit stage #5048 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * Update clients/pkg/logentry/stages/limit.go Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz> * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * Update docs/sources/clients/promtail/pipelines.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * Update docs/sources/clients/promtail/stages/limit.md * Update docs/sources/clients/promtail/stages/limit.md * fix import package * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/pipelines.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Michel Hollands	9d62f051b8	Update fluent-bit output name (#5711) ... * Update fluent-bit output name Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Empty commit * Another empty commit	4 years ago
Christian Haudum	5ecbbbe5f5	Mark GELF support in Promtail as experimental (#5697) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Christian Haudum	1a7b170cdb	Update Fluent Bit docs (#5402) ... * Change links to fluentbit.io website The documentation for the Fluent Bit Loki output plugin references the fluentbit.io website multiple times. However, the structure of this website seems to have changed. This commit updates the links to the correct URLs (if possible). Additionally, renamed occurences of "fluentbit" to "Fluent Bit", which seems to be the correct spelling of the product according to their website. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Remove trailing commas from JSON code blocks Trailing commands are syntactically not allowed in JSON. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Susana Ferreira	1d1461824d	Move promtail StreamLagLabels config to upper level config.Config (#5686) ... * Move promtail StreamLagLabels config to upper level config.Config * Fix promtail config load test * Fix promtail configuration reference * Add options promtail config section * Kick GitHub CI Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Peter Olivo	0a49d21d40	Fix broken Fluentbit / Fluentd plugin doc links (#5664)	4 years ago
Callum Styan	01d63c8ae8	[promtail] Refactor promtail client metrics so that we can't have duplicate metrics collected for the lag metric. (#5521) ... * Refactor promtail client metrics so that we can't have duplicate metrics collected for the lag metric. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Set up new metrics passing for other client types. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix lint issues. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update changelog and docs, also rename nested client configs struct to configs. Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Lukas Monkevicius	3dc1319a36	Update Pub/Sub docs section (#5205) ... * Update Pub/Sub section * Update docs/sources/clients/promtail/gcplog-cloud.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * apply corrections * Update docs/sources/clients/promtail/gcplog-cloud.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/gcplog-cloud.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Josh Risley	39e9c14611	Use output plugin grafana-loki (#5386) ... Reflects name change in v2.1.0. - If an ECS user configures `"Name": "loki"` then the native output plugin will be used and the task configuration crashes in ECS.	4 years ago
Jonathan Bédard Schami	776d5c41c7	Lambda-promtail: Enhance lambda-promtail to support adding extra labels from an environment variable value (#5359) ... * updated with ability to add extra tags * updated CHANGELOG.md * simplified extra label env variable to a simple comma seperated list in the form of "name1,value1,name2,value2,..." * refactored parsing of extra labels into its own method. Added unit tests. * removed invalid test, exit early on parseExtraLabels, refactored apply extra labels code to utility method, replaced hardcoded string with const global var in module. * updated docs, terraform template and cloud formation template * updated fmt.Println to fmt.Printf with line termination * updated to validate extra labels and added unit test for extra label validation behaviour * removed unused ExtraLabel struct * updated to use the new applyExtraLabels * pull latest * updated lambda promtail docs with instructions and example on how to use extra labels.	4 years ago
Vladyslav Diachenko	0e518967a7	updated documentation for xk6-loki extension (#5321) ... * documented custom k6 metrics that xk6-loki extension reports for instant and range queries * Update docs/sources/clients/k6/query-scenario.md Co-authored-by: Christian Haudum <christian.haudum@gmail.com> * changed description * documented new metrics Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Andre Ziviani	699fffe9e5	lambda-promtail: Add ability to ingest logs from S3 (#5065) ... * Add ability to ingest logs from S3 on lambda-promtail * fix ci * fix typo * bump golang and alpine version * update changelog * add s3 permissions on terraform * use for_each instead of count * fix typo * improve function naming * add documentation and an example of a s3 file path * refact logic to identify event type * add missing iam permission to allow lambda to run inside a vpc * fix typo * allow lambda to access only specified s3 buckets * configure a default log retention policy on log group * add missing depends_on to make sure iam role is created before lambda function * update docs * fix label naming convention * fix merge conflict * use new backoff lib and update dependencies * add option to limit batch size * cache s3 client * update docs and terraform * address some feedback on PR * fix typo	4 years ago
Karen Miller	d787a0fe28	Docs: remove "regular" from string definition (#5309)	4 years ago
Vladyslav Diachenko	f0ef4662fe	Documentation for load testing Loki with xk6-loki (#5182) ... * Add initial page for xk6-loki docs Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * added documentation for xk6-loki query scenario * Add simple installation and usage instructions Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add page about log generation with xk6-loki * Add documentation for k6 write scenario Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup: incorporate feedback from Karen Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fixup: incorporate feedback from Karen Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup: @ppcano's suggestions * fixup: @cyriltovena's suggestions * fixup: make read scenario more generic * Apply suggestions from code review Co-authored-by: Pepe Cano <pepe@loadimpact.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Use correct URL for git clone command Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Pepe Cano <pepe@loadimpact.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com>	4 years ago
Susana Ferreira	82fac990a1	Update promtail to support duration string formats (#5290) ... * Update promtail to support duration string formats * Address comments	4 years ago
Sashank Agarwal	c88734b72c	Link `replace` pipeline stage to doc (#5200)	4 years ago
Dan Poltawski	379ca6b409	Promtail docs: Fix link to `unpack` LogQL documentation (#5274)	4 years ago
Ed Welch	09a5a2cee3	Logstash: Add config option which allows seting up an allowlist for labels to be mapped to Loki (#5244) ... * add a config called `include_fields` which lets you allowlist a specific set of fields which will be mapped to labels and sent to Loki. Signed-off-by: Edward Welch <edward.welch@grafana.com> * update docs Signed-off-by: Edward Welch <edward.welch@grafana.com> * restore path for Dockerfile so it works in CI Signed-off-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Florian Klink	ca2132d7cb	Update _index.md (#5241) ... We also fixes typo.	4 years ago
Nabeel Saad	d0c6e3d016	Update _index.md (#5159) ... Adding default value for line_format so customers know which is picked up if the option is not provided.	4 years ago
Karsten Jeschkies	4716eea0db	Provide Docker target and discovery in Promtail. (#4911) ... **What this PR does / why we need it**: This patch adds support to fetch Docker container logs through the Docker daemon API. This should be more robust than the Loki Docker driver or scraping the logs files. The new Docker target will also collect meta information of the scraped containers. **Which issue(s) this PR fixes**: Addresses #2361 Closes #4703 **Special notes for your reviewer**: **Checklist** - [x] Documentation added - [x] Tests updated - [x] Add an entry in the `CHANGELOG.md` about the changes.	4 years ago
aengusrooneygrafana	c9d49cea6f	Update to Unofficial clients for JS (#5180) ... Came across these packages for JS with help from Danny - I thought they would be useful to include in our docs for posterity. CC @dannykopping for info!	4 years ago
Kevin	5030a1f463	Promtail: exclude_user_data description fix (#5038) ... Based on https://github.com/grafana/loki/blob/main/clients/pkg/promtail/scrapeconfig/scrapeconfig.go#L224 the option to exclude user data of windows evens is misspelled in the documentation. This puts the correct exclude_user_data option in the documentation.	4 years ago