apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
FUKAYA Toshikuni	6b74422150	Promtail docs: fix metrics stage. (#5740 ) Signed-off-by: Toshikuni Fukaya <toshikuni-fukaya@cybozu.co.jp>	3 years ago
李国忠	49c331aa6d	fix boltdb-shipper doc (#5796 )	3 years ago
Ed Welch	e15a03b5e5	Loki: Add more details about usage reporting to the docs and default config files. (#5767 ) * Add more details to usage reporting including putting it in our default config files Signed-off-by: Ed Welch <edward.welch@grafana.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * update verbiage Signed-off-by: Ed Welch <edward.welch@grafana.com> * add newlines Signed-off-by: Ed Welch <edward.welch@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Ed Welch	c158b2c5f5	Loki: Revert #4845 which changed the format of errors from the API (#5772 ) * This reverts the changes from #4845, unfortunately changing the content type from plain text to JSON is a breaking change of the API and we should wait to do this at a major release. Signed-off-by: Ed Welch <edward.welch@grafana.com> * fix tests which were updated after initial change. Signed-off-by: Ed Welch <edward.welch@grafana.com>	3 years ago
Karen Miller	c860fc6442	Docs: Document Promtail global rate limiting (#5737 ) * Docs: Document Promtail global rate limiting * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Jennifer Villa <jvilla2013@gmail.com> * Revise strings that explain the new configuration parameters * For rate limiting, limit_config becomes limits_config Co-authored-by: Jennifer Villa <jvilla2013@gmail.com>	3 years ago
Ed Welch	b136d0dab3	Increase flush_op_timeout to 10m, 10s is often much too short for a big WAL replay which can generate a lot of chunks very quickly. (#5768 ) Signed-off-by: Ed Welch <edward.welch@grafana.com>	3 years ago
李国忠	098b5a2d37	[new] promtail pipeline: Promtail Rate Limit stage #5048 (#5051 ) * [new] promtail pipeline: Promtail Rate Limit stage #5048 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * Update clients/pkg/logentry/stages/limit.go Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz> * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * Update docs/sources/clients/promtail/pipelines.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * [new] promtail pipeline: Promtail Rate Limit stage #5048 #5051 * Update docs/sources/clients/promtail/stages/limit.md * Update docs/sources/clients/promtail/stages/limit.md * fix import package * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/stages/limit.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/pipelines.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Michel Hollands	9d62f051b8	Update fluent-bit output name (#5711 ) * Update fluent-bit output name Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Empty commit * Another empty commit	3 years ago
Subomi Oluwalana	732b4ab539	Fixed Getting started docs error (#5504 ) * Simple docs error The docs read "... are what send the logs that Loki generate to Loki" instead of "... are what send the logs that promtail generate to Loki" * Capitalise spelling of Promtail	3 years ago
Karen Miller	34433343e8	Docs: add an empty v2.5 release notes section (#5533 )	3 years ago
Christian Haudum	5ecbbbe5f5	Mark GELF support in Promtail as experimental (#5697 ) Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Christian Haudum	1a7b170cdb	Update Fluent Bit docs (#5402 ) * Change links to fluentbit.io website The documentation for the Fluent Bit Loki output plugin references the fluentbit.io website multiple times. However, the structure of this website seems to have changed. This commit updates the links to the correct URLs (if possible). Additionally, renamed occurences of "fluentbit" to "Fluent Bit", which seems to be the correct spelling of the product according to their website. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Remove trailing commas from JSON code blocks Trailing commands are syntactically not allowed in JSON. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Nicolas Vanheuverzwijn	0950034890	Update retention.md (#5706 ) Retention policy actually accept suffix such as `d` and `w` but Go's time.ParseDuration does not. See `a2dd731586/pkg/storage/chunk/table_manager.go (L93)`	3 years ago
Susana Ferreira	1d1461824d	Move promtail StreamLagLabels config to upper level config.Config (#5686 ) * Move promtail StreamLagLabels config to upper level config.Config * Fix promtail config load test * Fix promtail configuration reference * Add options promtail config section * Kick GitHub CI Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Peter Olivo	0a49d21d40	Fix broken Fluentbit / Fluentd plugin doc links (#5664 )	3 years ago
Callum Styan	01d63c8ae8	[promtail] Refactor promtail client metrics so that we can't have duplicate metrics collected for the lag metric. (#5521 ) * Refactor promtail client metrics so that we can't have duplicate metrics collected for the lag metric. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Set up new metrics passing for other client types. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix lint issues. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update changelog and docs, also rename nested client configs struct to configs. Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Gábor Farkas	d74fc2c06d	Docs: update documentation about "limit" param (#5540 )	3 years ago
Febrian Setianto	8d7dbc3e13	Docs: Fix broken link to "Matching IP addresses" (#5550 )	3 years ago
Ivana Huckova	2eebdff2e2	Update metric_queries.md (#5525 ) Provided query is incorrect as it has extra `)`. This PR fixes it.	3 years ago
Lukas Monkevicius	3dc1319a36	Update Pub/Sub docs section (#5205 ) * Update Pub/Sub section * Update docs/sources/clients/promtail/gcplog-cloud.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * apply corrections * Update docs/sources/clients/promtail/gcplog-cloud.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/gcplog-cloud.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Cyril Tovena	95fefa6096	Align usage report config with Grafana (#5406 ) * Align usage report config with Grafana Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fixes tests * Update pkg/usagestats/reporter.go Co-authored-by: Christian Haudum <christian.haudum@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Christian Haudum <christian.haudum@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/configuration/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Karsten Jeschkies	ae39676cce	Stub multi tenant querier. (#5490 ) What this PR does / why we need it: - Introduce Queries interface and Querier API. - Configure a multi-tenant querier that just passes requests through. Which issue(s) this PR fixes: Closes #231 Special notes for your reviewer: Checklist - [x] Documentation added - [ ] Tests updated - [ ] Add an entry in the `CHANGELOG.md` about the changes.	3 years ago
Karen Miller	6f46a8ffeb	Docs: Fix links and formatting of HTTP API page (#5498 )	3 years ago
Dylan Guedes	c3edeac990	Docs: fix link reference to "Step vs Interval" section. (#5495 )	3 years ago
Karsten Jeschkies	ead9444d78	Document all support API timestamp formats. (#5439 ) Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Ivana Huckova	7320cb27ad	Update _index.md (#5458 )	3 years ago
RangerCD	daacfd0b70	Fix two remote_timeout configs in ingester_client block (#5418 ) * Fix two remote_timeout configs in ingester_client block * Add default value of remote_timeout in document	3 years ago
Benoît Knecht	776e229e94	pkg/ruler/base: Add external_labels option (#5450 ) This option can be used to add a set of labels to all alerts emitted by the ruler. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>	3 years ago
Ed Welch	4ca1fd0adb	set match_max_concurrent true by default (#5435 ) * set match_max_concurrent true by default Signed-off-by: Edward Welch <edward.welch@grafana.com> * add note to upgrade guide, fix up some of the existing notes Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Sandeep Sukhani	ff21fb063f	jsonnet: move boltdb-shipper configs set as compactor args to yaml config (#5393 ) * move boltdb-shipper configs set as compactor args to yaml config * update changelog * update upgrade guide	3 years ago
Josh Risley	39e9c14611	Use output plugin grafana-loki (#5386 ) Reflects name change in v2.1.0. - If an ECS user configures `"Name": "loki"` then the native output plugin will be used and the task configuration crashes in ECS.	3 years ago
Ed Welch	91b0bcf36a	remove promtail_log_entries_bytes_bucket (#5377 ) Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Jonathan Bédard Schami	776d5c41c7	Lambda-promtail: Enhance lambda-promtail to support adding extra labels from an environment variable value (#5359 ) * updated with ability to add extra tags * updated CHANGELOG.md * simplified extra label env variable to a simple comma seperated list in the form of "name1,value1,name2,value2,..." * refactored parsing of extra labels into its own method. Added unit tests. * removed invalid test, exit early on parseExtraLabels, refactored apply extra labels code to utility method, replaced hardcoded string with const global var in module. * updated docs, terraform template and cloud formation template * updated fmt.Println to fmt.Printf with line termination * updated to validate extra labels and added unit test for extra label validation behaviour * removed unused ExtraLabel struct * updated to use the new applyExtraLabels * pull latest * updated lambda promtail docs with instructions and example on how to use extra labels.	3 years ago
Travis Patterson	d8780da454	Revert to working version of Azure client (#5413 ) * Revert "storage: update azure blobstore client to use new sdk (#5302)" This reverts commit `89b04a97b3`. * Fix Azure SDK Issue - Revert SDK to working version - Introduce patches to prevent deadlocks * make metrics global	3 years ago
Michel Hollands	d8ed87d04c	Update dskit version (#5392 ) * Update dskit version Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * update changelog Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add debug printing to see interfaces in CI. This will be reverted Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add comment to remember to remove Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Use netutil.PrivateNetworkInterfacesWithFallback for the other rings Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Move import to place indicated by linter Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove debug printing Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Determine local interfaces in tests Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Rearrange import to satify linter Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update build image in CircleCI Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Change changelegog message to show customer visible changes Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add doc tag and use private network interfaces in common config Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add comment about filtered out non private IP addresses Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update the documentation of the interface names settings Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	3 years ago
Vladyslav Diachenko	0e518967a7	updated documentation for xk6-loki extension (#5321 ) * documented custom k6 metrics that xk6-loki extension reports for instant and range queries * Update docs/sources/clients/k6/query-scenario.md Co-authored-by: Christian Haudum <christian.haudum@gmail.com> * changed description * documented new metrics Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Karsten Jeschkies	b19ce6230a	Build and publish build image. (#5322 )	3 years ago
Cyril Tovena	bbaef790db	Add usage report into Loki. (#5361 ) * Adds leader election process Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fluke Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fixes the kv typecheck * wire up the http client * Hooking into loki services, hit a bug * Add stats variable. * re-vendor dskit and improve to never fail service * Intrument Loki with the package * Add changelog entry Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes compactor test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add configuration documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/usagestats/reporter.go Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Add boundary check Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add log for success report. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/usagestats/reporter.go Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com>	3 years ago
Nate Walters	ffc87055b8	Delete docs/sources/copyright directory (#5325 ) Removing copyright notice per https://raintank-corp.slack.com/archives/CH34H23HD/p1643999482151029	3 years ago
Andre Ziviani	699fffe9e5	lambda-promtail: Add ability to ingest logs from S3 (#5065 ) * Add ability to ingest logs from S3 on lambda-promtail * fix ci * fix typo * bump golang and alpine version * update changelog * add s3 permissions on terraform * use for_each instead of count * fix typo * improve function naming * add documentation and an example of a s3 file path * refact logic to identify event type * add missing iam permission to allow lambda to run inside a vpc * fix typo * allow lambda to access only specified s3 buckets * configure a default log retention policy on log group * add missing depends_on to make sure iam role is created before lambda function * update docs * fix label naming convention * fix merge conflict * use new backoff lib and update dependencies * add option to limit batch size * cache s3 client * update docs and terraform * address some feedback on PR * fix typo	3 years ago
Karen Miller	d787a0fe28	Docs: remove "regular" from string definition (#5309 )	3 years ago
Vladyslav Diachenko	f0ef4662fe	Documentation for load testing Loki with xk6-loki (#5182 ) * Add initial page for xk6-loki docs Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * added documentation for xk6-loki query scenario * Add simple installation and usage instructions Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add page about log generation with xk6-loki * Add documentation for k6 write scenario Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup: incorporate feedback from Karen Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fixup: incorporate feedback from Karen Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup: @ppcano's suggestions * fixup: @cyriltovena's suggestions * fixup: make read scenario more generic * Apply suggestions from code review Co-authored-by: Pepe Cano <pepe@loadimpact.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Use correct URL for git clone command Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Pepe Cano <pepe@loadimpact.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com>	3 years ago
Susana Ferreira	82fac990a1	Update promtail to support duration string formats (#5290 ) * Update promtail to support duration string formats * Address comments	3 years ago
Travis Patterson	89b04a97b3	storage: update azure blobstore client to use new sdk (#5302 ) * Update azure blobstore client to use new sdk * changelog * fix hardcoded maxretries * linter * more linting * Fix flaky test	3 years ago
Sashank Agarwal	c88734b72c	Link `replace` pipeline stage to doc (#5200 )	3 years ago
Owen Diehl	96ff7f900b	Revert "Adding a docs page that helps users understand memberlist a bit more (#5186 )" (#5286 ) This reverts commit `7e372cbc56`.	3 years ago
Christian Haudum	57b384df8f	Auto-expire old items from FIFO cache (#5148 ) * Remove validity from FIFO cache We can remove the validity setting of 1h in 2.4 for the chunks cache because it doesn't reduce memory usage and instead leads to valid chunks being ignore when querying the cache. Chunks are immutable so it doesn't make sense to not return them if they are present in the cache. Closes #4922 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Add periodic task to prune old FIFO cache elements As described in #4921 this PR adds a periodic task that prunes expired items from the FIFO cache to free up memory. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Apply suggestions from code review Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	3 years ago
Jennifer Villa	7e372cbc56	Adding a docs page that helps users understand memberlist a bit more (#5186 ) * Added some new docs on memberlist. * Added a page with more memberlist info.	3 years ago
Dan Poltawski	379ca6b409	Promtail docs: Fix link to `unpack` LogQL documentation (#5274 )	3 years ago
Ed Welch	09a5a2cee3	Logstash: Add config option which allows seting up an allowlist for labels to be mapped to Loki (#5244 ) * add a config called `include_fields` which lets you allowlist a specific set of fields which will be mapped to labels and sent to Loki. Signed-off-by: Edward Welch <edward.welch@grafana.com> * update docs Signed-off-by: Edward Welch <edward.welch@grafana.com> * restore path for Dockerfile so it works in CI Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago

1 2 3 4 5 ...

975 Commits (0025248f8d66043e759ce5da31065c1484f4068d)