apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Trevor Whitney	de93a1bd54	Promtail: add consul agent service discovery (#3834 ) * working prototype Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * update test for new responses and metadata labels Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * fix linting issues Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * clarify license/copyright/attribution to prometheus code Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * undo changes to go.sum when adding consul dep Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * add documentation around consul and consulagent scrape configs Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/clients/promtail/configuration.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Ed Welch <edward.welch@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Karen Miller	0d27c21dd4	Doc updates: (#3823 ) - Revise section titles - Add weight metadata to specify ordering of subsections - Remove TOC info from content prose, as it is already in the right side navigation panel - Remove a redundant section about upgrading.	4 years ago
李国忠	6be2fb0aed	[doc] mtric -> metric (#3578 )	4 years ago
Cyril Tovena	d9380eaac9	Add a target to find dead link in our documentation. (#3713 ) This is not part of the CI because it can be throttle and it's not super fast ~2min. But still usefull to check that no link are down if we make some big structure changes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Trevor Whitney	2f29e8e583	add note about wildcard log patterns and log rotation (#3655 ) Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com>	4 years ago
Stavros Aronis	22edfe34bc	Fix markdown for output stage (#3472 )	4 years ago
Aditya C S	bf4fa6613a	support max_message_length configuration for syslog parser (#3400 ) * support max_message_length configuration for syslog parser * address review comments	4 years ago
Alex Martin	99ac2e0c30	docs: promtail: Fix typo w/ windows_events hyperlink. (#3419 )	4 years ago
paaacman	93f1966451	doc - enable environment variable in configuration (#3385 ) Environment variable in configuration works only if promtail is started with `-config.expand-env=true` option. Should we add `Note: This feature is only available in Loki 2.1+.` too?	4 years ago
Cyril Tovena	72b3acb925	Windows events (#3246 ) * First commit for windows event targets. I had to add couple of new go modules and hook the windows log in. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add the ability to save where we are. * Finished setup tests and comments. * nits * adding documentation * go tidy * lint windows * nope * add manager for non windows * don't lint forked package * mod check Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/promtail/targets/windows/bookmark.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * Use passed-in Prometheus registerer. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Apply suggestions from code review Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * testing out windows drone. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * type exec. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * docker image. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * go/go.exe Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * build windows on container. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * trying another image. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * typo in image Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixed local timezone issue. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix tests with timezone. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes timezone tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update logstash since the last image is not working anymore 🤷 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
Torsten Walter	6c8ad5258b	Deprecate Charts as they have been moved (#2720 ) * Deprecate Charts as they have been moved Signed-off-by: Torsten Walter <torsten.walter@syncier.com> * update docs and links to new chart location Co-authored-by: Edward Welch <edward.welch@grafana.com>	5 years ago
LTek-online	56830bc78b	Changed incorrect headers of sections in the promtail config docu (#2636 ) The configuration documentation of promtails contains some errors where the headers of the sections don't match the actual configs. Notably configuration keys like 'server' and 'clients' have been mislabeled as 'server_config' and 'client_config'. This merge request is aimed to correct that so that it matches the configuration as in the written config files to avoid confusion.	5 years ago
Chance Zibolski	f0d4adc53d	promtail: Add support for using syslog message timestamp (#2914 ) Currently promtail sets the timestamp of incoming syslog messages to the time it was received by promtail. In some cases, it is preferable to use the source timestamp instead. This adds a new `use_message_timestamp` option to the syslog target config, which allows users to opt-in to the behavior of using the timestamp on the message, if one exists.	5 years ago
Keith Byrne	5793c4964e	Configuration: Support environment expansion in configuration (#2837 ) * Support environment expansion in configuration Inspired by https://github.com/cortexproject/cortex/pull/2147 Fixes #2311 Adds -config.expand-env as flag to loki and promtail. * Disable env expansion on logcli * Small nit updates	5 years ago
Kaviraj	690a387cce	fix: Remove depricated `entry_parser` from scrapeconfig (#2752 )	5 years ago
Douglas Hall	e64409540b	Doc: Vague link text. (#2698 ) * Fixes remove vague link text #2680 * Fix remaining 'docs' links. * Accept suggestion. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Change HTTP API to Ruler API. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Correct typo. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Capitalize Github. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Capitalize Promtail. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Add copy-edit suggestions from @achatterjee-grafana. * Incorporate @owen-d's changes. Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>	5 years ago
Madhav Jivrajani	356e2765ff	[DOCS] change format of unordered lists in tech docs (#2724 )	5 years ago
Mark	cd63a535d2	Doc fixes: remove typos and long sentences (#2586 )	5 years ago
Ed Welch	36164bbe1a	Promtail: use --client.external-labels for all clients (#2474 ) * --client.external-labels command line argument will now apply the labels to all clients configured in the clients config section of the config file. * do better Ed	5 years ago
Noah Kantrowitz	47aa1db44a	📝 Note that entry_parser is deprecated. (#2397 )	5 years ago
Robby Milo	5a8bc848db	Sync docs to website (#2378 ) * update docs location * add workflow * update docs content * update content * cleanup	5 years ago
Ed Welch	0b5996021f	Loki: add -print-config-stderr flag to dump loki's runtime config to stderr (#2336 ) * Loki: add -print-config-stderr flag to dump loki's runtime config to stderr * add ability to print inline config for better readability in grafana * add an option to log the config in reverse order to make viewing in Grafana easier. Also added this capability to Promtail	5 years ago
Ed Welch	b24a143043	Promtail: Loki Push API (#2296 ) * refactor to put targets in separate packages * rename scrape package to scrapeconfig * Push implementation, working with logging * adding new vendored library * adding tests * adding documentation and an additional config option. * fixing journal test * rename scrape config entry * Update docs/clients/promtail/configuration.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * PR feedback Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	5 years ago
Aditya C S	ff0a4c35f4	Set JournalTarget Priority value to keyword (#2087 )	5 years ago
Aditya C S	11937d3c3a	Targets not required in promtail config (#2026 ) * Targets not required in promtail config * changing the defaulted value from `dummy` to `localhost`, I think this will be more intuitive for people, also re-worded the docs a bit. Signed-off-by: Ed Welch <edward.welch@grafana.com> Co-authored-by: Ed Welch <edward.welch@grafana.com>	5 years ago
Josh Soref	0d9cf4946a	Spelling (#2014 ) * spelling: access * spelling: actual * spelling: asynchronously * spelling: circleci * spelling: circle * spelling: cognitive * spelling: comment * spelling: computation * spelling: correct * spelling: daemon * spelling: elliott * spelling: enabled * spelling: encbuf * spelling: extracted * spelling: explicitly * spelling: independent * spelling: languages * spelling: loose * spelling: message * spelling: metrics * spelling: mismatch * spelling: nonexistent * spelling: output * spelling: pipeline * spelling: pipe line * spelling: position * spelling: prepend * spelling: query * spelling: receive * spelling: received * spelling: reducible * spelling: registry * spelling: response * spelling: retryable * spelling: scanning * spelling: sourced * spelling: supported * spelling: template * spelling: timeout * spelling: unsupported * spelling: adapter * spelling: deferring * spelling: expirable	5 years ago
Cyril Tovena	34f9c601c9	Adds config to disable HTTP and GRPC server in Promtail. (#2004 ) Fixes #1991. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Peter Štibraný	6d5408c100	Update Cortex to latest master (#1869 ) * Update Cortex to master Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix compilation errors after Cortex update. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Update to Cortex v1.0.0-rc.0 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added missing vendored file. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Vendor Cortex 1.0.0 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Configuration changes. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Mention Cortex 1.0 changes and link to docs. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix jsonnet files, and mention fields that were removed. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	5 years ago
Ward Bekker	8f9c065fa2	Clarified that the api push path needs to be specified. (#1925 ) clarified the api push path needs to be specified. Otherwise folks see this message: level=error ts=2020-04-09T15:08:53.408999Z caller=client.go:247 component=client host=example.com:3100 msg="final error sending batch" status=404 error="server returned HTTP status 404 Not Found (404): 404 page not found"	5 years ago
alexanderGalushka	5e752bf343	feat: tms readiness check bypass implementation fix: renamed flag to health_check_target, default to true fix: flattened nested if statements	5 years ago
Ed Welch	08aa2dabd6	docs: update promtail docs for backoff (#1879 ) Signed-off-by: Edward Welch <edward.welch@grafana.com> (cherry picked from commit `08b3b45989`)	5 years ago
Edward Welch	3c479c8f9c	promtail retry 429 rate limit errors, clarifying risks in the docs of configuring multiple client sections in promtail, also increased the backoff and retry settings in promtail. Signed-off-by: Edward Welch <edward.welch@grafana.com> (cherry picked from commit `6841c418ef`)	5 years ago
Ed Welch	08b3b45989	docs: update promtail docs for backoff (#1879 ) Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Edward Welch	6841c418ef	promtail retry 429 rate limit errors, clarifying risks in the docs of configuring multiple client sections in promtail, also increased the backoff and retry settings in promtail. Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Ed Welch	cb798635f5	Improve promtail configuration docs (#1602 ) * fixing the promtail stage name docs to match their actual stage names, added the docker and cri stages, clarified and improved the examples a little. Signed-off-by: Edward Welch <edward.welch@grafana.com> * fixing newlines Signed-off-by: Edward Welch <edward.welch@grafana.com> * Update docs/clients/promtail/configuration.md Co-Authored-By: Robert Fratto <robert.fratto@grafana.com> * Update docs/clients/promtail/configuration.md Co-Authored-By: Robert Fratto <robert.fratto@grafana.com> * addressing feedback Signed-off-by: Edward Welch <edward.welch@grafana.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	5 years ago
hsraju	62cdc4a5cd	Updated configuration.md (#1504 ) Text error.	5 years ago
Owen Diehl	0b72ddb6a6	positions.ignore-corruptions (#1472 ) * positions.ignore-corruptions * semantic change: s/ignore-corruptions/ignore-invalid-yaml/ * Update pkg/promtail/positions/positions.go Co-Authored-By: Robert Fratto <robertfratto@gmail.com>	5 years ago
wphan	d627cda848	Support microsecond timestamp format (#1426 ) Adds microsecond timestamp support. https://github.com/grafana/loki/issues/1407	6 years ago
Robert Fratto	874d016bd7	promtail: add support for passing through journal entries as JSON This commit adds an extra configuration field (`json`) to the journal target configuration schema. When set to true, messages from the journal target will be passed through as JSON, containing all of the fields from the entry as keys and their values as the value. For backwards compatibility, the value for `json` defaults to false. Closes #1288.	6 years ago
Sebastian Widmer	f0f6f24926	pkg/promtail: IETF Syslog (RFC5424) Support (#1275 ) * IETF syslog (rfc5254) support * Upgrade go-syslog to correctly released v2.0.1 * Incorporate feedback from new linter * Update documentation with relevant RFC sections. * Incorporate feedback from review * Use context to shutdown server. * Use util.Backoff from cortex * Do not embed mutex into TestLabeledClient * Use strings.HasPrefix * Better naming of connectionsClosed -> openConnections * Incorporate further feedback from review * Callback instead of channel in ParseStream. Removes one running Goroutine per connection. * Improve parse error log level. * Move mutex above field it protects. * Use backoff.Ongoing() * Switch to "nontransparent" parser * Further improvements to the documentation	6 years ago
Peter Štibraný	2da8d6f4b8	docs: Fix grpc_listen_host and http_listen_host. (#1353 ) They should be grpc_listen_address and http_listen_address respectively. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Xiang Dai	9afda2c81e	doc(promtail): fix prometheus link (#1333 ) Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Jens Erat	374ac1b70f	fluent-bit: tenant ID configuration (#1273 ) * fluent-bit: tenant ID configuration Both promtail and the fluentd plugin already have support for sending a tenant ID, and all necessary for doing so in fluent-bit is actually passing through the configuration item. Configuration is aligned with the fluentd plugin for consistency. We're lucky, since no configuration will result in an empty string that will be treated as no tenant ID by the Loki shipping client. Signed-off-by: Jens Erat <email@jenserat.de> * promtail: minor typo in documentation Signed-off-by: Jens Erat <email@jenserat.de>	6 years ago
Robert Fratto	715f215c50	pkg/promtail: remove journal target forced path (#1298 ) * pkg/promtail: remove journal target forced path The forced default path for the journal target (/var/log/journal) did not apply to all Linux systems: systemd actually defaults to reading from _two_ default paths: /var/log/journal and /run/log/journal. Not setting an explicit default will enable both of those paths to be searched for journal logs. The comment mentioning the local machine ID was technically accurate, but is normally dealt with by bind mounting /etc/machine-id. That's the standard approach for running fluent-bit in a container, and should be the standard approach for Promtail as well. Fixes #1286.	6 years ago
Marco Pracucci	04f58c880f	promtail: add multi-tenant support (#1135 ) * promtail: added tenant_id support to promtail client * promtail: added tenant stage to dinamically override the tenant ID * promtail: documented client's batch struct and improved tenant stage config pointer usage * Added static value support to tenant stage	6 years ago
Marco Pracucci	f3370cf120	docs: fix Promtail / Loki capitalization (#1130 ) * docs: fixed Promtail capitalization * docs: fixed Loki capitalization	6 years ago
Robert Fratto	65ba42a6e7	Documentation Rewrite (#982 ) * docs: create structure of docs overhaul This commit removes all old docs and lays out the table of contents and framework for how the new documentation will be intended to be read. * docs: add design docs back in * docs: add community documentation * docs: add LogQL docs * docs: port existing operations documentation * docs: add new placeholder file for promtail configuration docs * docs: add TOC for operations/storage * docs: add Loki API documentation * docs: port troubleshooting document * docs: add docker-driver documentation * docs: link to configuration from main docker-driver document * docs: update API for new paths * docs: fix broken links in api.md and remove json marker from examples * docs: incorporate api changes from #1009 * docs: port promtail documentation * docs: add TOC to promtail configuration reference * docs: fix promtail spelling errors * docs: add loki configuration reference * docs: add TOC to configuration * docs: add loki configuration example * docs: add Loki overview with brief explanation about each component * docs: add comparisons document * docs: add info on table manager and update storage/README.md * docs: add getting started * docs: incorporate config yaml changes from #755 * docs: fix typo in releases url for promtail * docs: add installation instructions * docs: add more configuration examples * docs: add information on fluentd client fluent-bit has been temporarily removed until the PR for it is merged. * docs: PR review feedback * docs: add architecture document * docs: add missing information from old docs * `localy` typo Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: s/ran/run/g * Typo * Typo * Tyop * Typo * docs: fixed typo * docs: PR feedback * docs: @cyriltovena PR feedback * docs: add more details to promtail url config option * docs: expand promtail's pipelines document with extra detail * docs: remove reference to Stage interface in pipelines.md * docs: fixed some spelling * docs: clarify promtail configuration and scraping * docs: attempt #2 at explaining promtail's usage of machine hostname * docs: spelling fixes * docs: add reference to promtail custom metrics and fix silly typo * docs: cognizant -> aware * docs: typo * docs: typos * docs: add which components expose which API endpoints in microservices mode * docs: change ksonnet installation to tanka * docs: address most @pracucci feedback * docs: fix all spelling errors so reviewers don't have to keep finding them :) * docs: incorporate changes to API endpoints made in #1022 * docs: add missing loki metrics * docs: add missing promtail metrics * docs: @pstribrany feedback * docs: more @pracucci feedback * docs: move metrics into a table * docs: update push path references to /loki/api/v1/push * docs: add detail to further explain limitations of monolithic mode * docs: add alternative names to modes_of_operation diagram * docs: add log ordering requirement * docs: add procedure for updating docs with latest version * docs: separate out stages documentation into one document per stage * docs: list supported stores in storage documentation * docs: add info on duplicate log lines in pipelines * docs: add line_format as key feature to fluentd * docs: hopefully final commit :)	6 years ago

21 Commits (de93a1bd541e314f993b79814ebe4296ba516c86)