apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Patrick Mansfield	b3f6f6b415	table_manager: Change some level.Info() logging to level.Debug() (#6076 ) There is excessive logging of "creating table" and "synching tables" messages, change them to use level.Debug() instead of level.Info() to limit the output. Fixes #1786	3 years ago
n4mine	1d25e17b32	Docs: fix pic location in `sources/fundamentals/architecture/deployment-modes.md` (#6089 )	3 years ago
Kaviraj Kanagaraj	0a4bfbe4f7	Remove nosiy "inflight" requests log entries (#6074 ) We have enough metrics now (queue time, queue length and metrics.go statistics) that makes these log entries obselete. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Karen Miller	2264b73311	Docs: remove Cortex references (#6079 ) * Docs: remove Cortex references * Bug fix: (after PR 6015) Cortex to Loki update	3 years ago
Sashank Agarwal	c76565af53	fix labeler (#6087 )	3 years ago
Owen Diehl	93de7a7061	renames skip -> ok in ProcessString (#6064 ) * renames skip -> ok in ProcessString Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * streampipeline matches convention Signed-off-by: Owen Diehl <ow.diehl@gmail.com>	3 years ago
Kaviraj Kanagaraj	8b15632dd8	Fix(query-frontend): LokiCodec encode/decode works correctly with label values endpoint (#6084 ) When encode/decode `http.Request` into `querybase.Request` we re-create request.Path. Before this PR, both `/labels/` and `/labels/{name}/values` endpoint was decoding into same URL path `/labels/` before forwarding to the querier. So it always returns label names as response. This bug became visible after enabling all the middleware for `/labels/{name}/values` endpoint as well via #6072 Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Sashank Agarwal	6392ddb71b	Auto add labels on new pull request (#6065 ) * add auto labeler github action * add auto labeler github action	3 years ago
Christian Simon	213bb86802	Add integration tests which test happy path (#5968 ) * Add integration tests which test happy path This PR adds simple go based integration tests, which can run Loki in two modes: - single-binary - micro-services with index-gateway After standing up it performs the most basic duties like: - ingest logs - run a range query - query label names and label values This is meant to catch more significant problem as early as possible in the PR. We should aim to keep this as simple as possible. * Replace config generation with template Makes configuration much more readable and avoids easy mistakes * Apply suggestions from code review Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com> Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com>	3 years ago
Christian Haudum	7fff660144	Add UDP protocol support to Promtail's syslog target (#5790 ) Until now, the syslog target in Promtail did only support TCP. This PR adds support for sending syslog messages to Promtail (via ng-syslog or rsyslog) via UDP. UPD for syslogs can be used if you prefer speed over guaranteed delivery. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Ed Welch	98fda9b0a0	Loki: Change live tailing to only allow mutating the log line not the number of streams. (#6063 ) * don't create more streams when live tailing logs, process the log line with the pipeline to allow mutating the content of the line but don't split it into new streams. Signed-off-by: Edward Welch <edward.welch@grafana.com> * update changelog Signed-off-by: Edward Welch <edward.welch@grafana.com> * don't mutate the incoming streams Signed-off-by: Edward Welch <edward.welch@grafana.com> * do not reuse the pipeline because it caches labels Signed-off-by: Edward Welch <edward.welch@grafana.com> * add note to upgrade guide Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Kaviraj Kanagaraj	bb2e952d6f	Fix(query-frontend): `/label/<name>/values` endpoint to use right set of middlewares (#6072 ) * Fix(query-frontend): `/label/<name>/values` endpoint to use right middleware Previously, only `/label/` and `/labels` endpoint were using correct tripperware middleware on the query frontend(e.g: stats collector middleware) This PR fixes it for `/label/<name>/values` endpoint as well. This is useful to support `metrics.go` stats middleware for `label/{name}/values` endpoint as well. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove `unhandledpath` test Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove unused test helper Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
dependabot[bot]	00e210aa51	Bump actions/checkout from 2 to 3 (#5558 ) Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3. - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](https://github.com/actions/checkout/compare/v2...v3) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	3 years ago
Corentin Altepe	d9327ecd0c	Added NLog-Targets-Loki as unofficial C# client to Loki (#6061 ) Added a link to the HTTP C# client [NLog-Targets-Loki](https://github.com/corentinaltepe/nlog.loki) in Loki's clients documentation in the unofficial clients sections, right next to its Serilog counterpart.	3 years ago
W.T. Chang	9c19b0f548	Fix broken link on deployment-modes.md (#6068 ) The configuration link should go another parent level further in order to get `docs/loki/latest/configuration/`, currently it points to `docs/loki/latest/fundamentals/configuration/`.	3 years ago
Sandeep Sukhani	8cd4694adb	allow more time for boltdb-shipper index syncs to finish (#6071 ) * retains index files with ingester for 20 mins instead of 12 mins after uploading * sets GetChunkIDs lookback to 2h41m instead of 2h28m	3 years ago
Paschalis Tsilias	179d741c5f	promtail: Add support for exclusion patterns in `static_config` (#5943 ) * PR base Signed-off-by: Paschalis Tsilias <paschalis.tsilias@grafana.com> * Add CHANGELOG entry; updated documentation for new label Signed-off-by: Paschalis Tsilias <paschalis.tsilias@grafana.com> * Follow logic from t.path in exlusion case; always handle matching Signed-off-by: Paschalis Tsilias <paschalis.tsilias@grafana.com> * Make error message unique Signed-off-by: Paschalis Tsilias <paschalis.tsilias@grafana.com> * Only run if t.pathExclude is set Signed-off-by: Paschalis Tsilias <paschalis.tsilias@grafana.com> * Revert "Only run if t.pathExclude is set" This reverts commit 17abb006ce141071c4bca4b7d133bea2aa314594.	3 years ago
Susana Ferreira	38b1d3b914	Update Loki reads/writes resources dashboards (#5765 )	3 years ago
Bryan Boreham	241bde1271	Add dot to some DNS address to reduce lookups (#5789 ) Kubernetes sets up a DNS search path like `namespace.svc.cluster.local, svc.cluster.local, cluster.local, google.internal`; any unqualified name is first tried as a prefix to each of these. These requests, which will never succeed, add latency and increase load on the DNS service. Adding a `.` at the end makes the name fully-qualified, so Go's DNS client will skip the search path and use the name as-is. Note only changes a subset of addresses in the config; others didn't seem to be causing a problem.	3 years ago
Evangelos Foutras	093fe91ce9	Bump inet.af/netaddr for Go 1.18 compatibility (#5872 ) Fixes panic caused by outdated go4.org/unsafe/assume-no-moving-gc. [1] [1] assume-no-moving-gc commit 538ce61f45ea5c2c48d7133d44b3e52c3db5c31e	3 years ago
Zach Leslie	cce2d8ef2f	Promoto policyRule to v1 (#6003 )	3 years ago
Alex Ferm	d7f03be212	Update libsystemd-dev from bullseye-backports for arm32 docker images, fixes (#5938 ) (#6012 )	3 years ago
dependabot[bot]	8a5877ccf1	Bump github.com/minio/minio-go/v7 from 7.0.10 to 7.0.24 (#6007 ) Bumps [github.com/minio/minio-go/v7](https://github.com/minio/minio-go) from 7.0.10 to 7.0.24. - [Release notes](https://github.com/minio/minio-go/releases) - [Commits](https://github.com/minio/minio-go/compare/v7.0.10...v7.0.24) --- updated-dependencies: - dependency-name: github.com/minio/minio-go/v7 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	3 years ago
Dylan Guedes	162e82ebfb	Use quiet flag in logcli tail.go. (#6033 )	3 years ago
Dylan Guedes	47ce070b73	Add missing changelog entry for change introduced by PR 6034. (#6040 ) * Add missing changelog entry regarding PR 6034. * Move changelog entry to promtail subsection	3 years ago
Sandeep Sukhani	2758dc659a	boltdb shipper index list cache improvements (#6054 ) * bypass index list cache when doing query time downloading of index * detect and refresh stale index list cache during sync	3 years ago
Karen Miller	a5b9a9a91c	Docs: Improve wording of getting started guide (#6060 ) - Add the -d option to all docker-compose up commands - Make the wording consistent about the CWD	3 years ago
Travis Patterson	eb242f305d	Add tailing metrics (#6059 ) * Add tailing metrics * fix test * fix test	3 years ago
Owen Diehl	309592a8cf	ignores reporting cancellations as errors in the usage-reporter module (#6058 )	3 years ago
Cyril Tovena	9cb78bdad8	Improve index entries deduping and concurrency (#6055 )	3 years ago
Susana Ferreira	6b6521f791	Add metrics to range mapper (#6030 ) * Refactor ShardingMetrics to MapperMetrics * Add mapper metrics to range mapper	3 years ago
Cyril Tovena	5d51e5a54f	Improve batching in boltdb index (#6044 ) * Improve batching in boltdb index * review feedback	3 years ago
Christian Haudum	4891e28bff	Decrease log level for "failed to put to memcached" (#6018 ) Since failing to put to memcache does not have an operational impact on the write path, this log message should not be an error. Make it a warning instead. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
JordanRushing	0c721b49d6	Add IndexGateway Query Readiness Duration panel to `Loki - Reads Resources` dashboard in production/loki-mixin (#6014 ) * Add IndexGateway Query Readiness Duration panel to `Loki - Reads Resources` dashboard in production/loki-mixin Signed-off-by: JordanRushing <rushing.jordan@gmail.com> * Satisfy `make lint-jsonnet` by fixing query used in IndexGateway Query Readiness dashboard Signed-off-by: JordanRushing <rushing.jordan@gmail.com>	3 years ago
Christian Simon	6c1a62d829	Ensure proto definitions are formatted [2/2] (#6000 ) * Update build image to 0.10.4 * Add a fmt target for proto defintions This uses buf to ensure the proto defintions are more consistently formatted. * Update formatted files	3 years ago
Christian Simon	084a0804f1	docker-compose: Disable auth in Grafana (#5998 )	3 years ago
Michel Hollands	477a0e71df	Add filter parameter to rebound so lines can be deleted by the compactor (#5879 ) * Add filter parameter to rebound Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix linting issues Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add filter function to delete request Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix linting issues Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Enable api for filter and delete mode Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add settings for retention Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Use labels to check and add test Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Simplify filter function Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Also enable filter mode Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove test settings in config file for docker Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add extra (unused) param for ProcessString in filter Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Empty commit to trigger CI again Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Update changelog Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Fix flapping test Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Remove commented out unit tests and add some more Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Add extra test case for delete request without line filter Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Use chunk bounds Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * check if the log selector has a filter if the whole chunk is selected Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * fix lint issue: use correct go-kit import Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	3 years ago
Periklis Tsirakidis	8c03d2389c	operator: Merge gh index page with README.md to link to docs (#6048 )	3 years ago
Cyril Tovena	d73df0834a	Improve series store index queries (#6045 )	3 years ago
Arve Knudsen	d0160cb09c	Upgrade inet.af/netaddr (#6046 ) Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	3 years ago
Karen Miller	f031427bec	Docs: PR 5387 redo - Warn ECS users to avoid plain text creds (#6051 )	3 years ago
Christian Haudum	e2cde40009	Add query scheduler to "Read Resources" mixin dashboard (#6028 ) This component has been around for a while but has not been added to the loki-mixin yet. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Karen Miller	c4ebfd3020	Docs: revise getting started guide (#5939 ) * Revise the getting started section * Docs: revise getting started guide * Intermediate commit of getting started material. * Intermediate revision of the getting started guide. Add instructions to download, configure, and deploy the test environment. * Add sample queries and instructions for breaking down the test env * Revise prose using reviewer comments. * update to use promtail and flog in the docker compose file Signed-off-by: Edward Welch <edward.welch@grafana.com> * Revise guide to put all parts into Docker containers. * Add README files for examples directory. Revise getting started instructions. * Address DylanGuedes review comments * Getting started guide: incorporate suggestions from ssncferreira Co-authored-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Alexandre de Verteuil	149227b889	Minor fixes in docs/sources/api/_index.md (#5915 )	3 years ago
Dylan Guedes	cd02d6a478	Add better observability to queryReadiness (#5946 ) * Add two metrics to the IndexGateway. - Add a new `query_readiness_duration_seconds` metric, that reports query readiness duration of a tablemanager/index gateway instance. We should use it later to report performance against the ring mode - Add a new `usersToBeQueryReadyForTotal` metric, that reports number of users involved in the query readiness operation. We should use it later to correlate number of users with the query readiness duration. * Remove `usersToBeQueryReadyForTotal`. - It will report all users always for now, so it isn't too helpful the way it is. * Rename metric help text to not mislead people. * Log queryReadiness duration. * Fix where log message and duration and triggered. * Join users list in a single string. - This is necessary since go-kit doesn't support array type. * Tweak queryReadiness log messages. - As suggested by Ed on https://github.com/grafana/loki/pull/5972#discussion_r859734129 and https://github.com/grafana/loki/pull/5972#discussion_r859736072 * Ensure queryReadinessDuration metric. - It is redundant with a recently added log line. * noop	3 years ago
Ed Welch	fc8c4f0592	Loki: Add a configurable ability to fudge incoming timestamps for guaranteed query sort order when receiving entries for the same stream that have duplicate timestamps. (#6042 ) * Add a per tenant ability to fudge duplicate timestamps in the distributor Signed-off-by: Edward Welch <edward.welch@grafana.com> * update docs Signed-off-by: Edward Welch <edward.welch@grafana.com> * lint Signed-off-by: Edward Welch <edward.welch@grafana.com> * update changelog Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Dylan Guedes	88c4781dc7	Revendor `grafana/tail` to fix promtail symlink behavior (#6034 ) * Revendor grafana/tail. - This revendoring brings the fix to relative symlinks, as described in https://github.com/grafana/loki/issues/3374. * Prune package from `go mod tidy`. * noop	3 years ago
Cyril Tovena	986fe5cf05	Remove empty match within concat of regex (#6026 ) * Remove empty match within concat of regex * add back tests	3 years ago
Kaviraj Kanagaraj	0cc3fe7e54	Disable calling new index-gateway client's API. (#6025 ) * Disable calling new index-gateway client's API. * Remove infinite recursive call * Correct mock setup for test	3 years ago
Gerard Vanloo	bcb8009679	operator: logerr v2 update (#5987 )	3 years ago

1 2 3 4 5 ...

3417 Commits (b3f6f6b415b266d604524638e3d7a5eb8acfe6d0) All Branches Search

3417 Commits (b3f6f6b415b266d604524638e3d7a5eb8acfe6d0)

All Branches