apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Robert Fratto	887f0cce7b	Disable transfers in loki-local-config.yaml (#1579 ) * Disable transfers in loki-local-config.yaml #1425 added the ability to disable transfers by setting the max amount of retries to zero or lower. The PR, however, didn't change the default setting in loki-local-config.yaml. This commit changes the setting in loki-local-config.yaml to disable transfers since they would never succeed with the default settings of an inmemory ring anyway. * Set `max_transfer_retries` to 0 in helm charts	5 years ago
Peter Štibraný	d4cae667ae	loki: use new runtimeconfig package from Cortex (#1484 ) * loki: use new runtimeconfig package from Cortex runtimeconfig is a generalization of previous "overrides" mechanism, and can be used not for per-tenant limits, but other parts of Loki too (only one additional usage for now is "multi" KV client). Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * go mod tidy, go mod vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Removed RuntimeConfig from Ingester dependencies. Ingester already depends on RuntimeConfig via Store and Overrides mechanism. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Removed extra new line. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Remove unused method. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix broken code after rebasing. Removed incorrect comment. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated docs with section about runtime configuration. Mostly copied from Cortex. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * go mod tidy, go mod vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated Cortex to current master. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Go mod tidy, vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	5 years ago
Sandeep Sukhani	2ae8bb2bed	logcli: replaced GRAFANA_* with LOKI_* in logcli env vars, set default server url for logcli to localhost (#1492 ) * replaced GRAFANA_* with LOKI_* in logcli env vars, set default server url for logcli to localhost * add env var details in help text of logcli	5 years ago
Owen Diehl	29e4ad8cf8	TOUCH_PROTOS build arg for dockerfile (#1479 ) * TOUCH_PROTOS build arg for dockerfile * echos touch protos in dockerfile * touch protos correct var * make touch-protos options in all dockerfiles, run for amd builds	5 years ago
Jens Erat	557f9ccd7b	fluent-bit: multi-instance support (#1294 ) To run multiple plugin instances at the same time, the plugin instance must be registered and later retrieved. Additionally, a list of registered plugin instances must be stored for proper disposal during fluent-bit shutdown. Based on the [out_multiinstance example] in the upstream repository. [out_multiinstance example]: `fc386d2638/examples/out_multiinstance/out.go` Signed-off-by: Jens Erat <email@jenserat.de> Co-authored-by: Hiroshi Hatake <cosmo0920.oucc@gmail.com>	5 years ago
Jens Erat	c9016f4b2a	fluent-bit-plugin: re-enable JSON marshal tests (#1455 ) My upstream bugfix to `json-iterator/go` was accepted. This commit updates to the newest upstream release, adds checks for the returned error message and reenables the commented-out JSON marshaller tests. Re-enabling the JSON marshaller tests that should return an error message, I realized `sendMessage` logged and ignored marshalling errors instead of passing them to the caller. Signed-off-by: Jens Erat <email@jenserat.de>	5 years ago
Xiang Dai	bb0a64a64b	fix all misspell (#1437 ) Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Cyril Tovena	b1e232c007	Adds tenant-id for docker driver. (#1414 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Cyril Tovena	3ffa385b1e	Let Loki start when using the debug image. (#1372 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Ed Welch	191f87a376	Adding `zip` to the build image (#1364 ) Adding `drone` to the build image and updating the make target to run the drone command in the build image Re-adding `GO111MODULE=on` to the dependency import as it is still required and was removed in error. (Also updated the comment a little to reflect why it is still needed)	6 years ago
Peter Štibraný	49d0d0f0da	Makefile changes to allow easy builds with or without vendoring. Also fixes version bug for both cases. (#1095 ) * Extracted -mod=vendor into a variable * Use ?= to set variable only if not set yet. This enables "MOD_VENDOR= make all" use from command line * Enable/disable vendoring with VENDOR=true or false. Enabled by default * Make go generate use -mod=vendor depending on VENDOR flag * Use GOMOD to specify module version to use. GOMOD can be set to empty string, "vendor", "readonly" and in Go 1.14 to "mod". If not defined, defaults to "vendor". Non empty values are passed to -mod parameter to Go tools, and --modules-download-mode parameter for golangci-cli linting tool. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix versioning info when not using vendoring. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated build image to use Golintci-cli v1.21.0 and Go 1.13.4. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated build image to version 0.8.0. Changs: Golintci-cli v1.21.0, Go 1.13.4. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Renamed MOD_VENDOR to MOD_FLAG to better describe its function. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix version info in all command line tools. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use loki-build-image:0.8.0 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Cyril Tovena	27f17bc1de	Fixes linter warning from the yacc file. (#1328 ) * Fixes linter warning from the yacc file. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improves sed to work on POSIX Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
allanhung	30ec4eba79	fluent-bit-plugin: Auto add Kubernetes labels to Loki labels (#1204 ) * auto parser kubernetes metadata when lineformat set kubernetes * fix format * fix test * refactor * fix typo, use switch instead of if and go fmt * fix switch	6 years ago
Jens Erat	374ac1b70f	fluent-bit: tenant ID configuration (#1273 ) * fluent-bit: tenant ID configuration Both promtail and the fluentd plugin already have support for sending a tenant ID, and all necessary for doing so in fluent-bit is actually passing through the configuration item. Configuration is aligned with the fluentd plugin for consistency. We're lucky, since no configuration will result in an empty string that will be treated as no tenant ID by the Loki shipping client. Signed-off-by: Jens Erat <email@jenserat.de> * promtail: minor typo in documentation Signed-off-by: Jens Erat <email@jenserat.de>	6 years ago
Julien Pivotto	4a2dc5e97d	Update README.md (#1276 )	6 years ago
Jens Erat	492a17def1	fluent-bit: sorted JSON and properly convert []byte to string (#1310 ) * fluent-bit: fix variable spelling mistake Signed-off-by: Jens Erat <email@jenserat.de> * fluent-bit: sort JSON map While developing another fix, I stumbled upon #1309 as a newly written unit test (with multiple key-value pairs in a map) was flaky. While JSON does not [strictly define an order on records in a map][RFC8259], but practical operations with a logging tool pretty much require it (although of course grep for JSON is jq, not grep...). Also, the key value output format is already sorted. Switching to sorted output in jsoniter is pretty easy. As of today, it still has a [bug] though, for which I already provided a [fix]. I propose accepting that rare case where invalid types can occur from msgpack output (can this even happen?) and re-enable the failing test case as soon as the upstream PR is merged. [RFC8259]: https://tools.ietf.org/html/rfc8259#section-4 [bug]: https://github.com/json-iterator/go/issues/388 [fix]: https://github.com/json-iterator/go/issues/422 Signed-off-by: Jens Erat <email@jenserat.de> * fluent-bit: properly convert []byte to string Recently, a regression was introduced that no longer ran a deep conversion of `[]byte` to `string` unless a label map was supplied. This commit fixes this by running the string conversion recursively, also removing the need of applying the conversion function again during label map stage. This change has two minor side effects: - Some test cases had to be moved, as string conversion happens much earlier now. - Invalid characters do not result in the whole label being ignored any more, but are replaced by the unicode placeholder character now. I'd consider this an improvement, making both debugging much easier ("why is that value suddenly missing?") and preserving as much information as possible. Signed-off-by: Jens Erat <email@jenserat.de>	6 years ago
Robert Fratto	a1901e274a	pkg/loki: unmarshal module name from YAML (#1260 ) The module name field in the config could not be unmarshalled from a string, causing parsing the config to crash. This commit also changes the error message when the config could not be parsed to print directly to stderr, as the logger won't be initialized at the point where parsing the config fails, leading to no output in the console. Fixes #1259.	6 years ago
Sergey	c1e84b523e	Update docker-driver Dockerfile: add tzdb (#1233 ) Fix error "invalid timestamp stage config: invalid location specified: unknown time zone Europe/Moscow" when specifying `location` in [timestamp stage](https://github.com/grafana/loki/blob/master/docs/clients/promtail/stages/timestamp.md)	6 years ago
Takayuki WATANABE	d080e46e2a	Correct wrong document paths about querying (#1214 )	6 years ago
Mstislav Bobakov	149c70a2ca	[promtail] Fix #810 . Set stderr as a default output for klog library (#1180 ) * Fix #810 . Set stderr as a default output for klog library * sync go mod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Marco Pracucci	003cf32b9c	promtail: fix error message displaying on invalid config file	6 years ago
Marco Pracucci	de026a00ac	Fix compiled logproto protobuf (#1183 ) * Enforce recompile of protobuf sources on 'make check-generated-files' * Pinned version of protobuf in loki-build-image * Pinned version of goyacc in loki-build-image * Added 'make build-image-push' to Makefile * Documented how to release loki-build-image	6 years ago
Xiang Dai	b6faee205a	bump up golangci to 1.20 (#1133 ) * bump up golangci to 1.20 Signed-off-by: Xiang Dai <764524258@qq.com> * Built and published 0.7.3. Updated all references Signed-off-by: Joe Elliott <number101010@gmail.com> Signed-off-by: Xiang Dai <764524258@qq.com> * Removed concurrency limitation and added 5m timeout Signed-off-by: Joe Elliott <number101010@gmail.com> * Upping concurrency to try to reduce lint time Signed-off-by: Joe Elliott <number101010@gmail.com> Co-authored-by: Xiang Dai <764524258@qq.com> Co-authored-by: Joe Elliott <number101010@gmail.com>	6 years ago
George Adams	9a6b5dbf7c	Client recommendations documentation tweaks (#1124 ) * consistent use of proper noun for Fluent Bit * add notes about metrics extraction to client selection docs	6 years ago
Marco Pracucci	f3370cf120	docs: fix Promtail / Loki capitalization (#1130 ) * docs: fixed Promtail capitalization * docs: fixed Loki capitalization	6 years ago
Marco Pracucci	bf5eabe2de	Do not retry chunks transferring on shutdown in the local dev env (#1085 )	6 years ago
Marco Pracucci	96237b5550	logcli: added --step support to query command (#1103 ) * logcli: added --step support to query command * Changed query range API default step value from 1s to a dynamic value based on start/end input params	6 years ago
Jens Erat	c4913bfc88	fluent-bit: edge case tests (#1096 )	6 years ago
Joe Elliott	9faa8bcf1d	Go 1.13 (#1089 ) Updated everything to 1.13 Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Joe Elliott	fc6c5c063f	dep => go mod (#1062 ) * go mod files added. dep removed Signed-off-by: Joe Elliott <number101010@gmail.com> * Magically got prometheus version to stick Signed-off-by: Joe Elliott <number101010@gmail.com> * Cortex updated and prometheus updated Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated prometheus dependency Signed-off-by: Joe Elliott <number101010@gmail.com> * Added additional deps Signed-off-by: Joe Elliott <number101010@gmail.com> * Added two replaces from Gopkg.toml. Tests passing Signed-off-by: Joe Elliott <number101010@gmail.com> * Added deps Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated build image to 1.12 Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated golangci-lint to use vendored dependencies Signed-off-by: Joe Elliott <number101010@gmail.com> * Added check-mod makefile step and referenced in drone and circle ci configs Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated loki-build-image to 1.12 Signed-off-by: Joe Elliott <number101010@gmail.com> * Fixed linting error. Force go111module on for linting Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod vendor Signed-off-by: Joe Elliott <number101010@gmail.com> * Forced the inclusion of modtimevfs Signed-off-by: Joe Elliott <number101010@gmail.com> * Pin client-go due to issue with v12 go.mod Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy Signed-off-by: Joe Elliott <number101010@gmail.com> * Added check-mod to drone Signed-off-by: Joe Elliott <number101010@gmail.com> * Re-readded correct golang client Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy Signed-off-by: Joe Elliott <number101010@gmail.com> * Pinned golang/x/net to avoid proxy errors Signed-off-by: Joe Elliott <number101010@gmail.com> * Removed check-mod from all. Not necessary for tests Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated go.sum to match new pin Signed-off-by: Joe Elliott <number101010@gmail.com> * Upgraded proto to match build image Signed-off-by: Joe Elliott <number101010@gmail.com> * Force check-mod to wait til after test and lint are successful Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod vendor to go builds to force usage of vendored dependencies Signed-off-by: Joe Elliott <number101010@gmail.com> * Turn on gomodules on all builds Signed-off-by: Joe Elliott <number101010@gmail.com> * Revert "Added mod vendor to go builds to force usage of vendored dependencies" This reverts commit 65865a24c9a23133e0fa52942f2828ead7c22147. * Moved builds out of the gopath to enforce vendor usage Signed-off-by: Joe Elliott <number101010@gmail.com> * Revert "Turn on gomodules on all builds" This reverts commit b5847f0158e928e935e0b3c1b1d4eaba840ca3dc. * Explicitly choose build image for docker driver Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated golang.org/x/sys to match prometheus's version to fix promtail windows compilation Signed-off-by: Joe Elliott <number101010@gmail.com> * Added fluentbit dependency Signed-off-by: Joe Elliott <number101010@gmail.com> * Added dependency management clause Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated go version in contributing Signed-off-by: Joe Elliott <number101010@gmail.com> * Added phony makefile targets Signed-off-by: Joe Elliott <number101010@gmail.com> * Circle CI is increasingly failing linting Signed-off-by: Joe Elliott <number101010@gmail.com> * Force vendored deps on builds Signed-off-by: Joe Elliott <number101010@gmail.com> * Added logcli to gitignore Signed-off-by: Joe Elliott <number101010@gmail.com> * Reduced concurrency to help CircleCI Signed-off-by: Joe Elliott <number101010@gmail.com> * Moved drone builds out of GOPATH to force use of go module Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod vendor to prevent go clean from redownloading all packages Signed-off-by: Joe Elliott <number101010@gmail.com> * Added to test as well Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod-vendor to final go commands Signed-off-by: Joe Elliott <number101010@gmail.com> * Moved fluent-bit out of GO_PATH to force go modules Signed-off-by: Joe Elliott <number101010@gmail.com> * Pass mod vendor to the last holdout: go generate Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated ugorji/go to 1.17 to avoid version regression Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy and go mod vendor for ugorji/go Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Hiroshi Hatake	0cfa33d90d	fluent-bit shared object go plugin (#847 ) * Import fluent-bit-go-loki plugin sources * Add fluent-bit-go package constraint * Ensure dependencies with dep ``` $ dep ensure ``` * Update .gitignore * Move fluent-bit-go-loki to fluent-bit/fluent-bit-go-loki directory * Add documentation for fluent-bit-go-loki * Fix for lint * Fix for goimports errors * Display fluent-bit-go-loki plugin version * Use more descriptive description for fluent-bit Loki plugin * Remove needless newlines * Rectify fluent-bit-go-loki makefile Remove needless parts and rename meaningless target * Use more descriptive description in README * refactor(fluent-bit): move make targets into root Makefile * Organize imports * Reorder imports with goimports $ goimports -w out_loki.go * Remove needless LICENSE file Because it is the same for Loki repository. * Rely on Loki client retry mechanism * Make descriptions more clearly * Change default unit * BatchWait: msec -> sec * BatchSize: KiB -> Byte * Use logql to parse Loki native labels format * Use logger instead of fmt.Printf * Update documentation to reflect recent changes * Use prometheus version module to print version * Dump error message with logger * Use DYN_GO_FLAGS instead of custom FLAGS for fluent-bit-plugin * Support RemoveKeys parameter * use logql.ParseMatchers() * refactor fluent-bit go plugin * add ci step for docker image * fix lint issues * fix a failing url test * fix a failing url test * add build images for drone ci * Adding labelmap file to complex record to labels Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add helm chart and fix a bug with labelmap * New push path * dep sync * Move fluent-bit folder and use jsonnet for drone * fix build * Adds more documentation and include a basic config in the container Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove binaries * Some readme grammar fixes * docs: really nitpicky grammar change in clients README * Add helm documentation * fixes bad config * bump chart * fixes .gitignore	6 years ago
sh0rez	00245403d9	feat: configuration source precedence (#980 ) This implements more sophisticated handling of our configuration: - Correct precedence: Flags set on the command line now precede values from YAML, which in turn precede the defaults from the `flag` package - Sticks to the `flagext.Registerer` pattern, as it is partly vendored from Cortex / Weaveworks code we cannot change easily	6 years ago
Joe Elliott	778c0b6857	Update loki push path (#1049 ) This commit adds a /loki/api/v1/push endpoint to mirror the new v1 API, and updates all references to the old push endpoint to new the one.	6 years ago
Sandeep Sukhani	ec5bc7054d	limits: limits implementation for loki (#948 ) * limits implementation for loki Added following new limits: Length of query Number of active streams Number of streams matcher per query Ingestion rate * periodically reload ingestion rate limits to apply latest rates from overrides	6 years ago
sh0rez	794d7da845	feat: -version flag (#1036 ) While we were already setting the version on the built binaries, this now also exposes them as a user-facing flag (`-version`). The already used Prometheus package `github.com/prometheus/common/version` is used for generated the printed string.	6 years ago
polar3130	330d1a6fc0	Fix a link to correct doc and fix a typo (#1014 ) * fix typo * Fix a link to correct doc	6 years ago
Joe Elliott	47637852fb	Logcli: Add Support for New Query Path (#987 ) Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Alexander Danilov	2508dc16c4	Fix links to correct doc (#1005 ) Co-authored-by: Alexander Danilov <smilingnavern@joom.com>	6 years ago
Edward Welch	a2e2272653	use a global variable to wrap debug log statments in the pipeline to prevent unnecessary allocations when debug logging is not enabled	6 years ago
Cyril Tovena	497cff7970	Add stream label to docker driver	6 years ago
Cyril Tovena	5cd384a2af	Allow to pass max-size and max-file to the docker driver	6 years ago
Alexander Pazukhin	29586c7977	resolve: #922 . docker-driver compose labels support	6 years ago
Cyril Tovena	7f3db9d7f0	LogQL: Vector and Range Vector Aggregation. - adds avg,min,max,top,bottomk,stddev,stdvar,count - updates api documentation - adds tests Improve yacc & go lexer to understand duration Remove support for regexp in all queries Clean up querier and logselector	6 years ago
sh0rez	45bdebf8b2	chore(ci/cd): build containers using drone.io (#891 ) Because drone.io provides us with native ARM runners, we evaluate the platform to figure out if it is a suitable replacement for CircleCI and qemu. Configuration is done using .drone/drone.jsonnet, the .drone/drone.yml is generated from that. Images are built on amd64, arm64 and arm, natively and without emulation. This allows to get rid of cross-compilation, which in turn allows more advanced builds (CGO, etc.) Hopefully this will make the CI faster and more reliable in the future. Let's see!	6 years ago
Ed	173e8ea2a4	fix(canary): Fix Flaky Tests (#889 ) * make the missing entry lookup synchronous during tests to hopefully avoid races around the entry order and test verifications * playing around with timings some more to get all tests to pass even on a really slow machine	6 years ago
Ed	4eddcc1c8c	chore(packaging): avoid running containers from Dockerfile	6 years ago
sh0rez	e4b99f2729	chore(packaging): wrong executable format (#886 ) Due to an invalid usage of bash, the binary was always built for amd64. This fixes that and builds the correct one.	6 years ago
Robert Fratto	297f0e9d03	Makefile: build promtail with CGO_ENABLED if GOHOSTOS=GOOS=linux (#809 ) This commit modifies the Makefile to build promtail with CGO_ENABLED if both GOHOSTOS and GOOS are set to linux. To facilitate the Docker container utilizing the journal support, the container for promtail had to be modified to be based on top of debian. The sd-journal library depends on libsystemd.so being present at runtime. As alpine currently does not have a package for systemd, the easiest approach is to change the base image to debian:stretch-slim. A future solution for providing an alpine-based build will be considered in the future and discussion for the approach will be tracked in #838. This commit also updates the Dockerfile to default to using the latest loki-build-image. If a specific version is required, it should be provided as a build arg to docker build.	6 years ago
Aditya C S	132989031f	Fix Nolabels parse metrics	6 years ago
Ed	fc12a2355d	style(loki-canary): spelling (#832 )	6 years ago

... 6 7 8 9 10 ...

514 Commits (e038d0fc3af9cc2adecbda81dbc39163be22ba11)