apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Misha Gusarov	3786d74273	JSON encoding: avoid base64 encoding of []byte inside other slices (#1890 ) Closes #1889 Signed-off-by: Mikhail Gusarov <misha@ridge.co>	5 years ago
Joe Elliott	383eb6e70b	Addition of a `/suspend` endpoint to Loki Canary (#1891 ) * First pass loki canary pause Signed-off-by: Joe Elliott <number101010@gmail.com> * Write suspending msg to stderr Signed-off-by: Joe Elliott <number101010@gmail.com> * Added resume endpoint Signed-off-by: Joe Elliott <number101010@gmail.com> * Added documentation on new endpoints Signed-off-by: Joe Elliott <number101010@gmail.com> * Pass both signals to the same channel Signed-off-by: Joe Elliott <number101010@gmail.com> * lint Signed-off-by: Joe Elliott <number101010@gmail.com> * Removed return on startCanary Signed-off-by: Joe Elliott <number101010@gmail.com>	5 years ago
Ben Ye	9a62deb829	Support series API in logcli (#1861 ) * support series API in logcli Signed-off-by: yeya24 <yb532204897@gmail.com> add changelog Signed-off-by: yeya24 <yb532204897@gmail.com> * update logcli docs Signed-off-by: yeya24 <yb532204897@gmail.com>	5 years ago
Robert Fratto	8948ce1f2e	clarify logcli commands and output (#1712 ) * clarify logcli commands and output This commit attempts to do two things: 1. Differentiate between log entries and raw log lines, where the latter is what is produced by `-oraw`. 2. Explain the difference between `logcli query` and `logcli instant-query`. Fixes #1676. * address feedback * address more feedback * explain that instant-query is not useful for log lines * address review feedback This commit leaves logcli.md unmodified; that will be done in a later commit if the changes are approved. * sync logcli.md with command output	5 years ago
Cyril Tovena	ba51aad551	Logcli remote storage. (#1814 ) * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Start hooking logcli with local storage config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes org-id and documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	fa51393bce	Move default port for Loki to 3100 everywhere. (#1838 ) Also fixes default value for the table manager that doesn't support 0 anymore on master. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Mario-Hofstaetter	2a03cde4f4	Change local storage directory to /loki/ and fix permissions (#1833 ) (#1834 )	5 years ago
Cyril Tovena	a0dc10a03a	Use 8080 for Loki http port binding in tanka. (#1823 ) * Use 8080 for Loki http port binding. Previously we were using 80 but now that we run a rootless Loki for security reason. We can't bind below 1000. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update also docker file and default config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
sdojjy	0ad1c6c1af	loki can not be started with loki-local-config.yaml (#1816 )	5 years ago
Cyril Tovena	59410dfb73	Improve fluentbit logfmt. (#1791 ) * Improve fluentbit logfmt. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * mod check. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	45b51ef8d8	Non-root user docker image for Loki. (#1706 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Aditya C S	5b1316ed0f	Fix loki exit on jaeger agent not being present (#1789 )	5 years ago
Robert Fratto	ab4d885276	Fix 32-bit Promtail ARM docker builds from Drone (#1740 ) * link ld-linux-armhf.so.3 when building 32-bit arm promtail image if needed * Update .drone/drone.jsonnet Co-Authored-By: sh0rez <me@shorez.de> * review feedback Co-authored-by: sh0rez <me@shorez.de>	5 years ago
Aditya C S	a4d671b111	Fix panic error when AutoKubernetesLabels is true (#1717 )	5 years ago
Aditya C S	f9ff2a4b02	Add goimport local-prefixes configuration to .golangci.yml (#1710 )	5 years ago
dangoodman	f71504f0d4	Fix regex pipeline-example.yml (#1707 ) Backslashes must not be escaped inside single quotes: https://github.com/grafana/loki/blob/master/docs/clients/promtail/stages/regex.md#schema Spent an hour trying to figure out why no `level` tags assigned to my logs. Worked fine after the fix.	5 years ago
Cyril Tovena	4210fcef35	--dry-run Promtail. (#1652 ) * --dry-run Promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove changed on gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes flaky test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ensure position file is readonly when doing dry-run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add information about dry run mode in the troubleshooting section. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more spaces. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Aditya C S	636ed15c65	Fix logcli --quiet parameter parsing issue (#1682 )	5 years ago
Cyril Tovena	814cc87eb2	Pipe data to Promtail (#1649 ) * Adds readerTarget that read from io.Reader Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Updates comment and function names. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds stdin manager Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds default config with labels and support for static configs labels. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds a test with pipeline stages. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes race on shutdown and adds documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes deadlock on server.run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/clients/promtail/troubleshooting.md Co-Authored-By: Owen Diehl <ow.diehl@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * unlock mutex if Promtail.Run is called when Promtail is stopped Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	5 years ago
Owen Diehl	80e938c412	adds query stats and org id options in logcli (#1638 )	5 years ago
Cyril Tovena	93eb4ad27c	Add statistics to query_range and instant_query API. (#1615 ) * Refactor stats package to use proto. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Merge statistics in the frontend. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve engine logging. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes GRPC by rolling back Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add a test to verify stats in the LogQL engine. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Set circle ci build image to 0.9.1 which contains protobuf regression Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix drone CI. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Change timing data from nanoseconds to seconds like Prometheus. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve naming of stats Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move stats property under data property like Prometheus. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adjust queryrange frontend to use the new stats property Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Cleanup unused structs. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation for stats API. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Format proto file. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds missing godoc on logql.Result Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Pablo Castellano	94dd7565c3	Recommend using the latest schema version (v11) (#1608 )	5 years ago
Peter Štibraný	2ad4d7aba3	Move chunks-inspect tool to Loki repo (#1577 ) * Move chunks-inspect tool to Loki repo Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added README.md Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added .gitignore. Added more description to README.md Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	5 years ago
Robert Fratto	887f0cce7b	Disable transfers in loki-local-config.yaml (#1579 ) * Disable transfers in loki-local-config.yaml #1425 added the ability to disable transfers by setting the max amount of retries to zero or lower. The PR, however, didn't change the default setting in loki-local-config.yaml. This commit changes the setting in loki-local-config.yaml to disable transfers since they would never succeed with the default settings of an inmemory ring anyway. * Set `max_transfer_retries` to 0 in helm charts	5 years ago
Peter Štibraný	d4cae667ae	loki: use new runtimeconfig package from Cortex (#1484 ) * loki: use new runtimeconfig package from Cortex runtimeconfig is a generalization of previous "overrides" mechanism, and can be used not for per-tenant limits, but other parts of Loki too (only one additional usage for now is "multi" KV client). Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * go mod tidy, go mod vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Removed RuntimeConfig from Ingester dependencies. Ingester already depends on RuntimeConfig via Store and Overrides mechanism. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Removed extra new line. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Remove unused method. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix broken code after rebasing. Removed incorrect comment. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated docs with section about runtime configuration. Mostly copied from Cortex. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * go mod tidy, go mod vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated Cortex to current master. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Go mod tidy, vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	5 years ago
Sandeep Sukhani	2ae8bb2bed	logcli: replaced GRAFANA_* with LOKI_* in logcli env vars, set default server url for logcli to localhost (#1492 ) * replaced GRAFANA_* with LOKI_* in logcli env vars, set default server url for logcli to localhost * add env var details in help text of logcli	5 years ago
Owen Diehl	29e4ad8cf8	TOUCH_PROTOS build arg for dockerfile (#1479 ) * TOUCH_PROTOS build arg for dockerfile * echos touch protos in dockerfile * touch protos correct var * make touch-protos options in all dockerfiles, run for amd builds	5 years ago
Jens Erat	557f9ccd7b	fluent-bit: multi-instance support (#1294 ) To run multiple plugin instances at the same time, the plugin instance must be registered and later retrieved. Additionally, a list of registered plugin instances must be stored for proper disposal during fluent-bit shutdown. Based on the [out_multiinstance example] in the upstream repository. [out_multiinstance example]: `fc386d2638/examples/out_multiinstance/out.go` Signed-off-by: Jens Erat <email@jenserat.de> Co-authored-by: Hiroshi Hatake <cosmo0920.oucc@gmail.com>	5 years ago
Jens Erat	c9016f4b2a	fluent-bit-plugin: re-enable JSON marshal tests (#1455 ) My upstream bugfix to `json-iterator/go` was accepted. This commit updates to the newest upstream release, adds checks for the returned error message and reenables the commented-out JSON marshaller tests. Re-enabling the JSON marshaller tests that should return an error message, I realized `sendMessage` logged and ignored marshalling errors instead of passing them to the caller. Signed-off-by: Jens Erat <email@jenserat.de>	5 years ago
Xiang Dai	bb0a64a64b	fix all misspell (#1437 ) Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Cyril Tovena	b1e232c007	Adds tenant-id for docker driver. (#1414 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Cyril Tovena	3ffa385b1e	Let Loki start when using the debug image. (#1372 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Ed Welch	191f87a376	Adding `zip` to the build image (#1364 ) Adding `drone` to the build image and updating the make target to run the drone command in the build image Re-adding `GO111MODULE=on` to the dependency import as it is still required and was removed in error. (Also updated the comment a little to reflect why it is still needed)	6 years ago
Peter Štibraný	49d0d0f0da	Makefile changes to allow easy builds with or without vendoring. Also fixes version bug for both cases. (#1095 ) * Extracted -mod=vendor into a variable * Use ?= to set variable only if not set yet. This enables "MOD_VENDOR= make all" use from command line * Enable/disable vendoring with VENDOR=true or false. Enabled by default * Make go generate use -mod=vendor depending on VENDOR flag * Use GOMOD to specify module version to use. GOMOD can be set to empty string, "vendor", "readonly" and in Go 1.14 to "mod". If not defined, defaults to "vendor". Non empty values are passed to -mod parameter to Go tools, and --modules-download-mode parameter for golangci-cli linting tool. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix versioning info when not using vendoring. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated build image to use Golintci-cli v1.21.0 and Go 1.13.4. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated build image to version 0.8.0. Changs: Golintci-cli v1.21.0, Go 1.13.4. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Renamed MOD_VENDOR to MOD_FLAG to better describe its function. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix version info in all command line tools. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use loki-build-image:0.8.0 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Cyril Tovena	27f17bc1de	Fixes linter warning from the yacc file. (#1328 ) * Fixes linter warning from the yacc file. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improves sed to work on POSIX Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
allanhung	30ec4eba79	fluent-bit-plugin: Auto add Kubernetes labels to Loki labels (#1204 ) * auto parser kubernetes metadata when lineformat set kubernetes * fix format * fix test * refactor * fix typo, use switch instead of if and go fmt * fix switch	6 years ago
Jens Erat	374ac1b70f	fluent-bit: tenant ID configuration (#1273 ) * fluent-bit: tenant ID configuration Both promtail and the fluentd plugin already have support for sending a tenant ID, and all necessary for doing so in fluent-bit is actually passing through the configuration item. Configuration is aligned with the fluentd plugin for consistency. We're lucky, since no configuration will result in an empty string that will be treated as no tenant ID by the Loki shipping client. Signed-off-by: Jens Erat <email@jenserat.de> * promtail: minor typo in documentation Signed-off-by: Jens Erat <email@jenserat.de>	6 years ago
Julien Pivotto	4a2dc5e97d	Update README.md (#1276 )	6 years ago
Jens Erat	492a17def1	fluent-bit: sorted JSON and properly convert []byte to string (#1310 ) * fluent-bit: fix variable spelling mistake Signed-off-by: Jens Erat <email@jenserat.de> * fluent-bit: sort JSON map While developing another fix, I stumbled upon #1309 as a newly written unit test (with multiple key-value pairs in a map) was flaky. While JSON does not [strictly define an order on records in a map][RFC8259], but practical operations with a logging tool pretty much require it (although of course grep for JSON is jq, not grep...). Also, the key value output format is already sorted. Switching to sorted output in jsoniter is pretty easy. As of today, it still has a [bug] though, for which I already provided a [fix]. I propose accepting that rare case where invalid types can occur from msgpack output (can this even happen?) and re-enable the failing test case as soon as the upstream PR is merged. [RFC8259]: https://tools.ietf.org/html/rfc8259#section-4 [bug]: https://github.com/json-iterator/go/issues/388 [fix]: https://github.com/json-iterator/go/issues/422 Signed-off-by: Jens Erat <email@jenserat.de> * fluent-bit: properly convert []byte to string Recently, a regression was introduced that no longer ran a deep conversion of `[]byte` to `string` unless a label map was supplied. This commit fixes this by running the string conversion recursively, also removing the need of applying the conversion function again during label map stage. This change has two minor side effects: - Some test cases had to be moved, as string conversion happens much earlier now. - Invalid characters do not result in the whole label being ignored any more, but are replaced by the unicode placeholder character now. I'd consider this an improvement, making both debugging much easier ("why is that value suddenly missing?") and preserving as much information as possible. Signed-off-by: Jens Erat <email@jenserat.de>	6 years ago
Robert Fratto	a1901e274a	pkg/loki: unmarshal module name from YAML (#1260 ) The module name field in the config could not be unmarshalled from a string, causing parsing the config to crash. This commit also changes the error message when the config could not be parsed to print directly to stderr, as the logger won't be initialized at the point where parsing the config fails, leading to no output in the console. Fixes #1259.	6 years ago
Sergey	c1e84b523e	Update docker-driver Dockerfile: add tzdb (#1233 ) Fix error "invalid timestamp stage config: invalid location specified: unknown time zone Europe/Moscow" when specifying `location` in [timestamp stage](https://github.com/grafana/loki/blob/master/docs/clients/promtail/stages/timestamp.md)	6 years ago
Takayuki WATANABE	d080e46e2a	Correct wrong document paths about querying (#1214 )	6 years ago
Mstislav Bobakov	149c70a2ca	[promtail] Fix #810 . Set stderr as a default output for klog library (#1180 ) * Fix #810 . Set stderr as a default output for klog library * sync go mod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Marco Pracucci	003cf32b9c	promtail: fix error message displaying on invalid config file	6 years ago
Marco Pracucci	de026a00ac	Fix compiled logproto protobuf (#1183 ) * Enforce recompile of protobuf sources on 'make check-generated-files' * Pinned version of protobuf in loki-build-image * Pinned version of goyacc in loki-build-image * Added 'make build-image-push' to Makefile * Documented how to release loki-build-image	6 years ago
Xiang Dai	b6faee205a	bump up golangci to 1.20 (#1133 ) * bump up golangci to 1.20 Signed-off-by: Xiang Dai <764524258@qq.com> * Built and published 0.7.3. Updated all references Signed-off-by: Joe Elliott <number101010@gmail.com> Signed-off-by: Xiang Dai <764524258@qq.com> * Removed concurrency limitation and added 5m timeout Signed-off-by: Joe Elliott <number101010@gmail.com> * Upping concurrency to try to reduce lint time Signed-off-by: Joe Elliott <number101010@gmail.com> Co-authored-by: Xiang Dai <764524258@qq.com> Co-authored-by: Joe Elliott <number101010@gmail.com>	6 years ago
George Adams	9a6b5dbf7c	Client recommendations documentation tweaks (#1124 ) * consistent use of proper noun for Fluent Bit * add notes about metrics extraction to client selection docs	6 years ago
Marco Pracucci	f3370cf120	docs: fix Promtail / Loki capitalization (#1130 ) * docs: fixed Promtail capitalization * docs: fixed Loki capitalization	6 years ago
Marco Pracucci	bf5eabe2de	Do not retry chunks transferring on shutdown in the local dev env (#1085 )	6 years ago
Marco Pracucci	96237b5550	logcli: added --step support to query command (#1103 ) * logcli: added --step support to query command * Changed query range API default step value from 1s to a dynamic value based on start/end input params	6 years ago

... 4 5 6 7 8 ...

437 Commits (dda698ea9dbc5db0ddc2fb063652f986ff388ba9)