apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Joe Elliott	47637852fb	Logcli: Add Support for New Query Path (#987 ) Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Alexander Danilov	2508dc16c4	Fix links to correct doc (#1005 ) Co-authored-by: Alexander Danilov <smilingnavern@joom.com>	6 years ago
Edward Welch	a2e2272653	use a global variable to wrap debug log statments in the pipeline to prevent unnecessary allocations when debug logging is not enabled	6 years ago
Cyril Tovena	497cff7970	Add stream label to docker driver	6 years ago
Cyril Tovena	5cd384a2af	Allow to pass max-size and max-file to the docker driver	6 years ago
Alexander Pazukhin	29586c7977	resolve: #922 . docker-driver compose labels support	6 years ago
Cyril Tovena	7f3db9d7f0	LogQL: Vector and Range Vector Aggregation. - adds avg,min,max,top,bottomk,stddev,stdvar,count - updates api documentation - adds tests Improve yacc & go lexer to understand duration Remove support for regexp in all queries Clean up querier and logselector	6 years ago
sh0rez	45bdebf8b2	chore(ci/cd): build containers using drone.io (#891 ) Because drone.io provides us with native ARM runners, we evaluate the platform to figure out if it is a suitable replacement for CircleCI and qemu. Configuration is done using .drone/drone.jsonnet, the .drone/drone.yml is generated from that. Images are built on amd64, arm64 and arm, natively and without emulation. This allows to get rid of cross-compilation, which in turn allows more advanced builds (CGO, etc.) Hopefully this will make the CI faster and more reliable in the future. Let's see!	6 years ago
Ed	173e8ea2a4	fix(canary): Fix Flaky Tests (#889 ) * make the missing entry lookup synchronous during tests to hopefully avoid races around the entry order and test verifications * playing around with timings some more to get all tests to pass even on a really slow machine	6 years ago
Ed	4eddcc1c8c	chore(packaging): avoid running containers from Dockerfile	6 years ago
sh0rez	e4b99f2729	chore(packaging): wrong executable format (#886 ) Due to an invalid usage of bash, the binary was always built for amd64. This fixes that and builds the correct one.	6 years ago
Robert Fratto	297f0e9d03	Makefile: build promtail with CGO_ENABLED if GOHOSTOS=GOOS=linux (#809 ) This commit modifies the Makefile to build promtail with CGO_ENABLED if both GOHOSTOS and GOOS are set to linux. To facilitate the Docker container utilizing the journal support, the container for promtail had to be modified to be based on top of debian. The sd-journal library depends on libsystemd.so being present at runtime. As alpine currently does not have a package for systemd, the easiest approach is to change the base image to debian:stretch-slim. A future solution for providing an alpine-based build will be considered in the future and discussion for the approach will be tracked in #838. This commit also updates the Dockerfile to default to using the latest loki-build-image. If a specific version is required, it should be provided as a build arg to docker build.	6 years ago
Aditya C S	132989031f	Fix Nolabels parse metrics	6 years ago
Ed	fc12a2355d	style(loki-canary): spelling (#832 )	6 years ago
sh0rez	b887602e36	chore(packaging/docker): Support multiple architectures (#762 ) This finally adds support for multiple architectures! 🎉 Images are now built using BuildKit (actually img), Dockerfiles were parameterized to allow this. Containers are still built on alpine, using QEMU and binfmt as a kernel compatibility layer to allow RUN steps in these. CircleCI has been fully revamped, to speed up builds and de-duplicate the configuration. Makefile has been extended with additional logic to shadow the multi-arch to non-CI users. Happy hacking on Raspberry Pi and friends :)	6 years ago
Marco Pracucci	e7fb205827	fix(logcli): timestamp timezone handling (#821 ) Logcli used to inconsistently handle timezones in timestamps. This addresses this by adding a new `--timezone` / `-z` flag, to explicitly set the timezone the timestamps shall be formatted in. Furthermore it refactors the output framework inside of logcli to test it easier. Fixes #798	6 years ago
Sandeep Sukhani	459e4e3f4e	Update logcli usage in docs and improve help text	6 years ago
Cyril Tovena	b9463436b2	fix panic in docker driver for newer docker version (18.09.7+) (#813 )	6 years ago
Ed	573673a0ab	Simplify our makefile as much as possible (#753 ) refactor(makefile): simplify makefile by removing the autogenerated targets and make building binaries and dockerfiles separate operations.	6 years ago
Edward Welch	3d5319e72a	adding ability to supply timezone to timestamp pipeline stage	6 years ago
Marco Pracucci	8feadf7924	fix: Speed up Loki shutdown when using the sample local config (#784 )	6 years ago
Cyril Tovena	d31577faba	adjust old instructions for troubleshooting docker daemon (#785 )	6 years ago
sh0rez	38cb093358	feat(loki): extended tailing (#764 ) * refactor(querier/ingester): TailRequest Lookback window Moves the specifications of the Lookback Window out of the logproto.QueryRequest into it's own type logproto.Lookback. This is required, because the Lookback Window will be used in the TailRequest as well. * feat(querier): parse Lookback from HTTP Request * feat(logcli): send Lookback Window spec with tail request * feat(querier): include historic entries in tail mode Extends tailing by sending a configurable amount of historic entries with before the live entries. This enables a behaviour that is closer to kubectl logs -f and docker logs -f. It is implemented by running a regular Query before subscribing to the ingesters. * fix: adapt tests to Lookback change * feat(querier): check all errors to make the linter happy * fix(logproto): flatten Lookback window spec Flattens the Lookback window spec into the individual queries * fix(ingester): adapt test to Lookback flatten	6 years ago
Edward Welch	da6a13383a	better job of fixing url parsing and host name extraction for logcli	6 years ago
Cyril Tovena	c3e74b3eca	fix path escape (#779 )	6 years ago
Ed	03dc4e63fa	Parse the addr into a URL so we can extract the Host name for use in the TLSConfig (#778 )	6 years ago
Robert Fratto	f74f2c82f4	feat(logcli): add --to flag to specify latest RFC3339 time for query (#776 ) Fixes #774	6 years ago
Edward Welch	e6f431ad46	finishing up loki-canary move into loki repo	6 years ago
Edward Welch	cd5368a44d	preparing for move into loki repo	6 years ago
Cyril Tovena	3346ce1b40	Storage memory improvement (#713 ) * add benchmark for storage queries * improve iterator to load only on next * fix memory retained by lazy chunks * reverse backward lazy iterator	6 years ago
sh0rez	9d5630d875	feat(logcli): output modes (#731 ) * feat(logcli): quiet mode Adds a quiet mode (-q / --quiet) to suppress the debug messages to stderr * feat(logcli): output modes Adds two alternative output modes (-o / --output) - raw: emits the line as parsed - jsonl: emits the line plus all known metadata as JSONL (JSON Line) Usage: -o [default, raw, jsonl] * feat(logcli): quiet tailing mode * feat(logcli): output modes while tailing Supports the three different output modes in tail mode as well * feat(logcli): print labels in jsonl tail mode * refactor(logcli): clean up entry printing Moves the entry printing into a standardized interface, implements this three times: - default (human readable) - jsonl (for scripts) - raw ('as is')	6 years ago
sh0rez	d43de72f3b	feat(logcli): query from absolute timestamp (#736 ) * feat(logcli): query from absolute timestamp Adds a new flag (`--from`) as to complement `--since`. While since subtracts a relative duration from the current time, from allows to specify the absolute start of the lookback window. Note: `--from` takes precedence over `--since`, but only if set. * fix(logcli): use RFC3339Nano for -from To comply with Prometheus, this flag now honors Nanoseconds as well (was using RFC3339 so far)	6 years ago
Edward Welch	eedd3d9fc2	prune interval is configurable canary will suspend all operations on SIGINT but not exit, allowing you to shutdown the canary without it being restarted by docker/kubernetes SIGTERM will shutdown everything and end the process	6 years ago
sh0rez	4779b8bd2b	fix(loki): panic on missing config (#720 ) * fix(loki): pass missing config error to user Missing config errors are handled at the library level. Our own check mitigated this and causes loki to SEGFAULT later on * feat(loki): default config file in container The container provides a default config file. Use it by default * Revert "fix(loki): pass missing config error to user" This reverts commit `b2744fcf42`, because loki it assumed loki was incapable of running without config, which is not the case.	6 years ago
sh0rez	420a359ff7	fix(loki\|promtail): logger re-init nil config panic (#697 ) When a more or less invalid config (e.g. `null`) is supplied, the log level prop of the config receives an invalid value which causes the logger to panic on re-init. Prevents this by checking for a nil log-level and notifies the user in case	6 years ago
Edward Welch	bcccbbfaaf	changing the default prune interval to 60 seconds, at the previous 1 second it would cause some way too aggressive querying when scaled out over all our clusters and loki had a hiccup	6 years ago
Sandeep Sukhani	2a8a03795a	Improvements in live tailing of logs (#541 ) * Improvements in live tailing of logs Instead of polling for new logs, a grpc stream is opened between ingester and querier to get live logs Querier reconnects to disconnected or newly added ingesters * Added more comments to code for live log tailing * Some code refactoring in live log tailing * handling delayfor in logcli, max delayfor to be 5 seconds * some changes in tail response in live tailing * Fixed issue with stopping ingesters gracefully when live tailing is being used * Added tests for tailer in querier * Live tailing made logql compatible, some code refactoring suggested in PR	6 years ago
Cyril Tovena	aecf867605	fix missing logger in client (#673 )	6 years ago
Cyril Tovena	2909fe54e1	Docker Logging Driver (#663 ) * adds first version of docker driver * without logrus and fixes some linter issue * fix the driver and start a build system * adds swarm label discovery * Add documentation and more targets * make the linter happy ❤️ * indent config.json * with circleci steps for master and branch * Review Feebacks	6 years ago
Edward Welch	02aed71a28	refactoring things so that the comparator can use the reader to make a direct query to loki to look for logs not received over the websocket before reporting them as missing	6 years ago
sh0rez	6fac9547f2	fix(loki): honor log level from config file (#657 ) Because of the logger being initialized before the configuration file is parsed, the log_level from the config file is ignored. To solve this, the logger is reinitialized after the file is parsed, as it is already being done in promtail.	6 years ago
Edward Welch	04facc4d00	updating docs for new pipeline config. removed helm entry in scrape_config.sh because there doesn't seem to be anyway to make it work with new pipeline config	6 years ago
Sandeep Sukhani	f7f09e2226	Limits: Reject entries based on age set in limits (#631 ) * Reject entries based on age set in limits	6 years ago
Sandeep Sukhani	39bbd733be	ksonnet changes for running loki in single binary (#622 ) * ksonnet changes for running loki in single bianry Added retention config with default values * Fixed indentation	6 years ago
Sandeep Sukhani	3d3c05717a	Update cortex vendor (#610 ) * Update cortex vendor Use query max look back from cortex Update config changes from cortex Fixed breaking code due to updating cortex vendor * fixed linter error	6 years ago
Goutham Veeramachaneni	f2fb161a08	Fix local config: Use DayTime (#598 ) * Fix local config: Use DayTime Psst, the date is the first commit date for loki ;) Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Fix the config in ksonnet and helm too Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	6 years ago
Sandeep Sukhani	f5c8b22b34	Change tail response for backward compatibilty with future changes (#590 ) Changed it to dict with single key called "streams" and value set to list of logproto.Stream	6 years ago
Cyril Peponnet	7942493524	impr/clients: Handle TLS config and MTLS for logcli and promtail (#540 ) * impr/clients: Handle TLS config and MTLS for logcli and promtail * fix/tls: Please gofmt... * impr/clients: use prometheus HTTPClientConfig for logcli and promtail * fix/promtail: Set proper Client config name * impr/promtail: Use prometheus HTTPClientConfig configuration * adapt with master * address review * fix conflicts * address requested changes * remove file Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	6 years ago
Cyril Peponnet	0885f64e60	impr/logcli: Added label output filters + tests (#563 ) * impr/logcli: Added label filters + tests * Address review * udpate readme	6 years ago
Sandeep Sukhani	7b584b54f7	Limiting query start time with config (#572 ) * Limiting query start time with config * Fixed maxLookBackPeriod check, added it to existing configs, some other fixes * gofmted file * Changed maxLookBackPeriod to 4 weeks in helm chart * Setting maxLookBackPeriod in helm chart to 0 and bumping up the helm chart version * changed maxLookBackPeriod in yaml in cmd to 0 and some nit	6 years ago

1 2 3

135 Commits (107dfd3607a634fea1fecf763e10b0e5fa6fb9c1)