155 Commits (27395519becfc6cbd90e78de4b148eb1c38e84e5)

Author	SHA1	Message	Date
Robert Fratto	a1901e274a	pkg/loki: unmarshal module name from YAML (#1260) ... The module name field in the config could not be unmarshalled from a string, causing parsing the config to crash. This commit also changes the error message when the config could not be parsed to print directly to stderr, as the logger won't be initialized at the point where parsing the config fails, leading to no output in the console. Fixes #1259.	6 years ago
Sergey	c1e84b523e	Update docker-driver Dockerfile: add tzdb (#1233) ... Fix error "invalid timestamp stage config: invalid location specified: unknown time zone Europe/Moscow" when specifying `location` in [timestamp stage](https://github.com/grafana/loki/blob/master/docs/clients/promtail/stages/timestamp.md)	6 years ago
Takayuki WATANABE	d080e46e2a	Correct wrong document paths about querying (#1214)	6 years ago
Mstislav Bobakov	149c70a2ca	[promtail] Fix #810 . Set stderr as a default output for klog library (#1180) ... * Fix #810 . Set stderr as a default output for klog library * sync go mod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Marco Pracucci	003cf32b9c	promtail: fix error message displaying on invalid config file	6 years ago
Marco Pracucci	de026a00ac	Fix compiled logproto protobuf (#1183) ... * Enforce recompile of protobuf sources on 'make check-generated-files' * Pinned version of protobuf in loki-build-image * Pinned version of goyacc in loki-build-image * Added 'make build-image-push' to Makefile * Documented how to release loki-build-image	6 years ago
Xiang Dai	b6faee205a	bump up golangci to 1.20 (#1133) ... * bump up golangci to 1.20 Signed-off-by: Xiang Dai <764524258@qq.com> * Built and published 0.7.3. Updated all references Signed-off-by: Joe Elliott <number101010@gmail.com> Signed-off-by: Xiang Dai <764524258@qq.com> * Removed concurrency limitation and added 5m timeout Signed-off-by: Joe Elliott <number101010@gmail.com> * Upping concurrency to try to reduce lint time Signed-off-by: Joe Elliott <number101010@gmail.com> Co-authored-by: Xiang Dai <764524258@qq.com> Co-authored-by: Joe Elliott <number101010@gmail.com>	6 years ago
George Adams	9a6b5dbf7c	Client recommendations documentation tweaks (#1124) ... * consistent use of proper noun for Fluent Bit * add notes about metrics extraction to client selection docs	6 years ago
Marco Pracucci	f3370cf120	docs: fix Promtail / Loki capitalization (#1130) ... * docs: fixed Promtail capitalization * docs: fixed Loki capitalization	6 years ago
Marco Pracucci	bf5eabe2de	Do not retry chunks transferring on shutdown in the local dev env (#1085)	6 years ago
Marco Pracucci	96237b5550	logcli: added --step support to query command (#1103) ... * logcli: added --step support to query command * Changed query range API default step value from 1s to a dynamic value based on start/end input params	6 years ago
Jens Erat	c4913bfc88	fluent-bit: edge case tests (#1096)	6 years ago
Joe Elliott	9faa8bcf1d	Go 1.13 (#1089) ... Updated everything to 1.13 Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Joe Elliott	fc6c5c063f	dep => go mod (#1062) ... * go mod files added. dep removed Signed-off-by: Joe Elliott <number101010@gmail.com> * Magically got prometheus version to stick Signed-off-by: Joe Elliott <number101010@gmail.com> * Cortex updated and prometheus updated Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated prometheus dependency Signed-off-by: Joe Elliott <number101010@gmail.com> * Added additional deps Signed-off-by: Joe Elliott <number101010@gmail.com> * Added two replaces from Gopkg.toml. Tests passing Signed-off-by: Joe Elliott <number101010@gmail.com> * Added deps Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated build image to 1.12 Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated golangci-lint to use vendored dependencies Signed-off-by: Joe Elliott <number101010@gmail.com> * Added check-mod makefile step and referenced in drone and circle ci configs Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated loki-build-image to 1.12 Signed-off-by: Joe Elliott <number101010@gmail.com> * Fixed linting error. Force go111module on for linting Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod vendor Signed-off-by: Joe Elliott <number101010@gmail.com> * Forced the inclusion of modtimevfs Signed-off-by: Joe Elliott <number101010@gmail.com> * Pin client-go due to issue with v12 go.mod Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy Signed-off-by: Joe Elliott <number101010@gmail.com> * Added check-mod to drone Signed-off-by: Joe Elliott <number101010@gmail.com> * Re-readded correct golang client Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy Signed-off-by: Joe Elliott <number101010@gmail.com> * Pinned golang/x/net to avoid proxy errors Signed-off-by: Joe Elliott <number101010@gmail.com> * Removed check-mod from all. Not necessary for tests Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated go.sum to match new pin Signed-off-by: Joe Elliott <number101010@gmail.com> * Upgraded proto to match build image Signed-off-by: Joe Elliott <number101010@gmail.com> * Force check-mod to wait til after test and lint are successful Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod vendor to go builds to force usage of vendored dependencies Signed-off-by: Joe Elliott <number101010@gmail.com> * Turn on gomodules on all builds Signed-off-by: Joe Elliott <number101010@gmail.com> * Revert "Added mod vendor to go builds to force usage of vendored dependencies" This reverts commit 65865a24c9a23133e0fa52942f2828ead7c22147. * Moved builds out of the gopath to enforce vendor usage Signed-off-by: Joe Elliott <number101010@gmail.com> * Revert "Turn on gomodules on all builds" This reverts commit b5847f0158e928e935e0b3c1b1d4eaba840ca3dc. * Explicitly choose build image for docker driver Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated golang.org/x/sys to match prometheus's version to fix promtail windows compilation Signed-off-by: Joe Elliott <number101010@gmail.com> * Added fluentbit dependency Signed-off-by: Joe Elliott <number101010@gmail.com> * Added dependency management clause Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated go version in contributing Signed-off-by: Joe Elliott <number101010@gmail.com> * Added phony makefile targets Signed-off-by: Joe Elliott <number101010@gmail.com> * Circle CI is increasingly failing linting Signed-off-by: Joe Elliott <number101010@gmail.com> * Force vendored deps on builds Signed-off-by: Joe Elliott <number101010@gmail.com> * Added logcli to gitignore Signed-off-by: Joe Elliott <number101010@gmail.com> * Reduced concurrency to help CircleCI Signed-off-by: Joe Elliott <number101010@gmail.com> * Moved drone builds out of GOPATH to force use of go module Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod vendor to prevent go clean from redownloading all packages Signed-off-by: Joe Elliott <number101010@gmail.com> * Added to test as well Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod-vendor to final go commands Signed-off-by: Joe Elliott <number101010@gmail.com> * Moved fluent-bit out of GO_PATH to force go modules Signed-off-by: Joe Elliott <number101010@gmail.com> * Pass mod vendor to the last holdout: go generate Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated ugorji/go to 1.17 to avoid version regression Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy and go mod vendor for ugorji/go Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Hiroshi Hatake	0cfa33d90d	fluent-bit shared object go plugin (#847) ... * Import fluent-bit-go-loki plugin sources * Add fluent-bit-go package constraint * Ensure dependencies with dep ``` $ dep ensure ``` * Update .gitignore * Move fluent-bit-go-loki to fluent-bit/fluent-bit-go-loki directory * Add documentation for fluent-bit-go-loki * Fix for lint * Fix for goimports errors * Display fluent-bit-go-loki plugin version * Use more descriptive description for fluent-bit Loki plugin * Remove needless newlines * Rectify fluent-bit-go-loki makefile Remove needless parts and rename meaningless target * Use more descriptive description in README * refactor(fluent-bit): move make targets into root Makefile * Organize imports * Reorder imports with goimports $ goimports -w out_loki.go * Remove needless LICENSE file Because it is the same for Loki repository. * Rely on Loki client retry mechanism * Make descriptions more clearly * Change default unit * BatchWait: msec -> sec * BatchSize: KiB -> Byte * Use logql to parse Loki native labels format * Use logger instead of fmt.Printf * Update documentation to reflect recent changes * Use prometheus version module to print version * Dump error message with logger * Use DYN_GO_FLAGS instead of custom FLAGS for fluent-bit-plugin * Support RemoveKeys parameter * use logql.ParseMatchers() * refactor fluent-bit go plugin * add ci step for docker image * fix lint issues * fix a failing url test * fix a failing url test * add build images for drone ci * Adding labelmap file to complex record to labels Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add helm chart and fix a bug with labelmap * New push path * dep sync * Move fluent-bit folder and use jsonnet for drone * fix build * Adds more documentation and include a basic config in the container Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove binaries * Some readme grammar fixes * docs: really nitpicky grammar change in clients README * Add helm documentation * fixes bad config * bump chart * fixes .gitignore	6 years ago
sh0rez	00245403d9	feat: configuration source precedence (#980) ... This implements more sophisticated handling of our configuration: - Correct precedence: Flags set on the command line now precede values from YAML, which in turn precede the defaults from the `flag` package - Sticks to the `flagext.Registerer` pattern, as it is partly vendored from Cortex / Weaveworks code we cannot change easily	6 years ago
Joe Elliott	778c0b6857	Update loki push path (#1049) ... This commit adds a /loki/api/v1/push endpoint to mirror the new v1 API, and updates all references to the old push endpoint to new the one.	6 years ago
Sandeep Sukhani	ec5bc7054d	limits: limits implementation for loki (#948) ... * limits implementation for loki Added following new limits: Length of query Number of active streams Number of streams matcher per query Ingestion rate * periodically reload ingestion rate limits to apply latest rates from overrides	6 years ago
sh0rez	794d7da845	feat: -version flag (#1036) ... While we were already setting the version on the built binaries, this now also exposes them as a user-facing flag (`-version`). The already used Prometheus package `github.com/prometheus/common/version` is used for generated the printed string.	6 years ago
polar3130	330d1a6fc0	Fix a link to correct doc and fix a typo (#1014) ... * fix typo * Fix a link to correct doc	6 years ago
Joe Elliott	47637852fb	Logcli: Add Support for New Query Path (#987) ... Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Alexander Danilov	2508dc16c4	Fix links to correct doc (#1005) ... Co-authored-by: Alexander Danilov <smilingnavern@joom.com>	6 years ago
Edward Welch	a2e2272653	use a global variable to wrap debug log statments in the pipeline to prevent unnecessary allocations when debug logging is not enabled	6 years ago
Cyril Tovena	497cff7970	Add stream label to docker driver	6 years ago
Cyril Tovena	5cd384a2af	Allow to pass max-size and max-file to the docker driver	6 years ago
Alexander Pazukhin	29586c7977	resolve: #922. docker-driver compose labels support	6 years ago
Cyril Tovena	7f3db9d7f0	LogQL: Vector and Range Vector Aggregation. ... - adds avg,min,max,top,bottomk,stddev,stdvar,count - updates api documentation - adds tests Improve yacc & go lexer to understand duration Remove support for regexp in all queries Clean up querier and logselector	6 years ago
sh0rez	45bdebf8b2	chore(ci/cd): build containers using drone.io (#891) ... Because drone.io provides us with native ARM runners, we evaluate the platform to figure out if it is a suitable replacement for CircleCI and qemu. Configuration is done using .drone/drone.jsonnet, the .drone/drone.yml is generated from that. Images are built on amd64, arm64 and arm, natively and without emulation. This allows to get rid of cross-compilation, which in turn allows more advanced builds (CGO, etc.) Hopefully this will make the CI faster and more reliable in the future. Let's see!	6 years ago
Ed	173e8ea2a4	fix(canary): Fix Flaky Tests (#889) ... * make the missing entry lookup synchronous during tests to hopefully avoid races around the entry order and test verifications * playing around with timings some more to get all tests to pass even on a really slow machine	6 years ago
Ed	4eddcc1c8c	chore(packaging): avoid running containers from Dockerfile	6 years ago
sh0rez	e4b99f2729	chore(packaging): wrong executable format (#886) ... Due to an invalid usage of bash, the binary was always built for amd64. This fixes that and builds the correct one.	6 years ago
Robert Fratto	297f0e9d03	Makefile: build promtail with CGO_ENABLED if GOHOSTOS=GOOS=linux (#809) ... This commit modifies the Makefile to build promtail with CGO_ENABLED if both GOHOSTOS and GOOS are set to linux. To facilitate the Docker container utilizing the journal support, the container for promtail had to be modified to be based on top of debian. The sd-journal library depends on libsystemd.so being present at runtime. As alpine currently does not have a package for systemd, the easiest approach is to change the base image to debian:stretch-slim. A future solution for providing an alpine-based build will be considered in the future and discussion for the approach will be tracked in #838. This commit also updates the Dockerfile to default to using the latest loki-build-image. If a specific version is required, it should be provided as a build arg to docker build.	6 years ago
Aditya C S	132989031f	Fix Nolabels parse metrics	6 years ago
Ed	fc12a2355d	style(loki-canary): spelling (#832)	6 years ago
sh0rez	b887602e36	chore(packaging/docker): Support multiple architectures (#762) ... This finally adds support for multiple architectures! 🎉 Images are now built using BuildKit (actually img), Dockerfiles were parameterized to allow this. Containers are still built on alpine, using QEMU and binfmt as a kernel compatibility layer to allow RUN steps in these. CircleCI has been fully revamped, to speed up builds and de-duplicate the configuration. Makefile has been extended with additional logic to shadow the multi-arch to non-CI users. Happy hacking on Raspberry Pi and friends :)	6 years ago
Marco Pracucci	e7fb205827	fix(logcli): timestamp timezone handling (#821) ... Logcli used to inconsistently handle timezones in timestamps. This addresses this by adding a new `--timezone` / `-z` flag, to explicitly set the timezone the timestamps shall be formatted in. Furthermore it refactors the output framework inside of logcli to test it easier. Fixes #798	6 years ago
Sandeep Sukhani	459e4e3f4e	Update logcli usage in docs and improve help text	6 years ago
Cyril Tovena	b9463436b2	fix panic in docker driver for newer docker version (18.09.7+) (#813)	6 years ago
Ed	573673a0ab	Simplify our makefile as much as possible (#753) ... refactor(makefile): simplify makefile by removing the autogenerated targets and make building binaries and dockerfiles separate operations.	6 years ago
Edward Welch	3d5319e72a	adding ability to supply timezone to timestamp pipeline stage	6 years ago
Marco Pracucci	8feadf7924	fix: Speed up Loki shutdown when using the sample local config (#784)	6 years ago
Cyril Tovena	d31577faba	adjust old instructions for troubleshooting docker daemon (#785)	6 years ago
sh0rez	38cb093358	feat(loki): extended tailing (#764) ... * refactor(querier/ingester): TailRequest Lookback window Moves the specifications of the Lookback Window out of the logproto.QueryRequest into it's own type logproto.Lookback. This is required, because the Lookback Window will be used in the TailRequest as well. * feat(querier): parse Lookback from HTTP Request * feat(logcli): send Lookback Window spec with tail request * feat(querier): include historic entries in tail mode Extends tailing by sending a configurable amount of historic entries with before the live entries. This enables a behaviour that is closer to kubectl logs -f and docker logs -f. It is implemented by running a regular Query before subscribing to the ingesters. * fix: adapt tests to Lookback change * feat(querier): check all errors to make the linter happy * fix(logproto): flatten Lookback window spec Flattens the Lookback window spec into the individual queries * fix(ingester): adapt test to Lookback flatten	6 years ago
Edward Welch	da6a13383a	better job of fixing url parsing and host name extraction for logcli	6 years ago
Cyril Tovena	c3e74b3eca	fix path escape (#779)	6 years ago
Ed	03dc4e63fa	Parse the addr into a URL so we can extract the Host name for use in the TLSConfig (#778)	6 years ago
Robert Fratto	f74f2c82f4	feat(logcli): add --to flag to specify latest RFC3339 time for query (#776) ... Fixes #774	6 years ago
Edward Welch	e6f431ad46	finishing up loki-canary move into loki repo	6 years ago
Edward Welch	cd5368a44d	preparing for move into loki repo	6 years ago
Cyril Tovena	3346ce1b40	Storage memory improvement (#713) ... * add benchmark for storage queries * improve iterator to load only on next * fix memory retained by lazy chunks * reverse backward lazy iterator	6 years ago