apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Joe Elliott	9faa8bcf1d	Go 1.13 (#1089 ) Updated everything to 1.13 Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Joe Elliott	fc6c5c063f	dep => go mod (#1062 ) * go mod files added. dep removed Signed-off-by: Joe Elliott <number101010@gmail.com> * Magically got prometheus version to stick Signed-off-by: Joe Elliott <number101010@gmail.com> * Cortex updated and prometheus updated Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated prometheus dependency Signed-off-by: Joe Elliott <number101010@gmail.com> * Added additional deps Signed-off-by: Joe Elliott <number101010@gmail.com> * Added two replaces from Gopkg.toml. Tests passing Signed-off-by: Joe Elliott <number101010@gmail.com> * Added deps Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated build image to 1.12 Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated golangci-lint to use vendored dependencies Signed-off-by: Joe Elliott <number101010@gmail.com> * Added check-mod makefile step and referenced in drone and circle ci configs Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated loki-build-image to 1.12 Signed-off-by: Joe Elliott <number101010@gmail.com> * Fixed linting error. Force go111module on for linting Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod vendor Signed-off-by: Joe Elliott <number101010@gmail.com> * Forced the inclusion of modtimevfs Signed-off-by: Joe Elliott <number101010@gmail.com> * Pin client-go due to issue with v12 go.mod Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy Signed-off-by: Joe Elliott <number101010@gmail.com> * Added check-mod to drone Signed-off-by: Joe Elliott <number101010@gmail.com> * Re-readded correct golang client Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy Signed-off-by: Joe Elliott <number101010@gmail.com> * Pinned golang/x/net to avoid proxy errors Signed-off-by: Joe Elliott <number101010@gmail.com> * Removed check-mod from all. Not necessary for tests Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated go.sum to match new pin Signed-off-by: Joe Elliott <number101010@gmail.com> * Upgraded proto to match build image Signed-off-by: Joe Elliott <number101010@gmail.com> * Force check-mod to wait til after test and lint are successful Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod vendor to go builds to force usage of vendored dependencies Signed-off-by: Joe Elliott <number101010@gmail.com> * Turn on gomodules on all builds Signed-off-by: Joe Elliott <number101010@gmail.com> * Revert "Added mod vendor to go builds to force usage of vendored dependencies" This reverts commit 65865a24c9a23133e0fa52942f2828ead7c22147. * Moved builds out of the gopath to enforce vendor usage Signed-off-by: Joe Elliott <number101010@gmail.com> * Revert "Turn on gomodules on all builds" This reverts commit b5847f0158e928e935e0b3c1b1d4eaba840ca3dc. * Explicitly choose build image for docker driver Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated golang.org/x/sys to match prometheus's version to fix promtail windows compilation Signed-off-by: Joe Elliott <number101010@gmail.com> * Added fluentbit dependency Signed-off-by: Joe Elliott <number101010@gmail.com> * Added dependency management clause Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated go version in contributing Signed-off-by: Joe Elliott <number101010@gmail.com> * Added phony makefile targets Signed-off-by: Joe Elliott <number101010@gmail.com> * Circle CI is increasingly failing linting Signed-off-by: Joe Elliott <number101010@gmail.com> * Force vendored deps on builds Signed-off-by: Joe Elliott <number101010@gmail.com> * Added logcli to gitignore Signed-off-by: Joe Elliott <number101010@gmail.com> * Reduced concurrency to help CircleCI Signed-off-by: Joe Elliott <number101010@gmail.com> * Moved drone builds out of GOPATH to force use of go module Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod vendor to prevent go clean from redownloading all packages Signed-off-by: Joe Elliott <number101010@gmail.com> * Added to test as well Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod-vendor to final go commands Signed-off-by: Joe Elliott <number101010@gmail.com> * Moved fluent-bit out of GO_PATH to force go modules Signed-off-by: Joe Elliott <number101010@gmail.com> * Pass mod vendor to the last holdout: go generate Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated ugorji/go to 1.17 to avoid version regression Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy and go mod vendor for ugorji/go Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
sh0rez	00245403d9	feat: configuration source precedence (#980 ) This implements more sophisticated handling of our configuration: - Correct precedence: Flags set on the command line now precede values from YAML, which in turn precede the defaults from the `flag` package - Sticks to the `flagext.Registerer` pattern, as it is partly vendored from Cortex / Weaveworks code we cannot change easily	6 years ago
Joe Elliott	778c0b6857	Update loki push path (#1049 ) This commit adds a /loki/api/v1/push endpoint to mirror the new v1 API, and updates all references to the old push endpoint to new the one.	6 years ago
sh0rez	794d7da845	feat: -version flag (#1036 ) While we were already setting the version on the built binaries, this now also exposes them as a user-facing flag (`-version`). The already used Prometheus package `github.com/prometheus/common/version` is used for generated the printed string.	6 years ago
Edward Welch	a2e2272653	use a global variable to wrap debug log statments in the pipeline to prevent unnecessary allocations when debug logging is not enabled	6 years ago
sh0rez	45bdebf8b2	chore(ci/cd): build containers using drone.io (#891 ) Because drone.io provides us with native ARM runners, we evaluate the platform to figure out if it is a suitable replacement for CircleCI and qemu. Configuration is done using .drone/drone.jsonnet, the .drone/drone.yml is generated from that. Images are built on amd64, arm64 and arm, natively and without emulation. This allows to get rid of cross-compilation, which in turn allows more advanced builds (CGO, etc.) Hopefully this will make the CI faster and more reliable in the future. Let's see!	6 years ago
Ed	4eddcc1c8c	chore(packaging): avoid running containers from Dockerfile	6 years ago
sh0rez	e4b99f2729	chore(packaging): wrong executable format (#886 ) Due to an invalid usage of bash, the binary was always built for amd64. This fixes that and builds the correct one.	6 years ago
Robert Fratto	297f0e9d03	Makefile: build promtail with CGO_ENABLED if GOHOSTOS=GOOS=linux (#809 ) This commit modifies the Makefile to build promtail with CGO_ENABLED if both GOHOSTOS and GOOS are set to linux. To facilitate the Docker container utilizing the journal support, the container for promtail had to be modified to be based on top of debian. The sd-journal library depends on libsystemd.so being present at runtime. As alpine currently does not have a package for systemd, the easiest approach is to change the base image to debian:stretch-slim. A future solution for providing an alpine-based build will be considered in the future and discussion for the approach will be tracked in #838. This commit also updates the Dockerfile to default to using the latest loki-build-image. If a specific version is required, it should be provided as a build arg to docker build.	6 years ago
sh0rez	b887602e36	chore(packaging/docker): Support multiple architectures (#762 ) This finally adds support for multiple architectures! 🎉 Images are now built using BuildKit (actually img), Dockerfiles were parameterized to allow this. Containers are still built on alpine, using QEMU and binfmt as a kernel compatibility layer to allow RUN steps in these. CircleCI has been fully revamped, to speed up builds and de-duplicate the configuration. Makefile has been extended with additional logic to shadow the multi-arch to non-CI users. Happy hacking on Raspberry Pi and friends :)	6 years ago
Ed	573673a0ab	Simplify our makefile as much as possible (#753 ) refactor(makefile): simplify makefile by removing the autogenerated targets and make building binaries and dockerfiles separate operations.	6 years ago
Edward Welch	3d5319e72a	adding ability to supply timezone to timestamp pipeline stage	6 years ago
sh0rez	420a359ff7	fix(loki\|promtail): logger re-init nil config panic (#697 ) When a more or less invalid config (e.g. `null`) is supplied, the log level prop of the config receives an invalid value which causes the logger to panic on re-init. Prevents this by checking for a nil log-level and notifies the user in case	6 years ago
Edward Welch	04facc4d00	updating docs for new pipeline config. removed helm entry in scrape_config.sh because there doesn't seem to be anyway to make it work with new pipeline config	6 years ago
Edward Welch	97e4a122ca	adding a pipeline processing histogram	6 years ago
Cyril Tovena	53075db577	Send logs to multiple loki instances (#536 ) * Adds the ability to provide multiple Loki URL For backward compatibility `client:` still works with flag. * add some tests for multi client * update ksonnet module to support multiple client * fix comment * fix lint issues	6 years ago
Cyril Tovena	b8b7caa450	Promtail targets and service discovery pages (#532 ) * add a custom server for loki with assets embedded * adds a targets page for promtail to see discovered files and labels * lint fixes * fix css table size * add service discovery logic * add service discovery template * add promtail pages documentation * ignored gen file in linter	6 years ago
Edward Welch	916124b9ea	Adding `make debug` support to build debug binaries and debug containers which wrap the binary with delve and allow for remote debugging	6 years ago
Xiang Dai	00906d2066	promtail: fix wrong config path (#375 ) Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Ed	f6d0857ddf	Adding a sync() function to filetarget (#293 ) * Adding a sync() function to filetarget which runs on a timer to catch any events missed by fsnotify * moving where we mark the final position to avoid a race condition exposed in testing, we want to stop the tailer before shutting down our tailer loop * Fix changes from PR and refactor to remove circular imports and make config consistent * Adding an "integration" type unit test which tests promtail as a whole * fixing a bunch of imports I munged moved tailer to its own file refactoring filetarget to make synclogic easier to follow and reused as much as possible	6 years ago
Odin Ugedal	a59c86c68f	Switch docker base image to alpine 3.9 alpine:3.4 only contains a docker image for arm64, so building for other architectures doesn't work. The newest alpine relases, 3.9, is therefore better.	6 years ago
Christian Simon	31789eafc4	Refactor structure of promtail This allows easier integration of other targets than files for promtail. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Anthony Woods	fed3943596	allow promtail path to be a glob match (#206 ) * allow promtail target path to be a glob match Promtail now expects __path__ to be a glob. All files that match the glob expression will be tailed. If new files are created that match the glob, they will immediately be tailed. * remove entry from positions file when file is deleted * fix syncing the current positions to positions file * handle file renames When a file is renamed a "rename" and a "create" event are sent. We need to treat the rename as a remove. If the new filename matches the path glob, then we will start tailing it when the "create" event is reveived. * lint	6 years ago
Ye Ben	904c190364	add readLines metric (#214 )	6 years ago
Vangelis Katsikaros	22f5968d0d	Correct name in promtail error message (#180 )	7 years ago
Carl Bergquist	5aea1fe408	adds build info to loki and promtail (#172 )	7 years ago
Tom Wilkie	db114b60da	Move all the config for various ways of deploying Loki into one place. (#125 ) * Move all the config for various ways of deploying Loki into one place. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Fix reference to consul ksonnet module. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Move getting started docs into the production dir. Remove the raw docker commands, only use the compose file. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Spell production correctly. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Tweaks Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Tweak docs and docker compose setup; put config in images. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * typo Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago
Tom Wilkie	5f73598389	Rename Tempo to Loki. (#36 ) * Rename Tempo to Loki. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Use new build image, don't delete generated files on clean. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago
Tom Wilkie	600b24101e	Promtail updates (#30 ) * Make promtail read all its config from a file. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Use gokit logging everywhere. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Start work to parse normal log lines. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * update common and kuberesolver. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * lint Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Get EntryParser stuff working, so we can tail raw log files. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Make sure filename label works. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * lint, remove interfacer. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago
Tom Wilkie	1fef92bc17	Lint stuff (#27 ) * Check in generated files, to make getting started easier. Add gometalinter, and a lint check for changes to the generated files. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Make lint pass? Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago
Tom Wilkie	d06ed8fb1f	Remove flagext, use cortex's. Allow flags to be loaded from a file. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago
Tom Wilkie	0ffb432f30	Update for cortex changes. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago
Tom Wilkie	3f62b4ec36	s/logish/tempo/ Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago
Tom Wilkie	01ee8313c0	Fix request paths and logging. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago
Tom Wilkie	aa44de07bb	Move promtail from kausalco/public, update it for prometheus changes. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago

36 Commits (fa188936f22d48960c362aca43413f987428d876)