140 Commits (3d7e9cee362434e870459039cd02bfcb44cd43ce)

Author	SHA1	Message	Date
Dylan Guedes	3d7e9cee36	Copy `cortex/pkg/ruler` package dependency into Loki (#5089) ... * Fork cortex `ruler/rulestore/local`. * Fork cortex ruler into Loki as package `ruler/base`. * Use forked cortex ruler instead of vendored. * Update `vendor/modules.txt` and Makefile instruction. * Merge `pkg/ruler/base/rulestore` with `pkg/ruler/rulestore`. * Move `pkg/ruler/base/rulespb` to `pkg/ruler/rulespb`. * Rename `cortex_ruler` usage to `base_ruler`. * Fix lint issues. * Add forked ruler tests. * Use own `pkg/storage/bucket` instead of Cortex one. * Swap to `pkg/storage/chunk/{aws,gcp,etc}`. * Update with correct prometheus import. * Change error comparison. * Code style changes	3 years ago
Christian Haudum	52fa2114df	fluentd: Fix bug that caused lines to be dropped when containing non utf-8 characters (#5107) ... * fluentd: Remove non utf-8 characters from log lines When a log line in hash format contains non UTF-8 characters fluentd would drop the complete line because it failed to convert the line in key-value format. By forcing UTF-8 encoding and replacing non UTF-8 characters with empty strings the log line will not be dropped but only contain the valid UTF-8 characters. Fixes #5099 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Bump fluent-plugin-grafana-loki to version 1.2.17 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fluentd: Remove non utf-8 characters from log lines Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fluentd: Remove non utf-8 characters from log lines Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Dylan Guedes	0cdb66013b	Copy `cortex/pkg/storegateway` package dependency into Loki (#5088) ... * Fork Cortex `pkg/storegateway` into Loki. * Update forked `pkg/storegateway` imports. Modify it to use Loki's `spanlogger` instead of Cortex implementation. * Include `thanos-io` in the list of protos to include. * Remove `bucket_store_inmemory_server.go` as its content isn't used. * Update `go.mod` with new explicit dependency.	3 years ago
Christian Haudum	6b277cd9de	Make `go test` command replaceable in Makefile (#4934) ... There are multiple drop-in replacements for the `go test` command, such as [gotest](https://github.com/rakyll/gotest) or [gotestsum](https://github.com/gotestyourself/gotestsum). Setting the `GOTEST` environment variable allows for replacing the `go test` command in the `test` make target to use the specified test runner. Usage: ```bash GOTEST=gotest make test ``` Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Karsten Jeschkies	190c3a4b92	Lint Loki and Promtail mixins. (#4848) ... * Lint Loki and Promtail mixins. Summary: - Check whether Jsonnet files have been formatted. - Run mixtool on mixins. Closes #4841 * Format Jsonnet files. * Define uids for dashboards. * Exclude `vednor` from lintin. * Reference Docker image.	4 years ago
Marco Pracucci	2b0d020146	Refactor pkg/util/server to avoid cortexpb import in downstream projects vendoring logql (#4833) ... Signed-off-by: Marco Pracucci <marco@pracucci.com>	4 years ago
Sashank Agarwal	8d7b66fe10	Add storage size calculator (#95) ... * add storage size calculator * updated go.sum * updated size calculator manifest * updated storage size calculator * updated storage size calculator	4 years ago
Ed Welch	fbebf67588	Loki: check new Read target when initializing boltdb-shipper store (#4681) ... * make sure to check for new `Read` target when setting up boltdb-shipper * also need to make sure ingester querier is added as a dep for Read target * improve the comment on why we shorten the cache validity. * fix shellcheck errors * apply smart defaults to chunk retain period to avoid query gaps. * typo	4 years ago
Ed Welch	4e2812b9f3	no longer publish `latest` tag on every push to main (#4651) ... publish `latest` tag when building tagged release	4 years ago
Ed Welch	2ac409c23e	Build: simplify how protos are built (#4639) ... * we always seem to be chasing our tails with how protos are generated and Makes use of timestamps to determine if files should be recompiled. Instead of touching files and altering timestamps always delete the compiled proto files when calling `protos` to make sure they are compiled every time. Removed targets to build protos, yaccs, and ragel files when trying to build loki or the canary. This isn't necesary, if you are changing these files you would know you need to build them and the `check-generated-files` should catch any changes to them not committed. * rm -rf * we have a race between check-generated-files and our other steps, so let that run first. also removing `check-generated-files` from the `all` target because its redundant with a separate step and could also race with the parallel lint * remove TOUCH_PROTOS * more cleanup of TOUCH_PROTOS	4 years ago
Callum Styan	ea78cde659	Add drone build job for lambda-promtail images. (#4480) ... * Add drone build job for lambda-promtail images. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix image tag portion of drone job for lambda-promtail build Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address some review feedback. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Regenerate drone yaml file after some changes. Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Callum Styan	5f3e9a1943	Update loki-build-image to drone 1.4.0 (#4462) ... * Update loki-build-image to drone 1.4.0 Signed-off-by: Callum Styan <callumstyan@gmail.com> * update build image go versions plus fix install of drone-cli Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update build image version used in makefile Signed-off-by: Callum Styan <callumstyan@gmail.com> * update drone yaml built via new build image (updated drone cli version) Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
JordanRushing	4c5b084525	Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) ... * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Periklis Tsirakidis	7d54b3aca3	Remove vendor dir (#81)	4 years ago
Mathew Fleisch	895165f770	Add darwin/arm64 build to release binaries in Makefile (#4189)	4 years ago
Karsten Jeschkies	fbfc8abdab	Instruct how to sign `drone.yml`. (#4373)	4 years ago
Danny Kopping	d5b6d05557	CI: Fixing linter deprecations (#4353) ... * Fixing CI deprecations Replacing deprecated golint with revive (https://github.com/golangci/golangci-lint/pull/1965) Removing interfacer (https://github.com/golangci/golangci-lint/pull/1755) Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Further suggestions from Marco in https://github.com/grafana/loki/issues/1002 Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Clarify instruction Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Arve Knudsen	034e2a63cf	Makefile: Add format target (#4226) ... Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 years ago
Periklis Tsirakidis	626f7da151	Bump operator-sdk v1.11.0 and ctrl-runtime 0.9.2 (#73)	4 years ago
Ed Welch	1a970c54ac	fix build info which was not updated after build package changed (#4135)	4 years ago
Cyril Tovena	32e55c3043	Fork cortex chunk storage into Loki. (#3842) ... The chunk package has been forked from this commit for future reference and licensing. 09fe17c0e6	4 years ago
Julien Duchesne	acf1866706	Sign drone.yml file (#3950) ... * Sign drone.yml file This is needed to set the repository as "Protected" * Add shellcheck back	4 years ago
Karsten Jeschkies	0cde54c4dc	Lint script files. (#3944) ... * Lint script files. This patch adds a Drone CI step that runs shellcheck on all Bash script files. * Install Bash in shellcheck container. * Fix a few shelcheck errors. * Fix build.sh * Fix remaining shellcheck errors.	4 years ago
ecraven	1fb06cc64f	Makefile: Only set PROMTAIL_CGO if CGO_ENABLED is not 0. (#3935) ... * Only set PROMTAIL_CGO if CGO_ENABLED is not 0. This allows to build promtail without journald support on linux distributions that don't have systemd. Run as CGO_ENABLED=0 make promtail * Fix scope.	4 years ago
Sashank Agarwal	4e801e332d	removed manual apply and delete of servicemonitor resource (#62)	4 years ago
Gerard Vanloo	48d0cf67fe	Log 1403: OCP Certificate Signing (#59) ... * Adding service annotations to all loki services * Adding secret creation script; Adding OCP flag * Applying fixes based on review commits * Adding run flags for deploy * Moving service manager creation methods to new file * Adding in go run command argumentes * First attempt at adding the secret volume mount * Fixing deploy and adding bundle configurations for openshift * Initial clean up and review fixes * Code style changes * Moving configurations; build can return configuration error * Removing global variables * Code clean up * Adding service monitor build test case * Review changes * Code updates * Code change * Code change	4 years ago
Cyril Tovena	59bb6d3fba	LogQL: Pattern Parser (#3837) ... * The beginning of a fun story. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Working on adding ragel. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adding AST parsing with Yacc and Ragel. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Got a pattern parser working. Reworking ast to works with bytes and not runes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Setup tests and the matches algorithm. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * moar tests case. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add some validation for the pattern expression. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Hooking to LogQL + performance boost. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve bound check. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Removes generated files from being linted. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/logql/_index.md Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Update docs/sources/logql/_index.md Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Review feedback Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/logql/_index.md Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Update docs/sources/logql/_index.md Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Docs suggestions Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Sashank Agarwal	32734d284e	added service monitor for ocp prometheus to scrape metrics (#58)	4 years ago
Cyril Tovena	d9380eaac9	Add a target to find dead link in our documentation. (#3713) ... This is not part of the CI because it can be throttle and it's not super fast ~2min. But still usefull to check that no link are down if we make some big structure changes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Brett Jones	2a0d510d3b	LOG-1289: set pvc quotas per size (#51)	4 years ago
Julien Duchesne	bbb82b5781	Deploy loki with Drone plugin instead of CircleCI job (#3708) ... We are deprecating the CircleCI job Also, I moved secrets to Vault instead of Drone repository secrets Note that this will require Flux in all environments that are updated Issue: grafana/deployment_tools#5307	4 years ago
Gerard Vanloo	c0ba42ed34	Log 1318: Adding scorecard ci test (#46)	4 years ago
Periklis Tsirakidis	c5fab0a33b	Add owner watches for LokiStack owned resources (#42)	4 years ago
Brett Jones	65a8268f5f	LOG-1247: add node selectors support (#39)	4 years ago
Brett Jones	e16a365c66	implement t-shirt sizes (#28)	4 years ago
Ed Welch	6e67d1ea5d	Loki/Promtail: Client Refactor (#3623) ... * move docker driver * move fluent-bit output plugin * move fluentd plugin * move logstash plugin * move promtail * match stage uses simple logql label matcher and filter expressions only * remove remaining logql imports * remove helpers package and move contents to util package * move validation and runtime out of util package * fix imports * move build and cfg packages into util * move ParseRequest function to util package * create a new package for logql models and move marshal/unmarshal code to util folder * move ErrorLabel to logqlmodel * move stats package to logqlmodel * decouple loghttp from logql by moving validation to logql package * move gcplog to tools * move PackedEntryKey constant to logqlmodel * fix stats proto import and rebuild protos * fix windows promtail tests * update drone to new dockerfile locations	4 years ago
Periklis Tsirakidis	7877c8a955	Split default target into development and production overlays (#24)	4 years ago
Periklis Tsirakidis	c5700e59a8	Remove legacy manifests generation (#23)	4 years ago
Brett Jones	f975a5dd2f	Add the scaffolding for tshirt sizing (#21)	4 years ago
Periklis Tsirakidis	ecf4e92ef6	Add support to install the operator via OLM in OCP clusters (#17) ... Co-authored-by: Periklis Tsirakidis <periklis@redhat.com>	4 years ago
Cyril Tovena	a76a17877b	Add a target to reproduce fuzz testcase (#3553) ... * Add a make target to facilitate fuzz testing locally. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * missing target.... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Periklis Tsirakidis	b31c3316fe	Add operator-sdk to bingo targets (#14) ... Co-authored-by: Periklis Tsirakidis <periklis@redhat.com>	4 years ago
Brett Jones	11f699c5a6	add bingo (#12)	4 years ago
Brett Jones	bc7f7b5cef	make lint a non-requirement for specific make targets (#10)	4 years ago
Brett Jones	79c45880cd	CI: add build targets for broker and operator (#9)	4 years ago
Brett Jones	de72235035	LOG-1241: create cli for generating manifests (#8) ... * LOG-1241: create cli for generating manifests * add makefile entry, fix lint	4 years ago
Brett Jones	e65bc69e96	better ci and fix make (#7) ... * linting, cleaning up * CI: update golangci-lint version, remove go test -v flag * linting, add gofumpt and golangci-lint to makefile	4 years ago
Brett Jones	f23aa6512a	add some tests	4 years ago
Brett Jones	3a80bdcddd	cleanup	4 years ago
Brett Jones	d4a5e60445	fix rbac generation, etc	4 years ago