267 Commits (6f8b6e1d330ffeba67d3c0a060ca9d1d87b602cd)

Author	SHA1	Message	Date
Kaviraj Kanagaraj	a6bbe8a298	chore(makefile): Remove `NETGO` check after building loki binaries. (#6856) ... Encountered after upgrade to go1.19 in local breaks this assumption. Meaning, even if your loki binary built with `-tags netgo` that file `cgo_stub.go` doesn't exist in the binary. And any make <binary> keep failing. ``` \nYour go standard library was built without the 'netgo' build tag. To fix that, run sudo go clean -i net sudo go install -tags netgo std make: *** [Makefile:149: cmd/loki/loki] Error 1 ``` But even those commands not helping. Looks like this check was added by Tom at 2018. tbh, checking for filename inside the binary is too much internal details that is subjected to change (which is what happened here I think). NOTE: Had some internal discussions and confirmed that we don't need this check in recent Go versions anymore. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Julien Duchesne	7b70d3d939	deb and rpm packaging for all binaries (#6456) ... * deb and rpm packaging for all binaries There is currently deb and rpm packages being published for logcli amd64 but they aren't signed In this PR: - Add RPM and deb packages for `logcli`, `loki-canary` `loki` and `promtail` for arm, arm64 and amd64 - Sign them with the Grafana GPG key (packages.grafana.com/gpg.key). This will be the same key for all Grafana products - Add CI steps to test the RPM and deb packages. This launches a docker image with systemd installed, then it installs both loki and promtail and does a `logcli` query on the Loki instance * Remove specific version in test scripts * Bump build image to 0.22.0 * Add restart policy for promtail's service	3 years ago
Kaviraj Kanagaraj	0d99d80acd	upgrade `go:1.17.9` to `go:1.18.4` (#6726)	3 years ago
Periklis Tsirakidis	ebac1f1618	operator: Use docker build context for root make targets (#6601)	3 years ago
Shweta Padubidri	1c8ebaff61	operator: Build and publish images for docker hub (#6086)	3 years ago
Salva Corts	7314d95a91	Support dashboards for SSD mode (#6540) ... * Support dashboards for SSD mode * Fix issues * Add compiled mixins * Flip $.config.ssd on if conditions * Use prefix matcher for ssd * Add compiled SSD mixin * Update loki-mixin-check to check ssd compiled mixin * Checkout compiled ssd mixin	3 years ago
Julien Duchesne	6a9557a1e0	Add Drone pipeline to test packaging (#6482) ... * Add Drone pipeline to test packaging Currently, the packaging process only happens on tags, which could lead to surprises Especially considering I'm working on deb and RPM packaging (lots more steps than now) I also moved the publishing from Circle to Drone because: 1. I'll need some new secrets from Vault 2. It should be faster * Fix make target * Remove `-parallel` arg for `gox`	3 years ago
Marco Pracucci	afa53f1939	Loki mixin: publish compiled version of the mixin (#6254) ... * Publish compiled mixin Signed-off-by: Marco Pracucci <marco@pracucci.com> * Update Makefile Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> * Updated build image version Signed-off-by: Marco Pracucci <marco@pracucci.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com>	3 years ago
Travis Patterson	d97724e8dd	Introduce coverage to PR pipelines (#5357) ... * Add code coverage diff to CI * remove test package from coverage diff * review feedback * lint * Env variable test * faster experiment * drone vars * drone vars * how does the shell work? * add pr comment * escape json * report diff in comment * properly format json * quote post body * review feedback * add querier/queryrange to coverage	3 years ago
Christian Simon	6c1a62d829	Ensure proto definitions are formatted [2/2] (#6000) ... * Update build image to 0.10.4 * Add a fmt target for proto defintions This uses buf to ensure the proto defintions are more consistently formatted. * Update formatted files	3 years ago
Christian Haudum	b6ce3826b4	Use new build image 0.20.3 (#5904)	3 years ago
Christian Haudum	b3bc8d3063	Other: Improve check-drone-drift script (#5925) ... * Improve check-drone-drift script Instead of checking the line count of the current branch an main, run `make drone` and check if there are changes to the target `.drone/drone.yml` file. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Generate .drone/drone.yml using `make drone` Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Generate .drone/drone.yml using `make drone` Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Christian Simon	a6bec98b20	Raise version of build image correctly (#5900) ... Was using the makefile first. Now read the docs again: https://github.com/grafana/loki/blob/main/docs/sources/maintaining/release-loki-build-image.md	3 years ago
Christian Simon	9d0fd3a7e3	Upgrade golang version to v1.17.9 (#5899) ... ``` git ls-files '*[Dd]ockerfile*' | grep -v ^vendor/ | xargs sed -i "s/golang:[0-9\\.]*/golang:1.17.9/g" | ag 'golang:' ```	3 years ago
Bryan Boreham	46b552def2	Makefile: run lint and tests with default garbage-collection (#5841) ... Setting GOGC=10 makes Go run garbage-collection every time the heap gets 10% bigger than it was before, which does keep the max size down but slows down memory-intensive operations. Since this was added for CircleCI, and we don't run those operations on CircleCI any more, remove the setting.	3 years ago
Trevor Whitney	7b214e2ea6	fix missing file during rpm and deb packaging step (#5818)	3 years ago
Ed Welch	f313a9ff4f	Build: update package for fuzzer after refactoring (#5776) ... * Update the package name to reflect the moved package after refactoring Signed-off-by: Ed Welch <edward.welch@grafana.com> * also include makefile Signed-off-by: Ed Welch <edward.welch@grafana.com>	3 years ago
Susana Ferreira	d4dd4eda4a	Update docker repo to grafana/loki-query-tee (#5716) ... * Update docker repo to grafana/loki-querytee * Sign drone.yml file * Update makefile - update target to generate query-tee image with correct name - update error message on drone target * Update Makefile drone target error message Co-authored-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Cyril Tovena	c8bdb37ef3	update loki go version to 1.17.8 (#5543) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	3 years ago
Ed Welch	4db3e59a7d	Build: simplify make targets to just run every time (#5411) ... * run the make targets regardless of file timestamps and changes, just run them every time. Signed-off-by: Edward Welch <edward.welch@grafana.com> * attempt #2 Signed-off-by: Edward Welch <edward.welch@grafana.com> * don't need GO_FILES anymore Signed-off-by: Edward Welch <edward.welch@grafana.com> * remove all the mod=vendor flags required as we transitioned through go versions 13/14/15 Signed-off-by: Edward Welch <edward.welch@grafana.com> * changing drone deps because check-generated-files removes protos and I guess this all happens in the same place at the same time in drone. Signed-off-by: Edward Welch <edward.welch@grafana.com> * fix rebase Signed-off-by: Edward Welch <edward.welch@grafana.com>	3 years ago
Danny Kopping	00bd6cc1a2	Run `make drone` to use the new build image (#5368) ... Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago
Karsten Jeschkies	ec1ae42083	Verify that drone.yml was updated. (#5396)	3 years ago
Kaviraj Kanagaraj	531905c066	Remove `cortex` references from `go.mod` and makefile (#5269) ... * Remove cortex references from `go.mod` and makefile Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove from `modules.txt` Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Travis Patterson	8646436b18	Fix docker plugin build (#5240) ... - Rebuild the rootfs before each plugin build	3 years ago
Michel Hollands	a3fcd3cc75	Update Go version to latest and bump build image version (#5250) ... Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	3 years ago
Karsten Jeschkies	b03e2783d6	Package logcli as rpm and deb. (#4667) ... * Package logcli as rpm, deb and apk. * Package logcli on release builds.	3 years ago
Dylan Guedes	0e3df1938f	Copy querier subpackages dependency into Loki (#5068) ... * Fork cortex `querier/series`. * Fork cortex `querier/chunkstore`. * Fork cortex `querier/lazyquery`. * Use Loki forked cortex code. * Copy cortex `querier/queryrange` as `querier/queryrange/queryrangebase`. * Fork cortex `pkg/querier/queryrange` to `pkg/querier/queryrange/queryrangebase`. * Tell protoc to use gogo.types instead of pb.Any. * Use `pkg/querier/queryrange/queryrangebase`. * Remove cortex `queryrange` vendoring. * Fix lint. * Use `_ = ...` syntax instead of comment to fix lint.	3 years ago
Dylan Guedes	3d7e9cee36	Copy `cortex/pkg/ruler` package dependency into Loki (#5089) ... * Fork cortex `ruler/rulestore/local`. * Fork cortex ruler into Loki as package `ruler/base`. * Use forked cortex ruler instead of vendored. * Update `vendor/modules.txt` and Makefile instruction. * Merge `pkg/ruler/base/rulestore` with `pkg/ruler/rulestore`. * Move `pkg/ruler/base/rulespb` to `pkg/ruler/rulespb`. * Rename `cortex_ruler` usage to `base_ruler`. * Fix lint issues. * Add forked ruler tests. * Use own `pkg/storage/bucket` instead of Cortex one. * Swap to `pkg/storage/chunk/{aws,gcp,etc}`. * Update with correct prometheus import. * Change error comparison. * Code style changes	3 years ago
Christian Haudum	52fa2114df	fluentd: Fix bug that caused lines to be dropped when containing non utf-8 characters (#5107) ... * fluentd: Remove non utf-8 characters from log lines When a log line in hash format contains non UTF-8 characters fluentd would drop the complete line because it failed to convert the line in key-value format. By forcing UTF-8 encoding and replacing non UTF-8 characters with empty strings the log line will not be dropped but only contain the valid UTF-8 characters. Fixes #5099 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Bump fluent-plugin-grafana-loki to version 1.2.17 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fluentd: Remove non utf-8 characters from log lines Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fluentd: Remove non utf-8 characters from log lines Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Dylan Guedes	0cdb66013b	Copy `cortex/pkg/storegateway` package dependency into Loki (#5088) ... * Fork Cortex `pkg/storegateway` into Loki. * Update forked `pkg/storegateway` imports. Modify it to use Loki's `spanlogger` instead of Cortex implementation. * Include `thanos-io` in the list of protos to include. * Remove `bucket_store_inmemory_server.go` as its content isn't used. * Update `go.mod` with new explicit dependency.	3 years ago
Christian Haudum	6b277cd9de	Make `go test` command replaceable in Makefile (#4934) ... There are multiple drop-in replacements for the `go test` command, such as [gotest](https://github.com/rakyll/gotest) or [gotestsum](https://github.com/gotestyourself/gotestsum). Setting the `GOTEST` environment variable allows for replacing the `go test` command in the `test` make target to use the specified test runner. Usage: ```bash GOTEST=gotest make test ``` Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Karsten Jeschkies	190c3a4b92	Lint Loki and Promtail mixins. (#4848) ... * Lint Loki and Promtail mixins. Summary: - Check whether Jsonnet files have been formatted. - Run mixtool on mixins. Closes #4841 * Format Jsonnet files. * Define uids for dashboards. * Exclude `vednor` from lintin. * Reference Docker image.	4 years ago
Marco Pracucci	2b0d020146	Refactor pkg/util/server to avoid cortexpb import in downstream projects vendoring logql (#4833) ... Signed-off-by: Marco Pracucci <marco@pracucci.com>	4 years ago
Sashank Agarwal	8d7b66fe10	Add storage size calculator (#95) ... * add storage size calculator * updated go.sum * updated size calculator manifest * updated storage size calculator * updated storage size calculator	4 years ago
Ed Welch	fbebf67588	Loki: check new Read target when initializing boltdb-shipper store (#4681) ... * make sure to check for new `Read` target when setting up boltdb-shipper * also need to make sure ingester querier is added as a dep for Read target * improve the comment on why we shorten the cache validity. * fix shellcheck errors * apply smart defaults to chunk retain period to avoid query gaps. * typo	4 years ago
Ed Welch	4e2812b9f3	no longer publish `latest` tag on every push to main (#4651) ... publish `latest` tag when building tagged release	4 years ago
Ed Welch	2ac409c23e	Build: simplify how protos are built (#4639) ... * we always seem to be chasing our tails with how protos are generated and Makes use of timestamps to determine if files should be recompiled. Instead of touching files and altering timestamps always delete the compiled proto files when calling `protos` to make sure they are compiled every time. Removed targets to build protos, yaccs, and ragel files when trying to build loki or the canary. This isn't necesary, if you are changing these files you would know you need to build them and the `check-generated-files` should catch any changes to them not committed. * rm -rf * we have a race between check-generated-files and our other steps, so let that run first. also removing `check-generated-files` from the `all` target because its redundant with a separate step and could also race with the parallel lint * remove TOUCH_PROTOS * more cleanup of TOUCH_PROTOS	4 years ago
Callum Styan	ea78cde659	Add drone build job for lambda-promtail images. (#4480) ... * Add drone build job for lambda-promtail images. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix image tag portion of drone job for lambda-promtail build Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address some review feedback. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Regenerate drone yaml file after some changes. Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Callum Styan	5f3e9a1943	Update loki-build-image to drone 1.4.0 (#4462) ... * Update loki-build-image to drone 1.4.0 Signed-off-by: Callum Styan <callumstyan@gmail.com> * update build image go versions plus fix install of drone-cli Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update build image version used in makefile Signed-off-by: Callum Styan <callumstyan@gmail.com> * update drone yaml built via new build image (updated drone cli version) Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
JordanRushing	4c5b084525	Add DroneCI pipeline stage to validate loki example configs; create example configuration files (#4358) ... * Add DroneCI pipeline stage to validate loki example configs; create example configuration files * Actually run loki in the validate-example-configurations pipeline stage * Change method for running loki binary * Add step dependency for config validation pipeline stage * Actually loop over example configs and verify them! * Push bad config to test failing builds * Create remaining example configs * Fix provided example loki configs * Use make target to validate example configs * Add make target to generate a new example configuration doc; add make target for CI to verify doc is re-generated upon changes to example configs * Update CI to check the generated example config doc * Clean up Makefile * Mark new example config validation make targets as phony; fix conditional for config example doc checking * Fix conditional * Remove redundant step in generate-example-config-doc phony make target * Add a correction to PR 4358 * Improve grammar and add newlines in example configuration descriptions Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Regenerate examples.md Co-authored-by: Karen Miller <karen.miller@grafana.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Periklis Tsirakidis	7d54b3aca3	Remove vendor dir (#81)	4 years ago
Mathew Fleisch	895165f770	Add darwin/arm64 build to release binaries in Makefile (#4189)	4 years ago
Karsten Jeschkies	fbfc8abdab	Instruct how to sign `drone.yml`. (#4373)	4 years ago
Danny Kopping	d5b6d05557	CI: Fixing linter deprecations (#4353) ... * Fixing CI deprecations Replacing deprecated golint with revive (https://github.com/golangci/golangci-lint/pull/1965) Removing interfacer (https://github.com/golangci/golangci-lint/pull/1755) Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Further suggestions from Marco in https://github.com/grafana/loki/issues/1002 Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Clarify instruction Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Arve Knudsen	034e2a63cf	Makefile: Add format target (#4226) ... Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 years ago
Periklis Tsirakidis	626f7da151	Bump operator-sdk v1.11.0 and ctrl-runtime 0.9.2 (#73)	4 years ago
Ed Welch	1a970c54ac	fix build info which was not updated after build package changed (#4135)	4 years ago
Cyril Tovena	32e55c3043	Fork cortex chunk storage into Loki. (#3842) ... The chunk package has been forked from this commit for future reference and licensing. 09fe17c0e6	4 years ago
Julien Duchesne	acf1866706	Sign drone.yml file (#3950) ... * Sign drone.yml file This is needed to set the repository as "Protected" * Add shellcheck back	4 years ago
Karsten Jeschkies	0cde54c4dc	Lint script files. (#3944) ... * Lint script files. This patch adds a Drone CI step that runs shellcheck on all Bash script files. * Install Bash in shellcheck container. * Fix a few shelcheck errors. * Fix build.sh * Fix remaining shellcheck errors.	4 years ago