199 Commits (065bee7e72b00d800431f4b70f0d673d6e0e7a2b)

Author	SHA1	Message	Date
Michel Hollands	a70d092df6	Add help target to Makefile (#9531) ... **What this PR does / why we need it**: Add a help target to the Makefile. Only the main targets were added. ``` % make help Usage: make <target> Targets: help Display this help and any documented user-facing targets. Other undocumented targets may be present in the Makefile. all build all executables (loki, logcli, promtail, loki-canary) logcli build logcli executable logcli-debug build debug logcli executable logcli-image build logcli docker image loki build loki executable loki-debug build loki debug executable loki-canary build loki-canary executable helm-test run helm tests helm-lint run helm linter loki-querytee build loki-querytee executable promtail build promtail executable promtail-debug build debug promtail executable loki-mixin compile the loki mixin loki-mixin-check check the loki mixin is up to date lint run linters test run the unit tests clean clean the generated files docker-driver build the docker-driver executable fluent-bit-plugin build the fluent-bit plugin fluent-bit-image build the fluent-bit plugin docker image fluent-bit-push push the fluent-bit plugin docker image fluentd-plugin build the fluentd plugin fluentd-plugin-push push the fluentd plugin fluentd-image build the fluentd docker image fluentd-image-push push the fluentd docker image logstash-image build the logstash image logstash-push push the logstash image promtail-image build the promtail docker image promtail-debug-image build the promtail debug docker image loki-image build the loki docker image loki-debug-image build the debug loki docker image loki-canary-image build the loki canary docker image helm-test-image build the helm test image helm-test-push push the helm test image logql-analyzer-image build the LogQL Analyzer image logql-analyzer-push push the LogQL Analyzer image build-image build the docker build image build-image-push push the docker build image doc Generates the config file documentation check-doc Check the documentation files are up to date ``` **Checklist** - [X] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` - [ ] For Helm chart changes bump the Helm chart version in `production/helm/loki/Chart.yaml` and update `production/helm/loki/CHANGELOG.md` and `production/helm/loki/README.md`. [Example PR](d10549e3ec) Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	2 years ago
Danny Kopping	9495b6cc56	Update loki-build-image with go1.20.4 (#9372) ... Continuation of #9370 Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	2 years ago
Trevor Whitney	1283c42a80	Bring back centralized docs toolkit (undo revert in #9146) (#9147) ... **What this PR does / why we need it**: This reverts the revert in https://github.com/grafana/loki/pull/9146 with a slightly less "nuclear" solution. I think the problem was that CI was pulling `docs.mk` from `main`, and it was creating a diff between the version we had checked in. I changed `docs.mk` to point to a specific sha, which should prevent this in the future. I also opened a [PR](https://github.com/grafana/writers-toolkit/pull/228) against the writers-toolkit.	2 years ago
Kaviraj Kanagaraj	f42942768e	Makefile: Support debug build for `logcli`. (#9093) ... **What this PR does / why we need it**: Support debug build for `logcli` binary. This writes debug binary under `logcli-debug` name in the same `cmd/logcli` directory. Already faced situation multiple times this is useful to debug some issues with LogQL locally. **Which issue(s) this PR fixes**: Fixes NA **Special notes for your reviewer**: **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	2 years ago
JordanRushing	7edda371ea	Add journald support to Promtail amd64 binary builds (#9095) ... **What this PR does / why we need it**: Previously, in https://github.com/grafana/loki/pull/8131, we enabled journald support for Promtail arm/arm64 binary builds but not amd64. **Which issue(s) this PR fixes**: - https://github.com/grafana/loki/issues/9060 **Special notes for your reviewer**: N/A **Checklist** - [x] Reviewed the [`CONTRIBUTING.md`](https://github.com/grafana/loki/blob/main/CONTRIBUTING.md) guide (**required**) - [ ] Documentation added - [ ] Tests updated - [ ] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` --------- Signed-off-by: JordanRushing <rushing.jordan@gmail.com> Co-authored-by: Trevor Whitney <trevorjwhitney@gmail.com>	2 years ago
Karsten Jeschkies	ea8376d0cd	Check that code has been formatted. (#9012)	2 years ago
Christian Haudum	b502ee23ad	Remove ./tools/fetch-tags invocation from Makefile (#8854) ... **What this PR does / why we need it**: This invocation causes problems when make targets are executed in the build image container (`BUILD_IN_CONTAINER=true`), e.g. the `yacc` target, because git tries to fetch tags from `origin` using ssh, causing error message like these: ``` Host key verification failed. fatal: Could not read from remote repository. Please make sure you have the correct access rights and the repository exists. error: Could not fetch origin ``` This is because local ssh keys are not mounted into the build container. In order not to break CI builds (https://github.com/grafana/loki/pull/8232) we need to manually fetch the tags as the first step in release pipelines. This is added to the Drone configuration. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Trevor Whitney	a4d06acca7	Add yaml linting step to helm ci (#8822) ... **What this PR does / why we need it**: Adds a yaml linting step for the included rules in the loki helm chart. Only way I could think to enforce the comma line ending was to require qutoes around string, otherwise the linter cannot tell if the comma is just part of the string.	2 years ago
Michel Hollands	4f8d3240f6	Use 0.28.1 build image and update go and alpine versions (#8583) ... **What this PR does / why we need it**: - Use the 0.28.1 build image - Update Go version to 1.20.1 - Use Alpine 3.16.4 - Fix linter issues due to updated govet in 1.20.1 - Modify images to not create `/etc/nsswitch.conf` file anymore (available by default on Alpine 3.16.4) - Remove impossible test cases for `TestMemChunk_IteratorBounds`(see https://github.com/grafana/loki/pull/8591#discussion_r1115020111 for context) Signed-off-by: Michel Hollands <michel.hollands@grafana.com> Signed-off-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com> Co-authored-by: DylanGuedes <djmgguedes@gmail.com>	2 years ago
brettlounsbury	4c227bd268	DynamoDB: Accept a KMS key for DynamoDB tables (#8469) ... Co-authored-by: Travis Patterson <travis.patterson@grafana.com>	2 years ago
Christian Haudum	1728d09cba	Use Loki build image 0.27.1 in CI (#8279) ... Second part of updating the Loki build image Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 years ago
Taehyun Hwang	b2ea1214fc	Loki: Fix version info issue that shows wrong version (#7669, #8055) (#8232)	2 years ago
Travis Patterson	4b9cc39f9f	fix remaining docs issues (#8263)	2 years ago
Trevor Whitney	71846b0430	[helm] add local k3d loki cluster (#8218)	2 years ago
Karsten Jeschkies	17fdfcbaa1	Emit help message when check-mod fails (#8157)	2 years ago
Karsten Jeschkies	4504ed2701	Cross build Promtail for ARM with journald support. (#8131) ... This is the follow up to #8111 and adds journald support for Promatil ARM and ARM64 builds. I've tested it locally with my Raspberry Pi and it works. Fixes #1459	2 years ago
Travis Patterson	9322ed0a68	Change delimiter in test "sed" command to ':' (#8108) ... The current delimiter is `/` which breaks when a branch name contains that character. `:` is disallowed in branch names so should serve as a suitable delimiter This is the same as https://github.com/grafana/loki/pull/8107 but the branch name doesn't include a `/`. That shouldn't be an issue after this is merged	2 years ago
Michel Hollands	fcf198e701	Add drone env vars to test output to distinguish the 2 unit test runs. (#8093) ... **What this PR does / why we need it**: Add the drone step name and branch to the test output. These are used to distinguish between the two unit tests runs in a drone build. One unit test run is for the current branch, the other is for the branch to be merged to. This change helps in not reporting the unit tests results twice. There is also a fix for the TestPromtail test. The missing newline made the test reporting fail. Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	2 years ago
Michel Hollands	785fc2a62c	Add docker-driver pipeline (#8083) ... Copy the docker-driver pipeline from CirclCI to drone. Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	2 years ago
Michel Hollands	ce281e8ab1	Update build image and use in drone yaml (#8029) ... **What this PR does / why we need it**: Update the build image version to 0.26. Use this in drone.yaml. **Special notes for your reviewer**: This uses the new test setup from https://github.com/grafana/loki/pull/8022 Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	2 years ago
Susana Ferreira	86d33a4e4a	Add CI step to check generated documentation to check pipeline (#7938) ... **What this PR does / why we need it**: Follow up from PR: https://github.com/grafana/loki/pull/7916 to add a CI step to check if the configuration flag documentation file `doc/sources/configuration/_index.md` was generated successfully. Requirements: * CI `check` pipeline should fail if the documentation file is updated manually * CI `check` pipeline should fail if registration flags are changed in the code, but the documentation file is not generated. **Which issue(s) this PR fixes**: Fixes https://github.com/grafana/loki-private/issues/83 **Special notes for your reviewer**: **Checklist** - [ ] Reviewed the `CONTRIBUTING.md` guide - [ ] Documentation added - [ ] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md`	2 years ago
Robert Fratto	85392a9728	Update Prometheus dependency to latest release (v2.40.4) (#7826) ... Closes #7811, which is needed for Grafana Agent to update to v2.40 and add support for native histograms. I did not add support for native histograms to Loki, sorry :)	2 years ago
Robert Fratto	bd58352439	Update build image references to 0.25.0 (#7848) ... cc @slim-bean	2 years ago
Danny Kopping	6c8d04fe78	Completing step 2 of updating loki-build-image (#7796)	3 years ago
Christian Haudum	e04fb0073b	Add make target for building and pushing the fluentd plugin ... The fluentd plugin can now easily be published using the `make fluentd-plugin-push` make target. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Irina	bdb0aa0bf4	Promtail: Add go build tag promtail_journal_enabled (#7587) ... **What this PR does / why we need it**: This PR introduces the new go build tag `promtail_journal_enabled`. This tag is passed to go build if the environment variable `PROMTAIL_JOURNAL_ENABLED=true` is present. It is useful for users with Linux OS and CGO enabled. Currently, if the user has Linux and CGO enabled he has to install `libsystemd-dev` library (`sudo apt install -y libsystemd-dev`) even when he doesn't need journald support.	3 years ago
Furkan Türkal	28d6a97991	fluent-bit: clarify docs, use 1.9.9 (#6464) ... **What this PR does / why we need it**: * Pins digests for security enhancements * Pass `-ldflags` using `--build-args` * Use fluent-bit image `1.9.9` * Use golang image `1.19.2` * Clarify fluent-bit readme Signed-off-by: Furkan <furkan.turkal@trendyol.com> Co-authored-by: Michel Hollands <42814411+MichelHollands@users.noreply.github.com>	3 years ago
Karsten Jeschkies	b16ad8cb38	Document new Helm Charts (#7034) ... **What this PR does / why we need it**: This change describes various Helm related tasks such as installing Loki and configuring meta monitoring. It also explains different concepts related to the new Helm chart and provides a reference of the new Helm values file. **Which issue(s) this PR fixes**: Fixes #7035	3 years ago
Trevor Whitney	6c53113be1	[helm] Add a loki canary test to the helm chart (#7229) ... **What this PR does / why we need it**: Add a helm chart test that utilizes the Loki canary to confirm the Loki cluster is functioning correctly. **Which issue(s) this PR fixes**: Fixes #7228 Co-authored-by: Karsten Jeschkies <k@jeschkies.xyz>	3 years ago
Danny Kopping	355175ff89	Upgrade to Go 1.19 (#7243) ... Upgrade Loki and all related components to Go 1.19.2.	3 years ago
Vladyslav Diachenko	615941234a	Logql Analyzer (#6171) ... * created logql-debugger page and API endpoint that returns information for each stage of the query * added docker-compose setup for local testing * refactored analyzer and added unit tests * removed docs page to release it in a separate PR when back-end API is published * changes structure of results object in response to return origin log line needed for case when only stream selector is sent in query * merged the latest main and resolved conflicts * added endpoint for readiness probe and configured CI * fixed drone.yml discrepancy * fixed method signature * fixed path to Dockerfile * added clean step	3 years ago
Christian Simon	88f0ad2196	Update build-image to 0.23.0 (#6899)	3 years ago
Kaviraj Kanagaraj	a6bbe8a298	chore(makefile): Remove `NETGO` check after building loki binaries. (#6856) ... Encountered after upgrade to go1.19 in local breaks this assumption. Meaning, even if your loki binary built with `-tags netgo` that file `cgo_stub.go` doesn't exist in the binary. And any make <binary> keep failing. ``` \nYour go standard library was built without the 'netgo' build tag. To fix that, run sudo go clean -i net sudo go install -tags netgo std make: *** [Makefile:149: cmd/loki/loki] Error 1 ``` But even those commands not helping. Looks like this check was added by Tom at 2018. tbh, checking for filename inside the binary is too much internal details that is subjected to change (which is what happened here I think). NOTE: Had some internal discussions and confirmed that we don't need this check in recent Go versions anymore. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com>	3 years ago
Julien Duchesne	7b70d3d939	deb and rpm packaging for all binaries (#6456) ... * deb and rpm packaging for all binaries There is currently deb and rpm packages being published for logcli amd64 but they aren't signed In this PR: - Add RPM and deb packages for `logcli`, `loki-canary` `loki` and `promtail` for arm, arm64 and amd64 - Sign them with the Grafana GPG key (packages.grafana.com/gpg.key). This will be the same key for all Grafana products - Add CI steps to test the RPM and deb packages. This launches a docker image with systemd installed, then it installs both loki and promtail and does a `logcli` query on the Loki instance * Remove specific version in test scripts * Bump build image to 0.22.0 * Add restart policy for promtail's service	3 years ago
Kaviraj Kanagaraj	0d99d80acd	upgrade `go:1.17.9` to `go:1.18.4` (#6726)	3 years ago
Periklis Tsirakidis	ebac1f1618	operator: Use docker build context for root make targets (#6601)	3 years ago
Shweta Padubidri	1c8ebaff61	operator: Build and publish images for docker hub (#6086)	3 years ago
Salva Corts	7314d95a91	Support dashboards for SSD mode (#6540) ... * Support dashboards for SSD mode * Fix issues * Add compiled mixins * Flip $.config.ssd on if conditions * Use prefix matcher for ssd * Add compiled SSD mixin * Update loki-mixin-check to check ssd compiled mixin * Checkout compiled ssd mixin	3 years ago
Julien Duchesne	6a9557a1e0	Add Drone pipeline to test packaging (#6482) ... * Add Drone pipeline to test packaging Currently, the packaging process only happens on tags, which could lead to surprises Especially considering I'm working on deb and RPM packaging (lots more steps than now) I also moved the publishing from Circle to Drone because: 1. I'll need some new secrets from Vault 2. It should be faster * Fix make target * Remove `-parallel` arg for `gox`	3 years ago
Marco Pracucci	afa53f1939	Loki mixin: publish compiled version of the mixin (#6254) ... * Publish compiled mixin Signed-off-by: Marco Pracucci <marco@pracucci.com> * Update Makefile Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com> * Updated build image version Signed-off-by: Marco Pracucci <marco@pracucci.com> Co-authored-by: Kaviraj Kanagaraj <kavirajkanagaraj@gmail.com>	3 years ago
Travis Patterson	d97724e8dd	Introduce coverage to PR pipelines (#5357) ... * Add code coverage diff to CI * remove test package from coverage diff * review feedback * lint * Env variable test * faster experiment * drone vars * drone vars * how does the shell work? * add pr comment * escape json * report diff in comment * properly format json * quote post body * review feedback * add querier/queryrange to coverage	3 years ago
Christian Simon	6c1a62d829	Ensure proto definitions are formatted [2/2] (#6000) ... * Update build image to 0.10.4 * Add a fmt target for proto defintions This uses buf to ensure the proto defintions are more consistently formatted. * Update formatted files	3 years ago
Christian Haudum	b6ce3826b4	Use new build image 0.20.3 (#5904)	3 years ago
Christian Haudum	b3bc8d3063	Other: Improve check-drone-drift script (#5925) ... * Improve check-drone-drift script Instead of checking the line count of the current branch an main, run `make drone` and check if there are changes to the target `.drone/drone.yml` file. Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * Generate .drone/drone.yml using `make drone` Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Generate .drone/drone.yml using `make drone` Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	3 years ago
Christian Simon	a6bec98b20	Raise version of build image correctly (#5900) ... Was using the makefile first. Now read the docs again: https://github.com/grafana/loki/blob/main/docs/sources/maintaining/release-loki-build-image.md	3 years ago
Christian Simon	9d0fd3a7e3	Upgrade golang version to v1.17.9 (#5899) ... ``` git ls-files '*[Dd]ockerfile*' | grep -v ^vendor/ | xargs sed -i "s/golang:[0-9\\.]*/golang:1.17.9/g" | ag 'golang:' ```	3 years ago
Bryan Boreham	46b552def2	Makefile: run lint and tests with default garbage-collection (#5841) ... Setting GOGC=10 makes Go run garbage-collection every time the heap gets 10% bigger than it was before, which does keep the max size down but slows down memory-intensive operations. Since this was added for CircleCI, and we don't run those operations on CircleCI any more, remove the setting.	3 years ago
Trevor Whitney	7b214e2ea6	fix missing file during rpm and deb packaging step (#5818)	3 years ago
Ed Welch	f313a9ff4f	Build: update package for fuzzer after refactoring (#5776) ... * Update the package name to reflect the moved package after refactoring Signed-off-by: Ed Welch <edward.welch@grafana.com> * also include makefile Signed-off-by: Ed Welch <edward.welch@grafana.com>	3 years ago
Susana Ferreira	d4dd4eda4a	Update docker repo to grafana/loki-query-tee (#5716) ... * Update docker repo to grafana/loki-querytee * Sign drone.yml file * Update makefile - update target to generate query-tee image with correct name - update error message on drone target * Update Makefile drone target error message Co-authored-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	3 years ago