1070 Commits (1fc0ffde8a5f9139b2e30eeadacad89f7ef515ca)

 

All Branches   

Search

Author	SHA1	Message	Date
Cyril Tovena	1fc0ffde8a	Logql benchmark and performance improvement. (#1371) ... * Add logql benchmark test. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes store benchmark limits. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add LogQL improvements. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add back logging in the storage benchmark Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Edward Welch	ea5eec2abf	respond to label queries at `loki/api/v1/labels` instead of `loki/api/v1/label`	6 years ago
Owen Diehl	5227f5bee0	application/x-www-form-urlencoded support (#1381) ... * application/x-www-form-urlencoded support * handler func instead of unnecessary struct	6 years ago
Peter Štibraný	2da8d6f4b8	docs: Fix grpc_listen_host and http_listen_host. (#1353) ... They should be grpc_listen_address and http_listen_address respectively. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Peter Štibraný	dd96fa146c	pkg/ingester: check that ingester is in LEAVING state when transferring chunks and claiming tokens. Required when using memberlist client. (#1300) ... * On chunks transfer, verify that source ingester is LEAVING This is important when using gossiping ring. If source ingester is not leaving yet, than claiming its tokens will fail (merge function will not move ownership to the target ingester), and target ingester will end up with no tokens in the ring. * Register ring to prometheus. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Update check using latest version from Cortex. There is no direct usage of logging, which is consistent with the rest of this method. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Move import to group of imports with third-party packages. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Labesse Kévin	17b2ce0700	documentation: iam requirement for autoscaling (#1350)	7 years ago
Johannes Staffans	7b2fde3e58	Fluentd: guard against nil values when sanitizing labels (#1376) ... * Guard against nil values when sanitizing labels * Gem version bump	7 years ago
Cyril Tovena	3ffa385b1e	Let Loki start when using the debug image. (#1372) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	7 years ago
Peter Štibraný	e0ec61f986	pkg/ingester: handle labels mapping to the same fast fingerprint. (#1247) ... * pkg/ingester: handle labels mapping to the same fast fingerprint. Uses slightly adapted fpMapper code from Cortex. Fixes issue #898 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * empty commit to force new build Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Removed empty lines in imports. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added test that pushes entries concurrently. To be run with -race. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Stream now keeps both original and mapped fingerprint Mapped fingerprint is used in streams map. Original ("rawFP") is preserved when saving chunks. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Vendoring Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Reverted previous commit (keep the test, with updated checks). Preserving raw fingerprints could lead to data loss when doing chunk deduplication while storing chunks. We don't want that. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * go mod vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	7 years ago
Cyril Tovena	2b7f375a21	Fixes fluentd new push path API. (#1363) ... * Update fluentd to support the new v1 push API. - also add tests for ordering. - improve nanoseconds precision. - fixes all lint/style issue. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Bump the gem and add myself as author. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	7 years ago
Edward Welch	a8a143b578	Updating version numbers for 1.1.0 release	7 years ago
Ed Welch	191f87a376	Adding `zip` to the build image (#1364) ... Adding `drone` to the build image and updating the make target to run the drone command in the build image Re-adding `GO111MODULE=on` to the dependency import as it is still required and was removed in error. (Also updated the comment a little to reflect why it is still needed)	7 years ago
Ed Welch	28009050b4	Update changelog for 1.1.0 release (#1360) ... * Update changelog for 1.1.0 release	7 years ago
Cyril Tovena	f7ee1c753c	Supports same duration format in LogQL as Prometheus ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	7 years ago
Daniel D'Abate	df89859369	HTTP API: Support duration and float formats for step parameter (#1355) ... * Support duration and float formats for step parameter in http api * Support Prometheus duration format and add missing tests * Fixes linter Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	7 years ago
Xiang Dai	9afda2c81e	doc(promtail): fix prometheus link (#1333) ... Signed-off-by: Xiang Dai <764524258@qq.com>	7 years ago
Xiang Dai	1dcf3d371b	chore(/release): distribute binaries as .zip (#1160) ... Switches from `.gz` to `.zip` for the compressed binaries, as this format is more common across operating systems (works out of the box on probably all of them, including tooling such as Puppet, Ansible, etc.)	7 years ago
Adam Johnson	8c27cca496	Update loki helm chart to support service account annotations (#1341) ... * update loki helm chart to support service account annotations for use with EKS IAM roles Signed-off-by: Adam Johnson <a.johnson@winton.com> * Bump minor versions and fix serviceAccount reference for annotations Signed-off-by: Adam Johnson <a.johnson@winton.com>	7 years ago
Labesse Kévin	15bfc8931c	using parsable value in configuration example (#1349)	7 years ago
Jan-Philip Gehrcke	82caa52d39	authentication.md: replace "user" with "tenant" (#1223)	7 years ago
Cyril Tovena	b34c2b0bd3	Move to jsoniter instead of default json package (#1249) ... * Move to jsoniter instead of default json package Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Removes jsoniter on the logcli output Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	7 years ago
Daniel González	328ad23634	Fix duration format (#1343) ... Signed-off-by: Daniel González Lopes <danielgonzalezlopes@gmail.com>	7 years ago
Cyril Tovena	97ac9da430	Update gem version. (#1339) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	7 years ago
Adam Johnson	3ae6fecbfc	feat(loki): support IAM roles for EKS (#1340) ... * pull in cortex changes to support IAM roles for EKS * update go.sum after running tidy Signed-off-by: Adam Johnson <a.johnson@winton.com>	7 years ago
Gabriel Henrique Rudey	005745d544	chore(packaging): add debug symbols to loki and promtail debug builds (#1342) ... `-s` and `-w` build flags were removing the debug symbols from the binary, even on debug only builds, making debugging impossible	7 years ago
Peter Štibraný	49d0d0f0da	Makefile changes to allow easy builds with or without vendoring. Also fixes version bug for both cases. (#1095) ... * Extracted -mod=vendor into a variable * Use ?= to set variable only if not set yet. This enables "MOD_VENDOR= make all" use from command line * Enable/disable vendoring with VENDOR=true or false. Enabled by default * Make go generate use -mod=vendor depending on VENDOR flag * Use GOMOD to specify module version to use. GOMOD can be set to empty string, "vendor", "readonly" and in Go 1.14 to "mod". If not defined, defaults to "vendor". Non empty values are passed to -mod parameter to Go tools, and --modules-download-mode parameter for golangci-cli linting tool. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix versioning info when not using vendoring. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated build image to use Golintci-cli v1.21.0 and Go 1.13.4. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated build image to version 0.8.0. Changs: Golintci-cli v1.21.0, Go 1.13.4. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Renamed MOD_VENDOR to MOD_FLAG to better describe its function. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix version info in all command line tools. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use loki-build-image:0.8.0 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	7 years ago
Cyril Tovena	27f17bc1de	Fixes linter warning from the yacc file. (#1328) ... * Fixes linter warning from the yacc file. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improves sed to work on POSIX Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	7 years ago
Julien Pivotto	eb7b495565	Metrics: use Namespace everywhere when declaring metrics (#1320) ... Code linting to make things consistent. Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	7 years ago
allanhung	30ec4eba79	fluent-bit-plugin: Auto add Kubernetes labels to Loki labels (#1204) ... * auto parser kubernetes metadata when lineformat set kubernetes * fix format * fix test * refactor * fix typo, use switch instead of if and go fmt * fix switch	7 years ago
Dawid Malinowski	4202ceda8f	Wrong api endpoiont in fluent-plugin-grafana-loki (#1326) ... Closes: #1307	7 years ago
Peter Štibraný	125cfbfd5b	pkg/promtail/client: Handle fingerprint hash collisions (#1254) ... * Handle fingerprint hash collisions Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Instead of using fingerprints, use label strings as map keys. Label strings are properly sorted key=value pairs. This solution produces more garbage, but doesn't reinvent its own hashing, and keeps code simple. This seems to be a good tradeoff for promtail. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	7 years ago
Labesse Kévin	c4234e0bba	adding iam access for autoscaling configuration (#1262)	7 years ago
polar3130	d52d2cc10a	add description about tenant stage (#1266)	7 years ago
Jens Erat	374ac1b70f	fluent-bit: tenant ID configuration (#1273) ... * fluent-bit: tenant ID configuration Both promtail and the fluentd plugin already have support for sending a tenant ID, and all necessary for doing so in fluent-bit is actually passing through the configuration item. Configuration is aligned with the fluentd plugin for consistency. We're lucky, since no configuration will result in an empty string that will be treated as no tenant ID by the Loki shipping client. Signed-off-by: Jens Erat <email@jenserat.de> * promtail: minor typo in documentation Signed-off-by: Jens Erat <email@jenserat.de>	7 years ago
Julien Pivotto	4a2dc5e97d	Update README.md (#1276)	7 years ago
Jens Erat	492a17def1	fluent-bit: sorted JSON and properly convert []byte to string (#1310) ... * fluent-bit: fix variable spelling mistake Signed-off-by: Jens Erat <email@jenserat.de> * fluent-bit: sort JSON map While developing another fix, I stumbled upon #1309 as a newly written unit test (with multiple key-value pairs in a map) was flaky. While JSON does not [strictly define an order on records in a map][RFC8259], but practical operations with a logging tool pretty much require it (although of course grep for JSON is jq, not grep...). Also, the key value output format is already sorted. Switching to sorted output in jsoniter is pretty easy. As of today, it still has a [bug] though, for which I already provided a [fix]. I propose accepting that rare case where invalid types can occur from msgpack output (can this even happen?) and re-enable the failing test case as soon as the upstream PR is merged. [RFC8259]: https://tools.ietf.org/html/rfc8259#section-4 [bug]: https://github.com/json-iterator/go/issues/388 [fix]: https://github.com/json-iterator/go/issues/422 Signed-off-by: Jens Erat <email@jenserat.de> * fluent-bit: properly convert []byte to string Recently, a regression was introduced that no longer ran a deep conversion of `[]byte` to `string` unless a label map was supplied. This commit fixes this by running the string conversion recursively, also removing the need of applying the conversion function again during label map stage. This change has two minor side effects: - Some test cases had to be moved, as string conversion happens much earlier now. - Invalid characters do not result in the whole label being ignored any more, but are replaced by the unicode placeholder character now. I'd consider this an improvement, making both debugging much easier ("why is that value suddenly missing?") and preserving as much information as possible. Signed-off-by: Jens Erat <email@jenserat.de>	7 years ago
Peter Štibraný	9956717383	Include positions filename in the error when YAML unmarshal fails. (#1311) ... * Include positions filename in the error when YAML unmarshal fails. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Include filename when parsing of YAML/JSON file fails. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	7 years ago
Putra Sattvika, I Gusti Ngurah	c89df1a795	storage: fix missing logs with batched chunk iterator (#1299) ... * fix batched chunk iterator * fix expected series labels in iterator_test.go * add query range boundary check * add __name__ label matcher to test cases * trim __name__ without mutating chunks	7 years ago
sh0rez	8eced44bbc	chore(ci): drone-cli (#1274) ... Drone has a CLI (https://github.com/drone/drone-cli) that handles compiling the Jsonnet to a valid `drone.yml`. This is more elegant than our previous `jsonnet | yq` dance.	7 years ago
Robert Fratto	822e94fe6a	Fix v1 label API to be Prometheus-compatible (#1322) ... The label and label values API will now return the expected form of: ```json { "status": "success", "data": [ "label1", "label2", "labeln" ] } ```	7 years ago
Robert Fratto	715f215c50	pkg/promtail: remove journal target forced path (#1298) ... * pkg/promtail: remove journal target forced path The forced default path for the journal target (/var/log/journal) did not apply to all Linux systems: systemd actually defaults to reading from _two_ default paths: /var/log/journal and /run/log/journal. Not setting an explicit default will enable both of those paths to be searched for journal logs. The comment mentioning the local machine ID was technically accurate, but is normally dealt with by bind mounting /etc/machine-id. That's the standard approach for running fluent-bit in a container, and should be the standard approach for Promtail as well. Fixes #1286.	7 years ago
Julien Pivotto	7ccd0ab8d0	Use tenant as label name for discarded_samples metrics ... discarded_samples should use the name labels as the other metrics. Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	7 years ago
Julien Pivotto	5d1fec514c	Expose discarded bytes metric (#1317) ... Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	7 years ago
Robert Fratto	91bbe86a73	Document systemd journal scraping (#1261)	7 years ago
Edward Welch	20bb95f75a	Removing this file used to trick dep into importing packages, the second import already exists in the logproto.pb.go file and the first import is already imported other places in our code. ... This should fix the anyone using the logproto.pb.go file from registering a bunch of cortex metrics.	7 years ago
jianweizhang	61b5bc6554	https://github.com/grafana/loki/issues/1302 (#1303)	7 years ago
Max Rosin	7bd49c94bf	Add missing ) in LogQL example (#1312)	7 years ago
Peter Štibraný	fd25e6d180	Write positions to new file first, move to target destination afterwards. (#1304) ... Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	7 years ago
Robert Fratto	a5765b57bf	pkg/distributor: fix metric loki_discarded_samples_total (#1279) ... loki_discarded_samples_total is supposed to be the count of samples that were discarded, but was instead being reported as the total bytes discarded. The metric has been fixed and a new metric, loki_discarded_bytes_total, has been added to report the total discarded bytes. Fixes #1255.	7 years ago
Robert Fratto	6d09865911	docs: update limits_config to new structure from #948 (#1278) ... Co-Authored-By: Sandeep Sukhani <sandeep.d.sukhani@gmail.com>	7 years ago