219 Commits (768bf914e00f008bc833b87da7fdbdb55152df35)

Author	SHA1	Message	Date
wphan	d627cda848	Support microsecond timestamp format (#1426) ... Adds microsecond timestamp support. https://github.com/grafana/loki/issues/1407	6 years ago
Robert Fratto	874d016bd7	promtail: add support for passing through journal entries as JSON ... This commit adds an extra configuration field (`json`) to the journal target configuration schema. When set to true, messages from the journal target will be passed through as JSON, containing all of the fields from the entry as keys and their values as the value. For backwards compatibility, the value for `json` defaults to false. Closes #1288.	6 years ago
Peter Štibraný	dca244f7aa	pkg/ingester: added sync period flags ... SyncPeriod can be used to tell ingesters to cut chunks early (before they are full) to synchronize ingesters so that they put the same data into the new chunks. If they do, they generate fully equal chunks and then they don't need to store them. To avoid very small chunks, additional parameter is added: -ingester.sync-min-utilization. When set to eg. 0.5, chunk must be at least 50% full (utilization) in order to be cut early for sync purposes. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Xiang Dai	bb0a64a64b	fix all misspell (#1437) ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Joe Elliott	4f488e7dea	Removed unsupported encodings from docs (#1432) ... * Removed unsupported encodings from docs Signed-off-by: Joe Elliott <number101010@gmail.com> * Also removed none Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Peter Štibraný	93b85f92fa	pkg/ingester: Added possibility to disable transfers. (#1425) ... Previously, with -ingester.max-transfer-retries set to zero, transfers would never stop. Now zero means don't transfer at all. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Cyril Tovena	7654c27c12	Adds configurable compression algorithms for chunks (#1411) ... * Adds L4Z encoding. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds encoding benchmarks Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds snappy encoding. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds chunk size test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds snappy v2 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve benchmarks Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove chunkenc Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update lz4 to latest master version. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use temporary buffer in serialise method to avoid allocations when doing string -> byte conversion. It also makes code little more readable. We pool those buffers for reuse. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added gzip -1 for comparison. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Initialize reader and buffered reader lazily. This helps with reader/buffered reader reuse. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Don't keep entries, extracted generateData function (mostly to get more understandable profile) Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Improve test and benchmark to cover all encodings. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds support for a new chunk format with encoding info. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ingesters now support encoding config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add support for no compression. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add docs Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove default Gzip for ByteChunk. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Removes none, snappyv2 and gzip-1 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move log test lines to testdata and add supported encoding stringer Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * got linted Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Cyril Tovena	041b612bdf	Add Joe as member of the team. (#1415) ... Welcome !	6 years ago
Sebastian Widmer	f0f6f24926	pkg/promtail: IETF Syslog (RFC5424) Support (#1275) ... * IETF syslog (rfc5254) support * Upgrade go-syslog to correctly released v2.0.1 * Incorporate feedback from new linter * Update documentation with relevant RFC sections. * Incorporate feedback from review * Use context to shutdown server. * Use util.Backoff from cortex * Do not embed mutex into TestLabeledClient * Use strings.HasPrefix * Better naming of connectionsClosed -> openConnections * Incorporate further feedback from review * Callback instead of channel in ParseStream. Removes one running Goroutine per connection. * Improve parse error log level. * Move mutex above field it protects. * Use backoff.Ongoing() * Switch to "nontransparent" parser * Further improvements to the documentation	6 years ago
Chance Zibolski	904bf2fcc9	Fix example AWS storage configuration (#1394) ... `store` must be `aws`, not `dynamo`. Without this change, the previous example configuration causes Loki to error at startup: ``` level=error ts=2019-12-10T00:27:54.489032373Z caller=main.go:66 msg="error initialising loki" err="error initialising module: table-manager: Unrecognized storage client dynamo, choose one of: aws, cassandra, inmemory, gcp, bigtable, bigtable-hashed" ```	6 years ago
vishesh92	c4e669d928	Docs: Add configuration docs for redis (#1399)	6 years ago
Ed Welch	5aa82ba199	allow configuring a target chunk size in compressed bytes (#1406) ... * allow configuring a target chunk size in compressed bytes Signed-off-by: Edward Welch <edward.welch@grafana.com> * addressing feedback Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Robert Fratto	7b834c5ce1	Update release instructions and release script (#1391) ... * fix tools/release_prepare.sh so sed works on Linux * docs: expand release instructions * docs: add line describing releasing instructions	6 years ago
Robert Fratto	ccef3da2b6	Update changelog for 1.2.0 release (#1388) ... * Update changelog for 1.2.0 release * Update CHANGELOG.md Co-Authored-By: Ed Welch <ed@oqqer.com> * docs: update reference to release tag to v1.2.0	6 years ago
Edward Welch	ea5eec2abf	respond to label queries at `loki/api/v1/labels` instead of `loki/api/v1/label`	6 years ago
Peter Štibraný	2da8d6f4b8	docs: Fix grpc_listen_host and http_listen_host. (#1353) ... They should be grpc_listen_address and http_listen_address respectively. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Labesse Kévin	17b2ce0700	documentation: iam requirement for autoscaling (#1350)	6 years ago
Ed Welch	191f87a376	Adding `zip` to the build image (#1364) ... Adding `drone` to the build image and updating the make target to run the drone command in the build image Re-adding `GO111MODULE=on` to the dependency import as it is still required and was removed in error. (Also updated the comment a little to reflect why it is still needed)	6 years ago
Ed Welch	28009050b4	Update changelog for 1.1.0 release (#1360) ... * Update changelog for 1.1.0 release	6 years ago
Daniel D'Abate	df89859369	HTTP API: Support duration and float formats for step parameter (#1355) ... * Support duration and float formats for step parameter in http api * Support Prometheus duration format and add missing tests * Fixes linter Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Xiang Dai	9afda2c81e	doc(promtail): fix prometheus link (#1333) ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Labesse Kévin	15bfc8931c	using parsable value in configuration example (#1349)	6 years ago
Jan-Philip Gehrcke	82caa52d39	authentication.md: replace "user" with "tenant" (#1223)	6 years ago
Daniel González	328ad23634	Fix duration format (#1343) ... Signed-off-by: Daniel González Lopes <danielgonzalezlopes@gmail.com>	6 years ago
Labesse Kévin	c4234e0bba	adding iam access for autoscaling configuration (#1262)	6 years ago
polar3130	d52d2cc10a	add description about tenant stage (#1266)	6 years ago
Jens Erat	374ac1b70f	fluent-bit: tenant ID configuration (#1273) ... * fluent-bit: tenant ID configuration Both promtail and the fluentd plugin already have support for sending a tenant ID, and all necessary for doing so in fluent-bit is actually passing through the configuration item. Configuration is aligned with the fluentd plugin for consistency. We're lucky, since no configuration will result in an empty string that will be treated as no tenant ID by the Loki shipping client. Signed-off-by: Jens Erat <email@jenserat.de> * promtail: minor typo in documentation Signed-off-by: Jens Erat <email@jenserat.de>	6 years ago
Robert Fratto	822e94fe6a	Fix v1 label API to be Prometheus-compatible (#1322) ... The label and label values API will now return the expected form of: ```json { "status": "success", "data": [ "label1", "label2", "labeln" ] } ```	6 years ago
Robert Fratto	715f215c50	pkg/promtail: remove journal target forced path (#1298) ... * pkg/promtail: remove journal target forced path The forced default path for the journal target (/var/log/journal) did not apply to all Linux systems: systemd actually defaults to reading from _two_ default paths: /var/log/journal and /run/log/journal. Not setting an explicit default will enable both of those paths to be searched for journal logs. The comment mentioning the local machine ID was technically accurate, but is normally dealt with by bind mounting /etc/machine-id. That's the standard approach for running fluent-bit in a container, and should be the standard approach for Promtail as well. Fixes #1286.	6 years ago
Robert Fratto	91bbe86a73	Document systemd journal scraping (#1261)	6 years ago
Max Rosin	7bd49c94bf	Add missing ) in LogQL example (#1312)	6 years ago
Robert Fratto	6d09865911	docs: update limits_config to new structure from #948 (#1278) ... Co-Authored-By: Sandeep Sukhani <sandeep.d.sukhani@gmail.com>	6 years ago
Ed Welch	03c15a6ee5	update changelog for 1.0.0 (#1291)	6 years ago
Ed Welch	12538b0d9e	simplify the release page and instructions on installing and working with binaries to remove our opinionated installation path. (#1290)	6 years ago
Alexander Knipping	27395519be	Fix promtail releases download link	6 years ago
Robert Fratto	f686885eb4	docs: slightly modify language in community Loki packages section (#1248)	6 years ago
Dario Maiocchi	9231169a54	DOC: add minimal info about openSUSE linux pkgs (#1148)	6 years ago
Marco Pracucci	04f58c880f	promtail: add multi-tenant support (#1135) ... * promtail: added tenant_id support to promtail client * promtail: added tenant stage to dinamically override the tenant ID * promtail: documented client's batch struct and improved tenant stage config pointer usage * Added static value support to tenant stage	6 years ago
Robert Fratto	54b27674f8	Standardize schema used in `match` stage (#1234) ... This PR changes the schema for the `drop` field in `match` stages to use the same schema present throughout the rest of the docs. The comment describing the field has also been updated.	6 years ago
Wojtek	0b629147ce	Fixed whitespaces in example ingress yaml (#1082)	6 years ago
Labesse Kévin	64c7012b5e	typo url (#1215)	6 years ago
Björn Rabenstein	1b251e54a4	Simplify regexp's (#1202) ... This is mostly to remove redundant anchoring (as it makes people believe that Prometheus's regexp's aren't anchored by default, which will backfire badly at some point), but it also removes useless grouping (again to avoid confusion). Signed-off-by: beorn7 <beorn@grafana.com>	6 years ago
Ed Welch	e28ffdafcb	Updating Changelog for 0.4.0 (#1196) ... * Updating Changelog for 0.4.0 * Fix Joe's name Update release versions in docs * adding a few last minute PR's	6 years ago
Marco Pracucci	de026a00ac	Fix compiled logproto protobuf (#1183) ... * Enforce recompile of protobuf sources on 'make check-generated-files' * Pinned version of protobuf in loki-build-image * Pinned version of goyacc in loki-build-image * Added 'make build-image-push' to Makefile * Documented how to release loki-build-image	6 years ago
Vít Listík	7072ed702a	typo fix	6 years ago
Robert Fratto	00185f8bbb	docs: add exmaple and documentation about using JMESPath literals (#1176)	6 years ago
Cyril Tovena	1f6f4337ce	Add logql filter to match stages and drop capability (#1112) ... * Add logql filter to match stages and drop capability * use const string instead and remove unused value * Uses action property instead of drop_entries	6 years ago
Joe Elliott	bb2b925255	Update `/loki/api/v1/push` to use the v1 json format (#1145) ... Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Marco Pracucci	7af0c2bdf3	promtail: added action_on_failure support to timestamp stage (#1123)	6 years ago
Marco Pracucci	b94a4361f2	promtail: initialize extracted map with initial labels (#1122)	6 years ago