29 Commits (1765d7fe4b294b4cadc2fdc36ea83d9002f1a111)

Author	SHA1	Message	Date
Cyril Tovena	3d8688fae4	Fluent bit docs (#2390) ... * Improve documentation and fix all links for fluentbit. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Wrong file Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Reset fluentd Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add reference to ECS. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	81c7bd33f5	Fixes the fluentbit batchwait backward compatiblity. (#2375) ... We move from second `1` to duration `1s`, but we can keep that compatible. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Martin Dojcak	ca94b2cc91	Fix fluent-bit exit callback deadlock when buffering for loki is enabled (#2365)	5 years ago
Martin Dojcak	eb39e8283f	fluent-bit: Add more loki client configuration options (#2367) ... * Add more loki client configuration options to flb output plugin * Fix/Add config option tests	5 years ago
Cyril Tovena	19be2c4732	Fixes the lint issue merge to master. (#2290) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Aditya C S	384520436d	Fix fluent-bit \n and \t characters (#2286)	5 years ago
Owen Diehl	7682b32cba	Revert "Revert "Update go from 1.13 to 1.14. (#2013)"" (#2029) ... * Revert "Revert "Update go from 1.13 to 1.14. (#2013)"" This reverts commit e8fece69e3. * Update cortex to latest. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update go.sum and doc. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Owen Diehl	1530120c2e	Logql comparison ops (#2182) ... * comparison binops * starts comparison operator docs * implements bool modifier for comparison binops * vector-vector binop merging cases, including bool modifier * logql docs formatting * resets protos * linter fixes * goimports local * gofmt	5 years ago
Martin Dojcak	b27f92e86b	Add FIFO queue persistent buffering for fluent bit output plugin (#2142) ... * Add FIFO queue persistent buffering for fluent bit output plugin * Fix configuration names in logging * Fix typos & suggested improvments	5 years ago
Owen Diehl	2d31d07680	Revert "Update go from 1.13 to 1.14. (#2013)" (#2028) ... This reverts commit 8d6dc2c4ca.	5 years ago
Cyril Tovena	8d6dc2c4ca	Update go from 1.13 to 1.14. (#2013) ... * Update go from 1.13 to 1.14. See https://golang.org/doc/go1.14 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * modules.txt. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Misha Gusarov	77da15c331	JSON encoding: avoid base64 encoding of []byte inside other slices (#1890) ... Closes #1889 Signed-off-by: Mikhail Gusarov <misha@ridge.co> (cherry picked from commit 3786d74273)	5 years ago
Misha Gusarov	3786d74273	JSON encoding: avoid base64 encoding of []byte inside other slices (#1890) ... Closes #1889 Signed-off-by: Mikhail Gusarov <misha@ridge.co>	5 years ago
Cyril Tovena	59410dfb73	Improve fluentbit logfmt. (#1791) ... * Improve fluentbit logfmt. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * mod check. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Aditya C S	a4d671b111	Fix panic error when AutoKubernetesLabels is true (#1717)	5 years ago
Aditya C S	f9ff2a4b02	Add goimport local-prefixes configuration to .golangci.yml (#1710)	5 years ago
Jens Erat	557f9ccd7b	fluent-bit: multi-instance support (#1294) ... To run multiple plugin instances at the same time, the plugin instance must be registered and later retrieved. Additionally, a list of registered plugin instances must be stored for proper disposal during fluent-bit shutdown. Based on the [out_multiinstance example] in the upstream repository. [out_multiinstance example]: fc386d2638/examples/out_multiinstance/out.go Signed-off-by: Jens Erat <email@jenserat.de> Co-authored-by: Hiroshi Hatake <cosmo0920.oucc@gmail.com>	5 years ago
Jens Erat	c9016f4b2a	fluent-bit-plugin: re-enable JSON marshal tests (#1455) ... My upstream bugfix to `json-iterator/go` was accepted. This commit updates to the newest upstream release, adds checks for the returned error message and reenables the commented-out JSON marshaller tests. Re-enabling the JSON marshaller tests that should return an error message, I realized `sendMessage` logged and ignored marshalling errors instead of passing them to the caller. Signed-off-by: Jens Erat <email@jenserat.de>	5 years ago
Xiang Dai	bb0a64a64b	fix all misspell (#1437) ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Peter Štibraný	49d0d0f0da	Makefile changes to allow easy builds with or without vendoring. Also fixes version bug for both cases. (#1095) ... * Extracted -mod=vendor into a variable * Use ?= to set variable only if not set yet. This enables "MOD_VENDOR= make all" use from command line * Enable/disable vendoring with VENDOR=true or false. Enabled by default * Make go generate use -mod=vendor depending on VENDOR flag * Use GOMOD to specify module version to use. GOMOD can be set to empty string, "vendor", "readonly" and in Go 1.14 to "mod". If not defined, defaults to "vendor". Non empty values are passed to -mod parameter to Go tools, and --modules-download-mode parameter for golangci-cli linting tool. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix versioning info when not using vendoring. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated build image to use Golintci-cli v1.21.0 and Go 1.13.4. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated build image to version 0.8.0. Changs: Golintci-cli v1.21.0, Go 1.13.4. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Renamed MOD_VENDOR to MOD_FLAG to better describe its function. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix version info in all command line tools. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use loki-build-image:0.8.0 Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Cyril Tovena	27f17bc1de	Fixes linter warning from the yacc file. (#1328) ... * Fixes linter warning from the yacc file. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improves sed to work on POSIX Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
allanhung	30ec4eba79	fluent-bit-plugin: Auto add Kubernetes labels to Loki labels (#1204) ... * auto parser kubernetes metadata when lineformat set kubernetes * fix format * fix test * refactor * fix typo, use switch instead of if and go fmt * fix switch	6 years ago
Jens Erat	374ac1b70f	fluent-bit: tenant ID configuration (#1273) ... * fluent-bit: tenant ID configuration Both promtail and the fluentd plugin already have support for sending a tenant ID, and all necessary for doing so in fluent-bit is actually passing through the configuration item. Configuration is aligned with the fluentd plugin for consistency. We're lucky, since no configuration will result in an empty string that will be treated as no tenant ID by the Loki shipping client. Signed-off-by: Jens Erat <email@jenserat.de> * promtail: minor typo in documentation Signed-off-by: Jens Erat <email@jenserat.de>	6 years ago
Julien Pivotto	4a2dc5e97d	Update README.md (#1276)	6 years ago
Jens Erat	492a17def1	fluent-bit: sorted JSON and properly convert []byte to string (#1310) ... * fluent-bit: fix variable spelling mistake Signed-off-by: Jens Erat <email@jenserat.de> * fluent-bit: sort JSON map While developing another fix, I stumbled upon #1309 as a newly written unit test (with multiple key-value pairs in a map) was flaky. While JSON does not [strictly define an order on records in a map][RFC8259], but practical operations with a logging tool pretty much require it (although of course grep for JSON is jq, not grep...). Also, the key value output format is already sorted. Switching to sorted output in jsoniter is pretty easy. As of today, it still has a [bug] though, for which I already provided a [fix]. I propose accepting that rare case where invalid types can occur from msgpack output (can this even happen?) and re-enable the failing test case as soon as the upstream PR is merged. [RFC8259]: https://tools.ietf.org/html/rfc8259#section-4 [bug]: https://github.com/json-iterator/go/issues/388 [fix]: https://github.com/json-iterator/go/issues/422 Signed-off-by: Jens Erat <email@jenserat.de> * fluent-bit: properly convert []byte to string Recently, a regression was introduced that no longer ran a deep conversion of `[]byte` to `string` unless a label map was supplied. This commit fixes this by running the string conversion recursively, also removing the need of applying the conversion function again during label map stage. This change has two minor side effects: - Some test cases had to be moved, as string conversion happens much earlier now. - Invalid characters do not result in the whole label being ignored any more, but are replaced by the unicode placeholder character now. I'd consider this an improvement, making both debugging much easier ("why is that value suddenly missing?") and preserving as much information as possible. Signed-off-by: Jens Erat <email@jenserat.de>	6 years ago
George Adams	9a6b5dbf7c	Client recommendations documentation tweaks (#1124) ... * consistent use of proper noun for Fluent Bit * add notes about metrics extraction to client selection docs	6 years ago
Jens Erat	c4913bfc88	fluent-bit: edge case tests (#1096)	6 years ago
Joe Elliott	9faa8bcf1d	Go 1.13 (#1089) ... Updated everything to 1.13 Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Joe Elliott	fc6c5c063f	dep => go mod (#1062) ... * go mod files added. dep removed Signed-off-by: Joe Elliott <number101010@gmail.com> * Magically got prometheus version to stick Signed-off-by: Joe Elliott <number101010@gmail.com> * Cortex updated and prometheus updated Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated prometheus dependency Signed-off-by: Joe Elliott <number101010@gmail.com> * Added additional deps Signed-off-by: Joe Elliott <number101010@gmail.com> * Added two replaces from Gopkg.toml. Tests passing Signed-off-by: Joe Elliott <number101010@gmail.com> * Added deps Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated build image to 1.12 Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated golangci-lint to use vendored dependencies Signed-off-by: Joe Elliott <number101010@gmail.com> * Added check-mod makefile step and referenced in drone and circle ci configs Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated loki-build-image to 1.12 Signed-off-by: Joe Elliott <number101010@gmail.com> * Fixed linting error. Force go111module on for linting Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod vendor Signed-off-by: Joe Elliott <number101010@gmail.com> * Forced the inclusion of modtimevfs Signed-off-by: Joe Elliott <number101010@gmail.com> * Pin client-go due to issue with v12 go.mod Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy Signed-off-by: Joe Elliott <number101010@gmail.com> * Added check-mod to drone Signed-off-by: Joe Elliott <number101010@gmail.com> * Re-readded correct golang client Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy Signed-off-by: Joe Elliott <number101010@gmail.com> * Pinned golang/x/net to avoid proxy errors Signed-off-by: Joe Elliott <number101010@gmail.com> * Removed check-mod from all. Not necessary for tests Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated go.sum to match new pin Signed-off-by: Joe Elliott <number101010@gmail.com> * Upgraded proto to match build image Signed-off-by: Joe Elliott <number101010@gmail.com> * Force check-mod to wait til after test and lint are successful Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod vendor to go builds to force usage of vendored dependencies Signed-off-by: Joe Elliott <number101010@gmail.com> * Turn on gomodules on all builds Signed-off-by: Joe Elliott <number101010@gmail.com> * Revert "Added mod vendor to go builds to force usage of vendored dependencies" This reverts commit 65865a24c9a23133e0fa52942f2828ead7c22147. * Moved builds out of the gopath to enforce vendor usage Signed-off-by: Joe Elliott <number101010@gmail.com> * Revert "Turn on gomodules on all builds" This reverts commit b5847f0158e928e935e0b3c1b1d4eaba840ca3dc. * Explicitly choose build image for docker driver Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated golang.org/x/sys to match prometheus's version to fix promtail windows compilation Signed-off-by: Joe Elliott <number101010@gmail.com> * Added fluentbit dependency Signed-off-by: Joe Elliott <number101010@gmail.com> * Added dependency management clause Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated go version in contributing Signed-off-by: Joe Elliott <number101010@gmail.com> * Added phony makefile targets Signed-off-by: Joe Elliott <number101010@gmail.com> * Circle CI is increasingly failing linting Signed-off-by: Joe Elliott <number101010@gmail.com> * Force vendored deps on builds Signed-off-by: Joe Elliott <number101010@gmail.com> * Added logcli to gitignore Signed-off-by: Joe Elliott <number101010@gmail.com> * Reduced concurrency to help CircleCI Signed-off-by: Joe Elliott <number101010@gmail.com> * Moved drone builds out of GOPATH to force use of go module Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod vendor to prevent go clean from redownloading all packages Signed-off-by: Joe Elliott <number101010@gmail.com> * Added to test as well Signed-off-by: Joe Elliott <number101010@gmail.com> * Added mod-vendor to final go commands Signed-off-by: Joe Elliott <number101010@gmail.com> * Moved fluent-bit out of GO_PATH to force go modules Signed-off-by: Joe Elliott <number101010@gmail.com> * Pass mod vendor to the last holdout: go generate Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated ugorji/go to 1.17 to avoid version regression Signed-off-by: Joe Elliott <number101010@gmail.com> * go mod tidy and go mod vendor for ugorji/go Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Hiroshi Hatake	0cfa33d90d	fluent-bit shared object go plugin (#847) ... * Import fluent-bit-go-loki plugin sources * Add fluent-bit-go package constraint * Ensure dependencies with dep ``` $ dep ensure ``` * Update .gitignore * Move fluent-bit-go-loki to fluent-bit/fluent-bit-go-loki directory * Add documentation for fluent-bit-go-loki * Fix for lint * Fix for goimports errors * Display fluent-bit-go-loki plugin version * Use more descriptive description for fluent-bit Loki plugin * Remove needless newlines * Rectify fluent-bit-go-loki makefile Remove needless parts and rename meaningless target * Use more descriptive description in README * refactor(fluent-bit): move make targets into root Makefile * Organize imports * Reorder imports with goimports $ goimports -w out_loki.go * Remove needless LICENSE file Because it is the same for Loki repository. * Rely on Loki client retry mechanism * Make descriptions more clearly * Change default unit * BatchWait: msec -> sec * BatchSize: KiB -> Byte * Use logql to parse Loki native labels format * Use logger instead of fmt.Printf * Update documentation to reflect recent changes * Use prometheus version module to print version * Dump error message with logger * Use DYN_GO_FLAGS instead of custom FLAGS for fluent-bit-plugin * Support RemoveKeys parameter * use logql.ParseMatchers() * refactor fluent-bit go plugin * add ci step for docker image * fix lint issues * fix a failing url test * fix a failing url test * add build images for drone ci * Adding labelmap file to complex record to labels Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add helm chart and fix a bug with labelmap * New push path * dep sync * Move fluent-bit folder and use jsonnet for drone * fix build * Adds more documentation and include a basic config in the container Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove binaries * Some readme grammar fixes * docs: really nitpicky grammar change in clients README * Add helm documentation * fixes bad config * bump chart * fixes .gitignore	6 years ago