514 Commits (e038d0fc3af9cc2adecbda81dbc39163be22ba11)

Author	SHA1	Message	Date
Cyril Tovena	e6778e9827	Update to go 1.15 (#2877) ... * Upgrade to 1.15. Also upgrade linter and fixes some lint issues. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update CI. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update generated files. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Moar lint 🤦 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * moar lint and tests fixes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Moar tests fixes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	6bacfa1f3f	Bump fluentd plugin (#2825) ... so we can push it. ``` gem push fluent-plugin-grafana-loki-1.2.15.gem /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/universal-darwin19/rbconfig.rb:229: warning: Insecure world writable dir /Users/ctovena/go/src/github.com/grafana/loki/cmd/logcli in PATH, mode 040777 Pushing gem to https://rubygems.org... Repushing of gem versions is not allowed. Please use `gem yank` to remove bad gem releases. ``` Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Anders Ingemann	081cc024d6	fluent-plugin: Improve escaping in key_value format (#2434) ... The key_value format does not seem to be well specified. This change assumes "logfmt" as the format and escapes values accordingly: The code itself is lifted from here: e279d43cde/lib/stringify.js Grafana seems to handle values escaped in this manner much better than before. e.g.: query="{program="loki"}") was shown as (IIRC) query="{program= and is now displayed correctly. As an added bonus only values that require quoting will actually be quoted, improving readability and derived fields regexes.	5 years ago
Ed Welch	af6e8cb6c9	Update local and docker default config files to use boltdb-shipper with a few other config changes (#2803) ... * change the default local and docker config files to use boltdb-shipper also change them to use chunk_target_size * create ruler local filesystems directories if they don't exist change the ruler paths to be a little more consistent * don't need to create temp dir, also checking for the storage type * add compactor config to docker config file.	5 years ago
Dr. Jan-Philip Gehrcke	4e661cde0e	FluentD loki plugin: add support for bearer_token_file parameter (#2739) ... * fluentd plugin: improve param descriptions * fluentd plugin: make code comments more correct * fluentd plugin: rename things for clarity * fluentd plugin: add bearer_token_file parameter * fluentd plugin: read and set bearer token * fluentd plugin: improve error message * fluentd-plugin: bump version * fluentd plugin: fix header, log success * fluentd plugin: improve log messages	5 years ago
Cyril Tovena	62272cdaa1	Fixes all lint errors. (#2768) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
dlemel8	9a3592c42c	add "verify-config" flag that load and verify configuration and exits with proper exit code (#2737)	5 years ago
Aditya C S	772b7ff087	Logstash cpu usage fix (#2607) ... * Replace concurrent-ruby-edge with agent lib * Fix logstash cpu consumption * increment gemspec version * increment gemspec version * fix tests	5 years ago
Davor Kapsa	fffcfa6e81	fix some misspells (#2725)	5 years ago
Ed Welch	d3bf21e774	Promtail: (and also fluent-bit) change the max batch size to 1MB (#2710) ... * change the max batch size to 1MB for all the defaults including helm and fluent-bit, attempt to centralize this config a little where possible. * fix test	5 years ago
Jiajin Zheng	1b2bae46ba	fluent-bit plugin support tls (#2568)	5 years ago
Owen Diehl	0d64d2d912	fixes ruler docs & includes ruler configs in cmd/configs + docker img (#2657)	5 years ago
Ryan Lahfa	e9c9faf481	Docker logging driver: Add a keymod for the extra attributes from the Docker logging driver (#2459) ... * docker: add a keymod to replace . by _, making them "prometheus"-friendly * docker: fix the code * docker: replace also - by _	5 years ago
Sandeep Sukhani	65b539c2ab	add compactor details and other boltdb-shipper doc improvments (#2622)	5 years ago
Sandeep Sukhani	143672e643	add support for building querytee (#2602)	5 years ago
Tharun Rajendran	ab2dc9e2d3	Added logcli docker image (#2561) ... Signed-off-by: Tharun <rajendrantharun@live.com>	5 years ago
Sandeep Sukhani	501f93fa92	revendor cortex to latest master (#2543)	5 years ago
Ed Welch	82845e4f78	Adds --analyize-labels to logcli series command. (#2497) ... Changes the series command to use the common matcher input found in the query and instant-query commands, instead of `logcli series --matcher='{foo="bar"}'` it's now `logcli series '{foo="bar"}'`	5 years ago
Ed Welch	80693cae6f	Logcli: automatically batch requests (#2482) ... * first stab at batching logcli requests * fix other calls to printResult * working batching code * refactor the logcli Client into an interface so that it can be mocked for testing. * fixing some bugs * refactoring the output interface to make testing easier * starting to add tests * adding a bunch of tests fixing up how the MockQuerier works. * updating docs * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> * Update docs/sources/getting-started/logcli.md Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Diana Payton <52059945+oddlittlebird@users.noreply.github.com>	5 years ago
Aditya C S	68568f141e	colored labels output for logcli (#2470) ... * colored labels output for logcli * add period to all cli description	5 years ago
Owen Diehl	05e0e91d6e	Fix/promtail yaml config (#2471) ... * promtail config cloneable * config parsing compile time checks against cloneable	5 years ago
Owen Diehl	7530bf6def	avoid mutating config while parsing -config.file (#2392) ... * avoid mutating config while parsing -config.file * minimal config mutation test case * logcli local query config file compat	5 years ago
Ed Welch	691d27c8c7	Update Loki build image (#2467) ... * updating build-image version * updating drone config * updating a few other references to the build image	5 years ago
Ed Welch	204e61afe3	Loki-Canary: Backoff retries on query failures, add histograms for query performance. (#2413) ... * Canary needs to wait before spot-checking entries some reasonable amount of time else the nature of the async thread doing the testing can ask for them from Loki only a few ms after they are written and they would have no chance of being present. Adding two histograms for tracking the performance of the spot check and metric test queries * Adding backoff to queries if they fail specifically waiting 5mins when a 429 is received from Loki * fix order of parameters	5 years ago
Aditya C S	43f2ef33b3	logstash code refactor and doc improvements (#2410) ... * logstash code refactor and doc improvements * added back gradlew assemble	5 years ago
Cyril Tovena	4e2b37b2f8	bump fluentd version to release a new gem. (#2407) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Sándor Guba	35feea5a58	make fluentd verson more flexible for updatess (#2399)	5 years ago
Cyril Tovena	45af549aeb	Update fluentd docs and fixes links for the website.i (#2391) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	3d8688fae4	Fluent bit docs (#2390) ... * Improve documentation and fix all links for fluentbit. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Wrong file Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Reset fluentd Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add reference to ECS. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	23f64ef7e1	Docker driver doc (#2389) ... * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Merge all documentation for docker-driver in one place. Fixes #2198 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	81c7bd33f5	Fixes the fluentbit batchwait backward compatiblity. (#2375) ... We move from second `1` to duration `1s`, but we can keep that compatible. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Ed Welch	76ceec45d9	If an entry is missing on the websocket, start checking after `wait` but continue checking until `max-wait` (#2369) ... Refactored out a useful pruneList function	5 years ago
Aditya C S	4c6090756f	Loki Logstash Plugin (#1822) ... * Logstash plugin * include_labels * include_labels * Removes binary. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve documentation and remove the push path. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move to cmd. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more precision for jruby. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/clients/logstash/README.md * p Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * ignore Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove ignore file/ Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * More precision for installing jruby Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Rename without Grafana Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * A lot of refactoring and testing. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * change delay logic * Fully tested version. Now testing/writing docs and charts. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Forgot to save merge. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * working version. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Makefile + easier docker build. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * adds ci to build logstash image. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix build for logstash. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds example with helm charts. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix target to send 10 logs with logstash. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improved documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add missing helm add repo for external repo Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review comment. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes loki service in Promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update loki-stack version Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Martin Dojcak	ca94b2cc91	Fix fluent-bit exit callback deadlock when buffering for loki is enabled (#2365)	5 years ago
Martin Dojcak	eb39e8283f	fluent-bit: Add more loki client configuration options (#2367) ... * Add more loki client configuration options to flb output plugin * Fix/Add config option tests	5 years ago
Ed Welch	2b145da7d7	Canary tweaks (#2350) ... * tweak the canary a bit, add a metric for websocket pings, fix some logging, improve the mutex locking a bit, add a read timeout on the websocket, add a lastmessage time checker to restart websocket * fix constructor * fix counter name change metric count reporting to two separate metrics, expected vs actual * add note to upgrade guide for metric name changes * fixed tests.... * Update docs/operations/upgrade.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	5 years ago
Ed Welch	81b9decfb5	Loki-Canary: Add query spot checking and metric count checking (#2344) ... * Add spot check capability to canary to query certain values over time to make sure they are still in Loki. Add a context timeout to Loki queries * Updating canary to use /loki/api/v1 endpoints adding a metric test query * fixing metric names to have _total for counters * fix parsing of timestamp from log line and don't use entry timestamp * Tweak the metric test query to adjust the range to the time the canary has been running to get accurate results until the requested range has been reached. Add a total spot check entry counter to get a ratio of success * Add some debugging logs to troubleshoot missing entries * add more tests, fix some log lines * update docs, make the spot-check timer separate from prune entries * just how many paramaters can I add to the constructor.... * run prune entries on a separate thread, only run one at a time.	5 years ago
Cyril Tovena	2548d6986d	Remove mount in the docker driver. (#2295) ... * Remove mount in the docker driver. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint json Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Johnathan Falk	0ace187e17	Change ignoring empty line to debug logging. (#2343) ... Signed-off-by: Johnathan Falk <johnathan.falk@gmail.com>	5 years ago
Ed Welch	0b5996021f	Loki: add -print-config-stderr flag to dump loki's runtime config to stderr (#2336) ... * Loki: add -print-config-stderr flag to dump loki's runtime config to stderr * add ability to print inline config for better readability in grafana * add an option to log the config in reverse order to make viewing in Grafana easier. Also added this capability to Promtail	5 years ago
Ed Welch	b24a143043	Promtail: Loki Push API (#2296) ... * refactor to put targets in separate packages * rename scrape package to scrapeconfig * Push implementation, working with logging * adding new vendored library * adding tests * adding documentation and an additional config option. * fixing journal test * rename scrape config entry * Update docs/clients/promtail/configuration.md Co-authored-by: Owen Diehl <ow.diehl@gmail.com> * PR feedback Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	5 years ago
Cyril Tovena	3defe3a5bd	Default to 3100 port for Loki without requiring NET_BIND_SERVICE capability. (#2294) ... Mistakes were made. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	19be2c4732	Fixes the lint issue merge to master. (#2290) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Aditya C S	384520436d	Fix fluent-bit \n and \t characters (#2286)	5 years ago
Owen Diehl	7682b32cba	Revert "Revert "Update go from 1.13 to 1.14. (#2013)"" (#2029) ... * Revert "Revert "Update go from 1.13 to 1.14. (#2013)"" This reverts commit e8fece69e3. * Update cortex to latest. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update go.sum and doc. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Lukas Grimm	17390fd45d	Canary: make stream configurable (#2259) ... * tried to fix canary in non kubernetes env * update doc	5 years ago
Cyril Tovena	1e19aa4715	Add performance profile flags for logcli. (#2248) ... * Add performance profile flags for logcli. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update the logcli documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove comment. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove unused import. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	732fe6d14f	Adds default -config.file for the promtail docker images. (#2196) ... Closes #2194. This is already the case for Loki. I think it's better to have this since most people would expect it as default at least for docker. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	79a90dc4f6	Docker driver relabeling (#2199) ... * Add relabeling to docker driver using `loki-relabel-config` log option. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add docs. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Periklis Tsirakidis	815c47533e	Replace memberlist service in favor of cortex provided service (#2224) ... * Bump cortex deps to include non-experimental memberlist service * Replace memberlist service in favor of cortex provided service * Fix route method param for querytee tool * Register memberlist flags * Add documentation and example for memberlist	5 years ago