514 Commits (e038d0fc3af9cc2adecbda81dbc39163be22ba11)

Author	SHA1	Message	Date
sh0rez	b887602e36	chore(packaging/docker): Support multiple architectures (#762) ... This finally adds support for multiple architectures! 🎉 Images are now built using BuildKit (actually img), Dockerfiles were parameterized to allow this. Containers are still built on alpine, using QEMU and binfmt as a kernel compatibility layer to allow RUN steps in these. CircleCI has been fully revamped, to speed up builds and de-duplicate the configuration. Makefile has been extended with additional logic to shadow the multi-arch to non-CI users. Happy hacking on Raspberry Pi and friends :)	6 years ago
Marco Pracucci	e7fb205827	fix(logcli): timestamp timezone handling (#821) ... Logcli used to inconsistently handle timezones in timestamps. This addresses this by adding a new `--timezone` / `-z` flag, to explicitly set the timezone the timestamps shall be formatted in. Furthermore it refactors the output framework inside of logcli to test it easier. Fixes #798	6 years ago
Sandeep Sukhani	459e4e3f4e	Update logcli usage in docs and improve help text	6 years ago
Cyril Tovena	b9463436b2	fix panic in docker driver for newer docker version (18.09.7+) (#813)	6 years ago
Ed	573673a0ab	Simplify our makefile as much as possible (#753) ... refactor(makefile): simplify makefile by removing the autogenerated targets and make building binaries and dockerfiles separate operations.	6 years ago
Edward Welch	3d5319e72a	adding ability to supply timezone to timestamp pipeline stage	6 years ago
Marco Pracucci	8feadf7924	fix: Speed up Loki shutdown when using the sample local config (#784)	6 years ago
Cyril Tovena	d31577faba	adjust old instructions for troubleshooting docker daemon (#785)	6 years ago
sh0rez	38cb093358	feat(loki): extended tailing (#764) ... * refactor(querier/ingester): TailRequest Lookback window Moves the specifications of the Lookback Window out of the logproto.QueryRequest into it's own type logproto.Lookback. This is required, because the Lookback Window will be used in the TailRequest as well. * feat(querier): parse Lookback from HTTP Request * feat(logcli): send Lookback Window spec with tail request * feat(querier): include historic entries in tail mode Extends tailing by sending a configurable amount of historic entries with before the live entries. This enables a behaviour that is closer to kubectl logs -f and docker logs -f. It is implemented by running a regular Query before subscribing to the ingesters. * fix: adapt tests to Lookback change * feat(querier): check all errors to make the linter happy * fix(logproto): flatten Lookback window spec Flattens the Lookback window spec into the individual queries * fix(ingester): adapt test to Lookback flatten	6 years ago
Edward Welch	da6a13383a	better job of fixing url parsing and host name extraction for logcli	6 years ago
Cyril Tovena	c3e74b3eca	fix path escape (#779)	6 years ago
Ed	03dc4e63fa	Parse the addr into a URL so we can extract the Host name for use in the TLSConfig (#778)	6 years ago
Robert Fratto	f74f2c82f4	feat(logcli): add --to flag to specify latest RFC3339 time for query (#776) ... Fixes #774	6 years ago
Edward Welch	e6f431ad46	finishing up loki-canary move into loki repo	6 years ago
Edward Welch	cd5368a44d	preparing for move into loki repo	6 years ago
Cyril Tovena	3346ce1b40	Storage memory improvement (#713) ... * add benchmark for storage queries * improve iterator to load only on next * fix memory retained by lazy chunks * reverse backward lazy iterator	6 years ago
sh0rez	9d5630d875	feat(logcli): output modes (#731) ... * feat(logcli): quiet mode Adds a quiet mode (-q / --quiet) to suppress the debug messages to stderr * feat(logcli): output modes Adds two alternative output modes (-o / --output) - raw: emits the line as parsed - jsonl: emits the line plus all known metadata as JSONL (JSON Line) Usage: -o [default, raw, jsonl] * feat(logcli): quiet tailing mode * feat(logcli): output modes while tailing Supports the three different output modes in tail mode as well * feat(logcli): print labels in jsonl tail mode * refactor(logcli): clean up entry printing Moves the entry printing into a standardized interface, implements this three times: - default (human readable) - jsonl (for scripts) - raw ('as is')	6 years ago
sh0rez	d43de72f3b	feat(logcli): query from absolute timestamp (#736) ... * feat(logcli): query from absolute timestamp Adds a new flag (`--from`) as to complement `--since`. While since subtracts a relative duration from the current time, from allows to specify the absolute start of the lookback window. Note: `--from` takes precedence over `--since`, but only if set. * fix(logcli): use RFC3339Nano for -from To comply with Prometheus, this flag now honors Nanoseconds as well (was using RFC3339 so far)	6 years ago
Edward Welch	eedd3d9fc2	prune interval is configurable ... canary will suspend all operations on SIGINT but not exit, allowing you to shutdown the canary without it being restarted by docker/kubernetes SIGTERM will shutdown everything and end the process	6 years ago
sh0rez	4779b8bd2b	fix(loki): panic on missing config (#720) ... * fix(loki): pass missing config error to user Missing config errors are handled at the library level. Our own check mitigated this and causes loki to SEGFAULT later on * feat(loki): default config file in container The container provides a default config file. Use it by default * Revert "fix(loki): pass missing config error to user" This reverts commit b2744fcf42, because loki it assumed loki was incapable of running without config, which is not the case.	6 years ago
sh0rez	420a359ff7	fix(loki|promtail): logger re-init nil config panic (#697) ... When a more or less invalid config (e.g. `null`) is supplied, the log level prop of the config receives an invalid value which causes the logger to panic on re-init. Prevents this by checking for a nil log-level and notifies the user in case	6 years ago
Edward Welch	bcccbbfaaf	changing the default prune interval to 60 seconds, at the previous 1 second it would cause some way too aggressive querying when scaled out over all our clusters and loki had a hiccup	6 years ago
Sandeep Sukhani	2a8a03795a	Improvements in live tailing of logs (#541) ... * Improvements in live tailing of logs Instead of polling for new logs, a grpc stream is opened between ingester and querier to get live logs Querier reconnects to disconnected or newly added ingesters * Added more comments to code for live log tailing * Some code refactoring in live log tailing * handling delayfor in logcli, max delayfor to be 5 seconds * some changes in tail response in live tailing * Fixed issue with stopping ingesters gracefully when live tailing is being used * Added tests for tailer in querier * Live tailing made logql compatible, some code refactoring suggested in PR	6 years ago
Cyril Tovena	aecf867605	fix missing logger in client (#673)	6 years ago
Cyril Tovena	2909fe54e1	Docker Logging Driver (#663) ... * adds first version of docker driver * without logrus and fixes some linter issue * fix the driver and start a build system * adds swarm label discovery * Add documentation and more targets * make the linter happy ❤️ * indent config.json * with circleci steps for master and branch * Review Feebacks	6 years ago
Edward Welch	02aed71a28	refactoring things so that the comparator can use the reader to make a direct query to loki to look for logs not received over the websocket before reporting them as missing	6 years ago
sh0rez	6fac9547f2	fix(loki): honor log level from config file (#657) ... Because of the logger being initialized before the configuration file is parsed, the log_level from the config file is ignored. To solve this, the logger is reinitialized after the file is parsed, as it is already being done in promtail.	6 years ago
Edward Welch	04facc4d00	updating docs for new pipeline config. ... removed helm entry in scrape_config.sh because there doesn't seem to be anyway to make it work with new pipeline config	6 years ago
Sandeep Sukhani	f7f09e2226	Limits: Reject entries based on age set in limits (#631) ... * Reject entries based on age set in limits	6 years ago
Sandeep Sukhani	39bbd733be	ksonnet changes for running loki in single binary (#622) ... * ksonnet changes for running loki in single bianry Added retention config with default values * Fixed indentation	6 years ago
Sandeep Sukhani	3d3c05717a	Update cortex vendor (#610) ... * Update cortex vendor Use query max look back from cortex Update config changes from cortex Fixed breaking code due to updating cortex vendor * fixed linter error	6 years ago
Goutham Veeramachaneni	f2fb161a08	Fix local config: Use DayTime (#598) ... * Fix local config: Use DayTime Psst, the date is the first commit date for loki ;) Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Fix the config in ksonnet and helm too Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	6 years ago
Sandeep Sukhani	f5c8b22b34	Change tail response for backward compatibilty with future changes (#590) ... Changed it to dict with single key called "streams" and value set to list of logproto.Stream	6 years ago
Cyril Peponnet	7942493524	impr/clients: Handle TLS config and MTLS for logcli and promtail (#540) ... * impr/clients: Handle TLS config and MTLS for logcli and promtail * fix/tls: Please gofmt... * impr/clients: use prometheus HTTPClientConfig for logcli and promtail * fix/promtail: Set proper Client config name * impr/promtail: Use prometheus HTTPClientConfig configuration * adapt with master * address review * fix conflicts * address requested changes * remove file Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	6 years ago
Cyril Peponnet	0885f64e60	impr/logcli: Added label output filters + tests (#563) ... * impr/logcli: Added label filters + tests * Address review * udpate readme	6 years ago
Sandeep Sukhani	7b584b54f7	Limiting query start time with config (#572) ... * Limiting query start time with config * Fixed maxLookBackPeriod check, added it to existing configs, some other fixes * gofmted file * Changed maxLookBackPeriod to 4 weeks in helm chart * Setting maxLookBackPeriod in helm chart to 0 and bumping up the helm chart version * changed maxLookBackPeriod in yaml in cmd to 0 and some nit	6 years ago
Edward Welch	5aac00f4d9	changing response_latency buckets some more, making exponential and configurable	6 years ago
Edward Welch	9dde2c4e5f	fixing how auth is applied	6 years ago
Edward Welch	34bb9db758	using an environment variable passed into an arg instead of reading the pod name from a file and the downardApi ... added a makefile	6 years ago
Edward Welch	45a7556da2	improving metrics ... improving tests config via flags added ksonnet config	6 years ago
Edward Welch	8340232b04	initial checkin ... mostly working, need to extract out the config needs a proper ksonnet or helm deployment or both needs a makefile	6 years ago
Edward Welch	97e4a122ca	adding a pipeline processing histogram	6 years ago
Tom Wilkie	c71a9b0dce	Fix logcli. ... Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Cyril Tovena	53075db577	Send logs to multiple loki instances (#536) ... * Adds the ability to provide multiple Loki URL For backward compatibility `client:` still works with flag. * add some tests for multi client * update ksonnet module to support multiple client * fix comment * fix lint issues	6 years ago
Cyril Tovena	b8b7caa450	Promtail targets and service discovery pages (#532) ... * add a custom server for loki with assets embedded * adds a targets page for promtail to see discovered files and labels * lint fixes * fix css table size * add service discovery logic * add service discovery template * add promtail pages documentation * ignored gen file in linter	6 years ago
Edward Welch	916124b9ea	Adding `make debug` support to build debug binaries and debug containers which wrap the binary with delve and allow for remote debugging	6 years ago
Goutham Veeramachaneni	e2b25612c8	Take 2 for fix the limit settings (#519) ... * Revert "Make sure the default for EnforceMetricName is ✅ (#518)" This reverts commit 199746a130. * Fix overrides unmarshalling properly Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	6 years ago
Goutham Veeramachaneni	199746a130	Make sure the default for EnforceMetricName is ✅ (#518) ... Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	6 years ago
Sandeep Sukhani	1f1706f467	Move live log tailing behind websocket on server (#439) ... * Move live log tailing behind websocket on server Live log tailing now requires client to just open a websocket and keep listening to it for getting live logs for matching query * Fixed linting errors * Unexported tailQuery querier method * Added a delay in querying of logs to not miss delayed entries * Renamed variable for better readability * Some code refactoring suggested in PR review * Fixed linter errors * Code refactoring requested in PR review * Disabling linting for writeHTTPErrorResponse since same value for an input is being passed from all function calls for now * Removed a function which already existed * Improved printing of log entries using cli and some other code refactoring * Checking no-labels flag before printing log stream while tailing	6 years ago
Xiang Dai	72b9924368	Log error/debug info to stderr ... Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago