514 Commits (e038d0fc3af9cc2adecbda81dbc39163be22ba11)

Author	SHA1	Message	Date
Takayuki Watanabe	e2a7941e32	Add server TLS certificate verification (#2171) ... * Add server TLS certificate verification * Generalize use of server TLS certificate verification * Fix typo * Bump fluent-plugin-grafana-loki gem version: 1.2.12 -> 1.2.13 * Replace option: verify_tls -> insecure_tls * Update document * Update docs/clients/fluentd/README.md Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Sandeep Sukhani	f04bc99e05	query tee proxy with support for comparison of responses (#2211)	5 years ago
Takayuki Watanabe	59f312545c	Improve fluentd plugin development experience (#2179) ... * Add Gemfile.lock and .rspec_status to .gitignore * Converge gem definition in gemspec file * Add missing `bundle exec` to README * s/FluentD/Fluentd/g	5 years ago
Periklis Tsirakidis	6e55277552	Add flag to disable tracing (#2191)	5 years ago
Owen Diehl	1530120c2e	Logql comparison ops (#2182) ... * comparison binops * starts comparison operator docs * implements bool modifier for comparison binops * vector-vector binop merging cases, including bool modifier * logql docs formatting * resets protos * linter fixes * goimports local * gofmt	5 years ago
Cyril Tovena	bedab491ac	Allows to change the log driver mode and buffer size. (#2116) ... Before those configs where not allowed, but docker can use them to have a different log delivery behaviour. see https://docs.docker.com/config/containers/logging/configure/#configure-the-delivery-mode-of-log-messages-from-container-to-log-driver Potentially fixes #2017 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	a01787af19	Update old link for pipeline stages. (#2172) ... Fixes #2165	5 years ago
Cyril Tovena	4c8199ec21	Validate local storage config for the logcli (#2126) ... * Allows to pass inlined pipeline stages to the docker driver. Fixes #1296 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add validation before using storage config for the logcli. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Martin Dojcak	b27f92e86b	Add FIFO queue persistent buffering for fluent bit output plugin (#2142) ... * Add FIFO queue persistent buffering for fluent bit output plugin * Fix configuration names in logging * Fix typos & suggested improvments	5 years ago
Aditya C S	360d9a7f97	Support querying labels on time range in logcli (#2083)	5 years ago
Or Sela	835dd29316	fluentd plugin: support placeholders in tenant field (#2074)	5 years ago
Cyril Tovena	c2f100c334	Allows to pass inlined pipeline stages to the docker driver. (#2076) ... * Allows to pass inlined pipeline stages to the docker driver. Fixes #1296 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * doc. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Bohdan Kmit	f5b9cffc2e	Docker driver: Allow to provision external pipeline files to plugin (#2054) ... * Use latest Alpine version * Allow to provision external pipeline files to plugin * Add custom pipeline documentation * Untabify on reviewer request Co-authored-by: Mike Futerko <mike@maytech.net>	5 years ago
Emil 'Skeen' Madsen	33a81528ec	fluent-plugin-loki: Restructuring and CI (#2006) ... * Move fluentd/fluent-plugin-grafana-loki to cmd/fluentd * Integrate fluentd with Makefile * Added drone-ci job for fluentd * Fix typo fluent-bit --> fluentd in .drone/drone.jsonnet Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> * Change default LOKI_URL in FluentD Dockerfile Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> * Utilize upstream configuration file * Test setup, adapt default configuration * Regen drone.yml * Change default label to job=fluentd, rather than env=dev Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Owen Diehl	2d31d07680	Revert "Update go from 1.13 to 1.14. (#2013)" (#2028) ... This reverts commit 8d6dc2c4ca.	5 years ago
Cyril Tovena	8d6dc2c4ca	Update go from 1.13 to 1.14. (#2013) ... * Update go from 1.13 to 1.14. See https://golang.org/doc/go1.14 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * modules.txt. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Ed Welch	c7a1a1fb2e	Loki: Adds an `interval` paramater to query_range queries allowing a sampling of events to be returned based on the provided interval (#1965) ... * Adds an `interval` paramater to query_range queries allowing a sampling of events to be returned based on the provided interval Signed-off-by: Ed Welch <edward.welch@grafana.com> * lint Signed-off-by: Ed Welch <edward.welch@grafana.com> * extract function for parsing parameter Signed-off-by: Ed Welch <edward.welch@grafana.com> * Clarify the experimental nature of interval in the docs. Signed-off-by: Ed Welch <edward.welch@grafana.com> * make min time a constant Signed-off-by: Ed Welch <edward.welch@grafana.com> * Expand the docs around the experimental nature of interval a little more Signed-off-by: Ed Welch <edward.welch@grafana.com>	5 years ago
Ed Welch	e90e3b769f	incorporate some better defaults into table-manager configs (#1976) ... * Set less aggressive poll interval and a larger grace period for creating new periodic tables in the ksonnet config. Add some rate limiting and retry settings for the table manager bigtable arguments. Signed-off-by: Ed Welch <edward.welch@grafana.com> * Removing the dynamodb provisioning of 0 from config files Signed-off-by: Ed Welch <edward.welch@grafana.com>	5 years ago
Ben Grabham	97788abcc5	[Loki]: Cleanup dockerfile (#1949) ... * Reduce the amount of layers and data in the Dockerfile * Change the loki user and data directory to match the default helm configuration * Add an nsswitch.conf to stop localhost DNS requests * Copy changes to Dockerfile.cross except setep setep is probably not needed anymore due to 3100 being the default port. Also, I'm not sure the amd64 binary works on other arch binaries. * Install ca-certificates earlier and split creating user and creating dir steps * Install libcap earlier and don't bother deleting it as it doesn't make the image smaller * Revert config changes * Revert the dockerfile changes needed for the config revert	5 years ago
Peter Štibraný	e60164bef6	Convert Loki modules to services (#1804) ... * Loki now uses module services to start and stop its work. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use services methods to initialize some components. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use Cortex' NewModuleService. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Converted server to a service. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Converted distributor to service. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use table manager service Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * querier service Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * query-frontend service Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Merged stopping method into shutdown Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Converted ingester to a service. It now starts all background tasks in Starting state. Stopping needs little work, as does reacting on lifecycler errors. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Loki Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * If lifecycler fails, ingester fails too. It now doesn't call os.Exit, but shuts down gracefully and enters Failed state. That triggers Loki to shutdown completely. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Ignore ErrStopProcess errors from services This is a signal that Loki should stop. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use single /ready handler It checks the state of all services, and asks ingester for its own check as well. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Removed unused value. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Lint Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix test. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Go mod tidy, vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Tailers, not trailers. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Adds return for the healtcheck in case of error. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	4a208ce6e6	Improve the local config to work locally and inside docker. (#1963) ... * Improve the local config to work locally and inside docker. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add a file specifically for docker loki config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	e4d78b984b	Log docker driver config map. (#1903) ... This will allow users to verify which config option are passed to the driver. See dicussions here https://github.com/grafana/loki/issues/1868, it seems that it can be confusing when using docker-compose. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Owen Diehl	e9789f7f99	adds config validation, similar to cortex (#1939)	5 years ago
Cyril Tovena	25aed2b889	Add no-file and keep-file log option for docker driver. (#1906) ... * Add no-file and keep-file option. By default no-file is false, this means the driver will create json log files that can be used to run `docker logs` command. If no-file is true, no files are created and so `docker log` won't work. This allow the ability to run the driver without caring of space left on the host. keep-file tells the driver to keep file even after the container has been stopped, by default this options is false. This means files are cleaned up once containers are stopped and not history is left to be used for `docker logs`. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback ! Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Mario Constanti	2c8251f1c9	logcli: org-id/tls-skip-verify set via env var (#1922) ... * command line flags --org-id and --tls-skip-verify could be also set via environment variables `LOKI_ORG_ID` and `LOKI_TLS_SKIP_VERIFY`	5 years ago
Cyril Tovena	0e53190e72	Add cap_net_bind_service linux capabilities to Loki. (#1916) ... * Add cap_net_bind_service linux capabilities to Loki. This allow Loki to bind to port below port 1024 without being a root user. Also update tanka to use 80 as default port since this is more intuitive to remember. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move setcap to build step Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Doesn't work inside the build step. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Set 3100 default port. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Again back to 80 :p Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Misha Gusarov	77da15c331	JSON encoding: avoid base64 encoding of []byte inside other slices (#1890) ... Closes #1889 Signed-off-by: Mikhail Gusarov <misha@ridge.co> (cherry picked from commit 3786d74273)	5 years ago
Misha Gusarov	3786d74273	JSON encoding: avoid base64 encoding of []byte inside other slices (#1890) ... Closes #1889 Signed-off-by: Mikhail Gusarov <misha@ridge.co>	5 years ago
Joe Elliott	383eb6e70b	Addition of a `/suspend` endpoint to Loki Canary (#1891) ... * First pass loki canary pause Signed-off-by: Joe Elliott <number101010@gmail.com> * Write suspending msg to stderr Signed-off-by: Joe Elliott <number101010@gmail.com> * Added resume endpoint Signed-off-by: Joe Elliott <number101010@gmail.com> * Added documentation on new endpoints Signed-off-by: Joe Elliott <number101010@gmail.com> * Pass both signals to the same channel Signed-off-by: Joe Elliott <number101010@gmail.com> * lint Signed-off-by: Joe Elliott <number101010@gmail.com> * Removed return on startCanary Signed-off-by: Joe Elliott <number101010@gmail.com>	5 years ago
Ben Ye	9a62deb829	Support series API in logcli (#1861) ... * support series API in logcli Signed-off-by: yeya24 <yb532204897@gmail.com> add changelog Signed-off-by: yeya24 <yb532204897@gmail.com> * update logcli docs Signed-off-by: yeya24 <yb532204897@gmail.com>	5 years ago
Robert Fratto	8948ce1f2e	clarify logcli commands and output (#1712) ... * clarify logcli commands and output This commit attempts to do two things: 1. Differentiate between log entries and raw log lines, where the latter is what is produced by `-oraw`. 2. Explain the difference between `logcli query` and `logcli instant-query`. Fixes #1676. * address feedback * address more feedback * explain that instant-query is not useful for log lines * address review feedback This commit leaves logcli.md unmodified; that will be done in a later commit if the changes are approved. * sync logcli.md with command output	5 years ago
Cyril Tovena	ba51aad551	Logcli remote storage. (#1814) ... * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Start hooking logcli with local storage config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes org-id and documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	fa51393bce	Move default port for Loki to 3100 everywhere. (#1838) ... Also fixes default value for the table manager that doesn't support 0 anymore on master. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Mario-Hofstaetter	2a03cde4f4	Change local storage directory to /loki/ and fix permissions (#1833) (#1834)	5 years ago
Cyril Tovena	a0dc10a03a	Use 8080 for Loki http port binding in tanka. (#1823) ... * Use 8080 for Loki http port binding. Previously we were using 80 but now that we run a rootless Loki for security reason. We can't bind below 1000. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update also docker file and default config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
sdojjy	0ad1c6c1af	loki can not be started with loki-local-config.yaml (#1816)	5 years ago
Cyril Tovena	59410dfb73	Improve fluentbit logfmt. (#1791) ... * Improve fluentbit logfmt. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * mod check. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	45b51ef8d8	Non-root user docker image for Loki. (#1706) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Aditya C S	5b1316ed0f	Fix loki exit on jaeger agent not being present (#1789)	5 years ago
Robert Fratto	ab4d885276	Fix 32-bit Promtail ARM docker builds from Drone (#1740) ... * link ld-linux-armhf.so.3 when building 32-bit arm promtail image if needed * Update .drone/drone.jsonnet Co-Authored-By: sh0rez <me@shorez.de> * review feedback Co-authored-by: sh0rez <me@shorez.de>	5 years ago
Aditya C S	a4d671b111	Fix panic error when AutoKubernetesLabels is true (#1717)	5 years ago
Aditya C S	f9ff2a4b02	Add goimport local-prefixes configuration to .golangci.yml (#1710)	5 years ago
dangoodman	f71504f0d4	Fix regex pipeline-example.yml (#1707) ... Backslashes must not be escaped inside single quotes: https://github.com/grafana/loki/blob/master/docs/clients/promtail/stages/regex.md#schema Spent an hour trying to figure out why no `level` tags assigned to my logs. Worked fine after the fix.	5 years ago
Cyril Tovena	4210fcef35	--dry-run Promtail. (#1652) ... * --dry-run Promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove changed on gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes flaky test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ensure position file is readonly when doing dry-run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add information about dry run mode in the troubleshooting section. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more spaces. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Aditya C S	636ed15c65	Fix logcli --quiet parameter parsing issue (#1682)	5 years ago
Cyril Tovena	814cc87eb2	Pipe data to Promtail (#1649) ... * Adds readerTarget that read from io.Reader Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Updates comment and function names. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds stdin manager Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds default config with labels and support for static configs labels. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds a test with pipeline stages. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes race on shutdown and adds documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes deadlock on server.run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/clients/promtail/troubleshooting.md Co-Authored-By: Owen Diehl <ow.diehl@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * unlock mutex if Promtail.Run is called when Promtail is stopped Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	5 years ago
Owen Diehl	80e938c412	adds query stats and org id options in logcli (#1638)	5 years ago
Cyril Tovena	93eb4ad27c	Add statistics to query_range and instant_query API. (#1615) ... * Refactor stats package to use proto. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Merge statistics in the frontend. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve engine logging. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes GRPC by rolling back Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add a test to verify stats in the LogQL engine. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Set circle ci build image to 0.9.1 which contains protobuf regression Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix drone CI. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Change timing data from nanoseconds to seconds like Prometheus. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve naming of stats Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move stats property under data property like Prometheus. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adjust queryrange frontend to use the new stats property Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Cleanup unused structs. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation for stats API. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Format proto file. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds missing godoc on logql.Result Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Pablo Castellano	94dd7565c3	Recommend using the latest schema version (v11) (#1608)	5 years ago
Peter Štibraný	2ad4d7aba3	Move chunks-inspect tool to Loki repo (#1577) ... * Move chunks-inspect tool to Loki repo Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added README.md Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added .gitignore. Added more description to README.md Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	5 years ago