278 Commits (7effeec6424fcd670b8f7b2fe6ac19c7c78f44df)

Author	SHA1	Message	Date
Aditya C S	f41273182c	Support configurable maximum of the limits parameter (#1798)	6 years ago
Edward Welch	00ee652260	remove a few places we recommend the schema version and consolidate in the configuration doc ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Robert Fratto	18e828c705	Proposal: Promtail Push API (#1627) ... Co-Authored-By: Owen Diehl <ow.diehl@gmail.com>	6 years ago
Edward Welch	6841c418ef	promtail retry 429 rate limit errors, clarifying risks in the docs of configuring multiple client sections in promtail, also increased the backoff and retry settings in promtail. ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
vishesh92	30303c6a71	Docs: Update configuration docs for redis (#1843)	6 years ago
Jan-Philip Gehrcke	644d4beff7	docs: observability.md: clarify lines vs. entries (#1738) ... * docs: observability.md: vscode md format * docs: observability.md: clarify lines vs. entries Signed-off-by: Dr. Jan-Philip Gehrcke <jp@opstrace.com>	6 years ago
Brian Candler	f106c099bd	Recommended schema is now v11 ... Fixes #1778 Signed-off-by: Brian Candler <b.candler@pobox.com>	6 years ago
David Tennander	5139aa1867	Promtail: Ignore dropped entries in subsequent metric-stages in pipelines. (#1743) ... * Adds testcase for promtail that records metrics after a "match-drop". * Makes subsequent metrics stages in promtail ignore dropped entries. Before this change a "metric" stage after a "match" stage with `action: drop` would result in an error. This specifies the behavior in the docs and adds logic to ignore dropped entries.	6 years ago
Irake	8b8d3a4eec	docs: fix outdated link of fluentd (#1728)	6 years ago
Owen Diehl	414f95fedc	Literal Expressions in LogQL (#1677) ... * binops in ast * bin op associativity & precedence * binOpEvaluator work * defers close only if constructed without error * tests binary ops * more binops * updates docs * changelog * number literals in ast * [wip] literalExpr parsing * number parsing * signed literals * propagates evaluator close, handles healthchecks * literal evaluator works on non commutative operations * literalExprs cannot be used as legs of logical/set binops * removes comment * single literalExpr tests * reduces binops with literals in ast construction where possible * doc updates * scalar datatypes in logql * scalar serialization type * increases safety and reduces complexity in ast evaluator * recursive literal binop reduction parse test, improves parse errors on literal construction * vector + literal test	6 years ago
Aditya C S	460bb5b857	Support entire extracted value map in template pipeline stage (#1666) ... Refactor template stage processing. This sets all extracted key available, plus if the source is available adds the extra key `Value` for backward compatibility. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Signed-off-by: Aditya C S <aditya.gnu@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Owen Diehl	d6b85876ca	max line lengths (component + tenant overrides) (#1686) ... * bytesize flag support * max line limits * configurable tenant override options for max line size * bytesize yaml support * validator methods * distributor validator type * human friendly line size output, distributor test * invalid labels distributor test * docs + vendor * removes dead limits code	6 years ago
Cyril Tovena	4210fcef35	--dry-run Promtail. (#1652) ... * --dry-run Promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove changed on gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes flaky test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ensure position file is readonly when doing dry-run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add information about dry run mode in the troubleshooting section. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more spaces. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Edward Welch	0202884d27	Automatically prune metrics from the /metrics output of the promtail metrics pipeline stage after an idle period. ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Edward Welch	4aeeeea1c8	Allow a metric defined as a counter to match all lines, useful for creating line count metrics which include all your labels. ... Found a bug in the the test runner where it didn't fail if the actual error was nil but the test expected an error Added some tests to the counters to test valid configs Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Owen Diehl	2f5da72877	maintainer links & usernames (#1675)	6 years ago
Owen Diehl	6bbb61eb2f	Binary operators in LogQL (#1662) ... * binops in ast * bin op associativity & precedence * binOpEvaluator work * defers close only if constructed without error * tests binary ops * more binops * updates docs * changelog * better logql parsing errors for binops Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * adds ^ operator	6 years ago
Cyril Tovena	814cc87eb2	Pipe data to Promtail (#1649) ... * Adds readerTarget that read from io.Reader Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Updates comment and function names. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds stdin manager Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds default config with labels and support for static configs labels. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds a test with pipeline stages. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes race on shutdown and adds documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes deadlock on server.run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/clients/promtail/troubleshooting.md Co-Authored-By: Owen Diehl <ow.diehl@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * unlock mutex if Promtail.Run is called when Promtail is stopped Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	6 years ago
Cyril Tovena	0c08e3ee03	Add Owen to the maintainer team. (#1673) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Sho Okada	4b44e50dfe	Update tanka.md so that promtail.yml is in the correct format (#1671)	6 years ago
Oscar Santiago	72902af473	Correcte syntax of rate example (#1641) ... * Correcte syntax of rate example * Update docs/logql.md Co-Authored-By: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
kanata	d9e3defee8	loki-canary: fix indent of DaemonSet manifest written in .md file (#1648)	6 years ago
Aditya C S	b70f691cd4	Support custom prefix name in metrics stage (#1664)	6 years ago
Takayuki Watanabe	973b96d094	Unite docs for fluentd plugin (#1634) ... * Use original README.md for fluentd plugin explanations `doc/client/fluentd.m` includes obsolete explanations and it confuses new users. For example, label_keys option was removed at https://github.com/grafana/loki/pull/1186 but `fluentd.md` has the explanation. It's simple to maitain `fluentd/fluent-plugin-grafana-loki/README.md` for the explantion of the output plugin and use the link when we share how to use it. * Remove `label_keys` option and simplify usage for `drop_single_key` * Fix environment variable: FLUENT_CONFIG -> FLUENTD_CONFIG `docker-compose up` fails due to the wrong environment variable specifying the fluentd config. As a result this causes the following error ``` docker-compose up --build WARNING: The LOKI_USERNAME variable is not set. Defaulting to a blank string. WARNING: The LOKI_PASSWORD variable is not set. Defaulting to a blank string. Building fluentd Step 1/17 : FROM fluent/fluentd:v1.3.2-debian ---> 4790aaf4d1e5 Step 2/17 : USER root ---> Using cache ---> 7b54da6cec9e Step 3/17 : WORKDIR /home/fluent ---> Using cache ---> a161d2fcf64b Step 4/17 : ENV PATH /fluentd/vendor/bundle/ruby/2.3.0/bin:$PATH ---> Using cache ---> b67529aad0b5 Step 5/17 : ENV GEM_PATH /fluentd/vendor/bundle/ruby/2.3.0 ---> Using cache ---> 3a8b05beb185 Step 6/17 : ENV GEM_HOME /fluentd/vendor/bundle/ruby/2.3.0 ---> Using cache ---> d68a94345cb4 Step 7/17 : ENV FLUENTD_DISABLE_BUNDLER_INJECTION 1 ---> Using cache ---> 70f9bbf646e8 Step 8/17 : COPY docker/Gemfile* /fluentd/ ---> Using cache ---> 5f8b2f6ffe1a Step 9/17 : RUN buildDeps="sudo make gcc g++ libc-dev ruby-dev" && apt-get update && apt-get install -y --no-install-recommends $buildDeps libsystemd0 net-tools libjemalloc1 && gem install bundler --version 1.16.2 && bundle config silence_root_warning true && bundle install --gemfile=/fluentd/Gemfile --path=/fluentd/vendor/bundle && sudo gem sources --clear-all && SUDO_FORCE_REMOVE=yes apt-get purge -y --auto-remove -o APT::AutoRemove::RecommendsImportant=false $buildDeps && rm -rf /var/lib/apt/lists/* /home/fluent/.gem/ruby/2.3.0/cache/*.gem /tmp/* /var/tmp/* /usr/lib/ruby/gems/*/cache/*.gem ---> Using cache ---> 36c960a53c2c Step 10/17 : COPY docker/entrypoint.sh /fluentd/entrypoint.sh ---> Using cache ---> 7f8d72ae63ca Step 11/17 : COPY lib/fluent/plugin/out_loki.rb /fluentd/plugins/out_loki.rb ---> Using cache ---> d09473ee4f25 Step 12/17 : COPY docker/conf/ /fluentd/etc/loki/ ---> Using cache ---> 00d0439ef3c8 Step 13/17 : ENV FLUENTD_CONF="/fluentd/etc/loki/fluentd.conf" ---> Using cache ---> 2d33a002baaf Step 14/17 : ENV FLUENTD_OPT="" ---> Using cache ---> c314df064756 Step 15/17 : ENV LOKI_URL "https://logs-us-west1.grafana.net" ---> Using cache ---> df78c829d416 Step 16/17 : ENV LD_PRELOAD="/usr/lib/x86_64-linux-gnu/libjemalloc.so.1" ---> Using cache ---> 3d7d14cf37f5 Step 17/17 : ENTRYPOINT ["/fluentd/entrypoint.sh"] ---> Using cache ---> 82c70c2354ac Successfully built 82c70c2354ac Successfully tagged fluentd:loki Starting docker_fluentd_1 ... done Attaching to docker_fluentd_1 fluentd_1 | /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:769:in `initialize': No such file or directory @ rb_sysopen - /fluentd/etc/loki/fluentd.conf (Errno::ENOENT) fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:769:in `open' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:769:in `read_config' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:479:in `run_supervisor' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/command/fluentd.rb:314:in `<top (required)>' fluentd_1 | from /usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require' fluentd_1 | from /usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/bin/fluentd:8:in `<top (required)>' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/bin/fluentd:22:in `load' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/bin/fluentd:22:in `<main>' docker_fluentd_1 exited with code 1 ``` * Use docs/clients/fluentd/README.md for fluent-plugin-grafana-loki explanation * Arrange list order based on number * Revert "Fix environment variable: FLUENT_CONFIG -> FLUENTD_CONFIG" This reverts commit 8ed58ac97a82d5536321fb9a76120fed766ae506. * Elaborate the way to use docker image * Fix grammar: remove unnecessary with * Add disclaimer for multi-worker usage	6 years ago
Edward Welch	e18810949f	canary needs its logo ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Ed Welch	cb798635f5	Improve promtail configuration docs (#1602) ... * fixing the promtail stage name docs to match their actual stage names, added the docker and cri stages, clarified and improved the examples a little. Signed-off-by: Edward Welch <edward.welch@grafana.com> * fixing newlines Signed-off-by: Edward Welch <edward.welch@grafana.com> * Update docs/clients/promtail/configuration.md Co-Authored-By: Robert Fratto <robert.fratto@grafana.com> * Update docs/clients/promtail/configuration.md Co-Authored-By: Robert Fratto <robert.fratto@grafana.com> * addressing feedback Signed-off-by: Edward Welch <edward.welch@grafana.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	6 years ago
Edward Welch	a85ce664ea	improve systemd field docs ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
Cyril Tovena	93eb4ad27c	Add statistics to query_range and instant_query API. (#1615) ... * Refactor stats package to use proto. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Merge statistics in the frontend. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve engine logging. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes GRPC by rolling back Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add a test to verify stats in the LogQL engine. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Set circle ci build image to 0.9.1 which contains protobuf regression Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix drone CI. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Change timing data from nanoseconds to seconds like Prometheus. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve naming of stats Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move stats property under data property like Prometheus. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adjust queryrange frontend to use the new stats property Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Cleanup unused structs. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation for stats API. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Format proto file. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds missing godoc on logql.Result Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Shai Katz	39c28682c0	Dynamodb -> aws-dynamo (#1619)	6 years ago
Pablo Castellano	94dd7565c3	Recommend using the latest schema version (v11) (#1608)	6 years ago
Pedro Gomes	34b3a764c7	Fix wget syntax in documentation (#1609) ... * fix wget syntax in documentation * fix wget syntax in documentation	6 years ago
Owen Diehl	3e0ee04e7f	loki frontend docs additions (#1611) ... * loki frontend docs additions * s/cortex/loki/ Co-Authored-By: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/configuration/query-frontend.md Co-Authored-By: Cyril Tovena <cyril.tovena@gmail.com> * addresses pr comments * query frontend docs downstream via http, use 9091 as http port * removes grpc references in frontend yaml snippet * more comprehensive query frontend example description * makes query frontend example deployable alongside existing loki Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Robert Fratto	576e479090	docs: clarify rules around escaping backslashes in YAML (#1601) ... YAML treats backslashes in double-quoted strings differently than backslashes in non-double-quoted strings. This commit clarifies the behavior for the regex stage. Closes #1597	6 years ago
Cyril Tovena	f7ad6a18b6	Update tanka.md doc. (#1598) ... * Update tanka.md Fixed and tested see https://github.com/grafana/loki/issues/1591 * Update tanka.md * Update docs/installation/tanka.md Co-Authored-By: Robert Fratto <robert.fratto@grafana.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	6 years ago
hsraju	62cdc4a5cd	Updated configuration.md (#1504) ... Text error.	6 years ago
Peter Štibraný	d4cae667ae	loki: use new runtimeconfig package from Cortex (#1484) ... * loki: use new runtimeconfig package from Cortex runtimeconfig is a generalization of previous "overrides" mechanism, and can be used not for per-tenant limits, but other parts of Loki too (only one additional usage for now is "multi" KV client). Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * go mod tidy, go mod vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Removed RuntimeConfig from Ingester dependencies. Ingester already depends on RuntimeConfig via Store and Overrides mechanism. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Removed extra new line. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Remove unused method. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Fix broken code after rebasing. Removed incorrect comment. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated docs with section about runtime configuration. Mostly copied from Cortex. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * go mod tidy, go mod vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Updated Cortex to current master. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Go mod tidy, vendor Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	6 years ago
Owen Diehl	841befaf8e	Feature/query ingesters within (#1572) ... * querier.query-ingesters-within * avoids an unnecessary heapIter * updates changelog/config readme * variable reuse	6 years ago
Owen Diehl	5026dfea57	ingester.max-chunk-age (#1558) ... * ingester.max-chunk-age * bumps helm & changelog * adjusts max-chunk-age test * bumps wait period to let ci catch up * updates changelog	6 years ago
Pomazan Bogdan	83dfdf08c5	Update fluentd.md (#1561)	6 years ago
Ed Welch	5e527a03cc	1.3.0 Release (#1563) ... * updating changelog and versions for 1.3.0 release Signed-off-by: Edward Welch <edward.welch@grafana.com> * fixing incorrect quote Signed-off-by: Edward Welch <edward.welch@grafana.com>	6 years ago
robshep	731795ac0c	Update output.md ... Fix example.	6 years ago
Sandeep Sukhani	2ae8bb2bed	logcli: replaced GRAFANA_* with LOKI_* in logcli env vars, set default server url for logcli to localhost (#1492) ... * replaced GRAFANA_* with LOKI_* in logcli env vars, set default server url for logcli to localhost * add env var details in help text of logcli	6 years ago
Jamie Wiebe	a5d6bf9143	fix syntax error in pipeline example (#1539) ... the contents of metrics stages should be a map of string to metric, not a slice. See https://github.com/grafana/loki/blob/master/docs/clients/promtail/stages/metrics.md	6 years ago
Andrew Fitzgerald	4397415781	Add note on using Loki with ECS (#1531)	6 years ago
Xiang Dai	43ef52e89d	Add docker install doc (#1227) ... * Add docker install doc Signed-off-by: Xiang Dai <764524258@qq.com> * feedback Signed-off-by: Xiang Dai <764524258@qq.com>	6 years ago
Robert Fratto	bcbb1f294e	docs: Document timestamp ordering rules (#1521) ... Co-authored-by: Ed Welch <ed@oqqer.com>	6 years ago
Robert Fratto	5511de88b5	Link to release docs in README.md, not master docs (#1516) ... Co-authored-by: Ed Welch <ed@oqqer.com>	6 years ago
Cyril Tovena	5739150136	Fixes bad json in Loki API documentation. (#1508) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	6 years ago
Sandeep Sukhani	f1d431778b	fix sample yaml in docs for installing promtail to k8s (#1505)	6 years ago
Robert Fratto	9227eed9f4	pkg/ingester: limit total number of errors a stream can return on push (#1071) ... * pkg/ingester: limit total number of errors a stream can return on push * pkg/ingester: s/max_ignored_stream_errors/max_returned_stream_errors	6 years ago