1252 Commits (f9ff2a4b02832c7495f890abd2d73f4c8d44f1af)

 

All Branches   

Search

Author	SHA1	Message	Date
Aditya C S	f9ff2a4b02	Add goimport local-prefixes configuration to .golangci.yml (#1710)	5 years ago
Aditya C S	45d40a5c00	Fix panic in debug message (#1687)	5 years ago
Sho Okada	42fc522b3e	Add headers for WebSocket (#1689) ... * Add headers for WebSocket * Remove the OrgID * fix	5 years ago
dangoodman	f71504f0d4	Fix regex pipeline-example.yml (#1707) ... Backslashes must not be escaped inside single quotes: https://github.com/grafana/loki/blob/master/docs/clients/promtail/stages/regex.md#schema Spent an hour trying to figure out why no `level` tags assigned to my logs. Worked fine after the fix.	5 years ago
Owen Diehl	db6fd7e779	api support for scalars (#1704) ... * adds conversions to loghttp scalar types * logcli prints scalars, lothttp scalars use prometheus json marshaling	5 years ago
Owen Diehl	414f95fedc	Literal Expressions in LogQL (#1677) ... * binops in ast * bin op associativity & precedence * binOpEvaluator work * defers close only if constructed without error * tests binary ops * more binops * updates docs * changelog * number literals in ast * [wip] literalExpr parsing * number parsing * signed literals * propagates evaluator close, handles healthchecks * literal evaluator works on non commutative operations * literalExprs cannot be used as legs of logical/set binops * removes comment * single literalExpr tests * reduces binops with literals in ast construction where possible * doc updates * scalar datatypes in logql * scalar serialization type * increases safety and reduces complexity in ast evaluator * recursive literal binop reduction parse test, improves parse errors on literal construction * vector + literal test	5 years ago
Naoki Oketani	92ec0e5317	fix promtail/templates/NOTES.txt to show correctly port-forward command (#1697) ... Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Jeff Billimek	9fe1f13e3f	[promtail helm chart] Enable support for syslog service (#1617) ... * Enable support for dynamic extra ports This should allow the chart to be configured for extra exposed ports like syslog (port 1514) for example Signed-off-by: Jeff Billimek <jeff@billimek.com> * making syslog its own optional service Signed-off-by: Jeff Billimek <jeff@billimek.com> * syslogService config should be at top level Signed-off-by: Jeff Billimek <jeff@billimek.com> * fixing linting error Signed-off-by: Jeff Billimek <jeff@billimek.com> * Enhancing chart documentation with syslog example Signed-off-by: Jeff Billimek <jeffrey_k_billimek@homedepot.com>	5 years ago
Aditya C S	460bb5b857	Support entire extracted value map in template pipeline stage (#1666) ... Refactor template stage processing. This sets all extracted key available, plus if the source is available adds the extra key `Value` for backward compatibility. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Signed-off-by: Aditya C S <aditya.gnu@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Marco Pracucci	32d4f6c97b	Increased production distributors memory request and limit (#1699) ... Signed-off-by: Marco Pracucci <marco@pracucci.com>	5 years ago
Owen Diehl	d6b85876ca	max line lengths (component + tenant overrides) (#1686) ... * bytesize flag support * max line limits * configurable tenant override options for max line size * bytesize yaml support * validator methods * distributor validator type * human friendly line size output, distributor test * invalid labels distributor test * docs + vendor * removes dead limits code	5 years ago
Cyril Tovena	2f061f3a8a	Ensure status codes are set correctly in the frontend. (#1684) ... * Returns httpgrpc error in roundtriper. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ensure error codes are set correctly in the frontend. Previously we had cases where 400 would endup as 500. We should use httpgrpc.Errorf when possible. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	4210fcef35	--dry-run Promtail. (#1652) ... * --dry-run Promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove changed on gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes flaky test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ensure position file is readonly when doing dry-run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add information about dry run mode in the troubleshooting section. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more spaces. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes journaltarget refactor. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Aditya C S	636ed15c65	Fix logcli --quiet parameter parsing issue (#1682)	5 years ago
Cyril Tovena	24d9956653	This improves the log ouput for statistics in the logcli. (#1644) ... * This improves the log ouput for statistics in the logcli. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Please the linter Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Frédéric Barrière	250b7d5dc6	Loki stack helm chart can deploy datasources without Grafana (#1688)	5 years ago
Edward Welch	0202884d27	Automatically prune metrics from the /metrics output of the promtail metrics pipeline stage after an idle period. ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Edward Welch	4aeeeea1c8	Allow a metric defined as a counter to match all lines, useful for creating line count metrics which include all your labels. ... Found a bug in the the test runner where it didn't fail if the actual error was nil but the test expected an error Added some tests to the counters to test valid configs Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Owen Diehl	2f5da72877	maintainer links & usernames (#1675)	5 years ago
Owen Diehl	6bbb61eb2f	Binary operators in LogQL (#1662) ... * binops in ast * bin op associativity & precedence * binOpEvaluator work * defers close only if constructed without error * tests binary ops * more binops * updates docs * changelog * better logql parsing errors for binops Signed-off-by: Owen Diehl <ow.diehl@gmail.com> * adds ^ operator	5 years ago
Cyril Tovena	814cc87eb2	Pipe data to Promtail (#1649) ... * Adds readerTarget that read from io.Reader Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Updates comment and function names. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds stdin manager Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds default config with labels and support for static configs labels. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds a test with pipeline stages. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes race on shutdown and adds documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes deadlock on server.run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/clients/promtail/troubleshooting.md Co-Authored-By: Owen Diehl <ow.diehl@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * unlock mutex if Promtail.Run is called when Promtail is stopped Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	5 years ago
Cyril Tovena	0c08e3ee03	Add Owen to the maintainer team. (#1673) ... Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Sho Okada	4b44e50dfe	Update tanka.md so that promtail.yml is in the correct format (#1671)	5 years ago
Oscar Santiago	72902af473	Correcte syntax of rate example (#1641) ... * Correcte syntax of rate example * Update docs/logql.md Co-Authored-By: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	2af69cb57c	Frontend & Querier query statistics instrumentation. (#1661) ... * wip stats frontend Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * wip stats frontend Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Updates cortex and add a record metric function. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add some tests in the mix Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Removes unused tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Replace global by an injected interface. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds a test to make sure the stats middleware update response statistics. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
kanata	d9e3defee8	loki-canary: fix indent of DaemonSet manifest written in .md file (#1648)	5 years ago
Cyril Tovena	f25e42b058	Query frontend service should be headless. (#1665) ... Queriers need to connect to Pod IP discovered via headless service not a load balanced one. my bad, found by @pracucci @pstibrany.	5 years ago
Aditya C S	b70f691cd4	Support custom prefix name in metrics stage (#1664)	5 years ago
Robert Fratto	267dbe0085	pkg/promtail/positions: handle empty positions file (#1660) ... If the positions file is empty, unmarshaling it will lead to a nil map being created. This commit ensures that positions is always initialized to be non-nil. Potentially handles #1659.	5 years ago
Takayuki Watanabe	675a5f35fe	Convert second(Integer class) to nanosecond precision (#1656) ... * Convert time(Integer) to nanosecond precision * Bump gem version	5 years ago
Takayuki Watanabe	973b96d094	Unite docs for fluentd plugin (#1634) ... * Use original README.md for fluentd plugin explanations `doc/client/fluentd.m` includes obsolete explanations and it confuses new users. For example, label_keys option was removed at https://github.com/grafana/loki/pull/1186 but `fluentd.md` has the explanation. It's simple to maitain `fluentd/fluent-plugin-grafana-loki/README.md` for the explantion of the output plugin and use the link when we share how to use it. * Remove `label_keys` option and simplify usage for `drop_single_key` * Fix environment variable: FLUENT_CONFIG -> FLUENTD_CONFIG `docker-compose up` fails due to the wrong environment variable specifying the fluentd config. As a result this causes the following error ``` docker-compose up --build WARNING: The LOKI_USERNAME variable is not set. Defaulting to a blank string. WARNING: The LOKI_PASSWORD variable is not set. Defaulting to a blank string. Building fluentd Step 1/17 : FROM fluent/fluentd:v1.3.2-debian ---> 4790aaf4d1e5 Step 2/17 : USER root ---> Using cache ---> 7b54da6cec9e Step 3/17 : WORKDIR /home/fluent ---> Using cache ---> a161d2fcf64b Step 4/17 : ENV PATH /fluentd/vendor/bundle/ruby/2.3.0/bin:$PATH ---> Using cache ---> b67529aad0b5 Step 5/17 : ENV GEM_PATH /fluentd/vendor/bundle/ruby/2.3.0 ---> Using cache ---> 3a8b05beb185 Step 6/17 : ENV GEM_HOME /fluentd/vendor/bundle/ruby/2.3.0 ---> Using cache ---> d68a94345cb4 Step 7/17 : ENV FLUENTD_DISABLE_BUNDLER_INJECTION 1 ---> Using cache ---> 70f9bbf646e8 Step 8/17 : COPY docker/Gemfile* /fluentd/ ---> Using cache ---> 5f8b2f6ffe1a Step 9/17 : RUN buildDeps="sudo make gcc g++ libc-dev ruby-dev" && apt-get update && apt-get install -y --no-install-recommends $buildDeps libsystemd0 net-tools libjemalloc1 && gem install bundler --version 1.16.2 && bundle config silence_root_warning true && bundle install --gemfile=/fluentd/Gemfile --path=/fluentd/vendor/bundle && sudo gem sources --clear-all && SUDO_FORCE_REMOVE=yes apt-get purge -y --auto-remove -o APT::AutoRemove::RecommendsImportant=false $buildDeps && rm -rf /var/lib/apt/lists/* /home/fluent/.gem/ruby/2.3.0/cache/*.gem /tmp/* /var/tmp/* /usr/lib/ruby/gems/*/cache/*.gem ---> Using cache ---> 36c960a53c2c Step 10/17 : COPY docker/entrypoint.sh /fluentd/entrypoint.sh ---> Using cache ---> 7f8d72ae63ca Step 11/17 : COPY lib/fluent/plugin/out_loki.rb /fluentd/plugins/out_loki.rb ---> Using cache ---> d09473ee4f25 Step 12/17 : COPY docker/conf/ /fluentd/etc/loki/ ---> Using cache ---> 00d0439ef3c8 Step 13/17 : ENV FLUENTD_CONF="/fluentd/etc/loki/fluentd.conf" ---> Using cache ---> 2d33a002baaf Step 14/17 : ENV FLUENTD_OPT="" ---> Using cache ---> c314df064756 Step 15/17 : ENV LOKI_URL "https://logs-us-west1.grafana.net" ---> Using cache ---> df78c829d416 Step 16/17 : ENV LD_PRELOAD="/usr/lib/x86_64-linux-gnu/libjemalloc.so.1" ---> Using cache ---> 3d7d14cf37f5 Step 17/17 : ENTRYPOINT ["/fluentd/entrypoint.sh"] ---> Using cache ---> 82c70c2354ac Successfully built 82c70c2354ac Successfully tagged fluentd:loki Starting docker_fluentd_1 ... done Attaching to docker_fluentd_1 fluentd_1 | /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:769:in `initialize': No such file or directory @ rb_sysopen - /fluentd/etc/loki/fluentd.conf (Errno::ENOENT) fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:769:in `open' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:769:in `read_config' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:479:in `run_supervisor' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/command/fluentd.rb:314:in `<top (required)>' fluentd_1 | from /usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require' fluentd_1 | from /usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/bin/fluentd:8:in `<top (required)>' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/bin/fluentd:22:in `load' fluentd_1 | from /fluentd/vendor/bundle/ruby/2.3.0/bin/fluentd:22:in `<main>' docker_fluentd_1 exited with code 1 ``` * Use docs/clients/fluentd/README.md for fluent-plugin-grafana-loki explanation * Arrange list order based on number * Revert "Fix environment variable: FLUENT_CONFIG -> FLUENTD_CONFIG" This reverts commit 8ed58ac97a82d5536321fb9a76120fed766ae506. * Elaborate the way to use docker image * Fix grammar: remove unnecessary with * Add disclaimer for multi-worker usage	5 years ago
Edward Welch	e18810949f	canary needs its logo ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Matt Mendick	422a40b958	Attempting to add `informational` only feedback for codecov (#1647) ... An attempt to try to add the `informational` flag (to not fail build steps) for the `codecov/patch` portion of the build steps. This is _not_ in their documentation, but there are lots of other things not correct in their documentation as noted on their community site, so I'm going to try this. Otherwise, I will submit another PR to turn the codecov/patch off and we'll just have stats for the whole project.	5 years ago
Owen Diehl	e0a77656fd	removes duplicate logRangeExprExt grammar (#1651) ... * removes duplicate logRangeExprExt grammar * linting errors	5 years ago
luki	9ecdcf5151	Added support for imagePullSecrets in Loki Helm chart (#1632) ... * Added support for imagePullSecrets in Loki Helm chart * Updating only path version for loki charts	5 years ago
Takayuki Watanabe	8f8cb80a11	Fix rubocop violation for fluentd/fluent-plugin-loki (#1646) ... * Don't use sudo to install bundler Follow [the official installation docs](https://github.com/rubygems/bundler#installation-and-usage). * Fix rubocop viloation: kind_of? -> is_a? ``` lib/fluent/plugin/out_loki.rb:76:21: C: Style/ClassCheck: Prefer Object#is_a? over Object#kind_of?. unless @uri.kind_of?(URI::HTTP) or @uri.kind_of?(URI::HTTPS) ^^^^^^^^ ``` * Fix rubocop violation ``` lib/fluent/plugin/out_loki.rb:78:9: C: Layout/EmptyLineAfterGuardClause: Add empty line after guard clause. end ``` * Fix rubocup violation: or -> || ``` lib/fluent/plugin/out_loki.rb:76:38: C: Style/AndOr: Use || instead of or. unless @uri.is_a?(URI::HTTP) or @uri.is_a?(URI::HTTPS) ^^ ``` * Fix rubocop violation: use single quoate ``` lib/fluent/plugin/out_loki.rb:77:38: C: Style/StringLiterals: Prefer single-quoted strings when you don't need string interpolation or special symbols. raise Fluent::ConfigError, "url parameter must be valid HTTP" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ``` * Ignore rubocop violation: configure method is still not complex Both rubocop and rspec fail with the current codes. Except for this rubocop violation, they were fixed. this cyclomatic complexity violation occurrs in configure method. However, it's still simple and the implementation could be changed during spec fixation. So, this violation should be ignored at this moment. ``` lib/fluent/plugin/out_loki.rb:72:7: C: Metrics/CyclomaticComplexity: Cyclomatic complexity for configure is too high. [7/6] def configure(conf) ... ^^^^^^^^^^^^^^^^^^^ ```	5 years ago
Ed Welch	cb798635f5	Improve promtail configuration docs (#1602) ... * fixing the promtail stage name docs to match their actual stage names, added the docker and cri stages, clarified and improved the examples a little. Signed-off-by: Edward Welch <edward.welch@grafana.com> * fixing newlines Signed-off-by: Edward Welch <edward.welch@grafana.com> * Update docs/clients/promtail/configuration.md Co-Authored-By: Robert Fratto <robert.fratto@grafana.com> * Update docs/clients/promtail/configuration.md Co-Authored-By: Robert Fratto <robert.fratto@grafana.com> * addressing feedback Signed-off-by: Edward Welch <edward.welch@grafana.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	5 years ago
Owen Diehl	80e938c412	adds query stats and org id options in logcli (#1638)	5 years ago
Edward Welch	a85ce664ea	improve systemd field docs ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Robert Fratto	784c4ce232	ci: print error when getting tags fails (#1640) ... This commit also removes fatal logs. The pruning process isn't essential and should generally never cause the CI to report failure.	5 years ago
Robert Fratto	1fe5dc45b3	ci: prune docker tags prefixed with "master-" older than 90 days on merge (#1639)	5 years ago
Cyril Tovena	375fc86af7	Fixes stats summary computation. (#1636) ... * Fixes stats summary computation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes division by zero Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Robert Fratto	d1ae91cea7	ci: pin plugins/manifest image tag (#1637)	5 years ago
Aboubacar Toure	d83061279f	Promtail Helm Chart: Add support for extra environment variables (#1529) ... * Make Promtail's Helm chart support passing extra env variables * bump charts versions	5 years ago
Robert Fratto	f1dc58c48d	ci: make manifest publishing run serially	5 years ago
Owen Diehl	6930fb2a5c	adds stringer methods for all ast expr types (#1630) ... * adds stringer methods for all ast expr types * Update pkg/logql/ast.go Co-Authored-By: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Edward Welch	a135652e69	ignore markdown in codecoverage ... Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Robert Fratto	cf6fad29d4	Exempt proposals from stale bot (#1628) ... I think proposals should be something we always take a look at and decide to close manually.	5 years ago
Cyril Tovena	93eb4ad27c	Add statistics to query_range and instant_query API. (#1615) ... * Refactor stats package to use proto. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Merge statistics in the frontend. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve engine logging. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes GRPC by rolling back Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add a test to verify stats in the LogQL engine. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Set circle ci build image to 0.9.1 which contains protobuf regression Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix drone CI. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Change timing data from nanoseconds to seconds like Prometheus. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve naming of stats Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move stats property under data property like Prometheus. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adjust queryrange frontend to use the new stats property Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Cleanup unused structs. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation for stats API. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Format proto file. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds missing godoc on logql.Result Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Owen Diehl	1773900659	compiler guarantees for logql exprs (#1626)	5 years ago