apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Cyril Tovena	814cc87eb2	Pipe data to Promtail (#1649 ) * Adds readerTarget that read from io.Reader Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Updates comment and function names. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds stdin manager Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add more tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds default config with labels and support for static configs labels. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds a test with pipeline stages. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes race on shutdown and adds documentation Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes deadlock on server.run Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/clients/promtail/troubleshooting.md Co-Authored-By: Owen Diehl <ow.diehl@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * gofmt Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * unlock mutex if Promtail.Run is called when Promtail is stopped Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	5 years ago
Cyril Tovena	0c08e3ee03	Add Owen to the maintainer team. (#1673 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Sho Okada	4b44e50dfe	Update tanka.md so that promtail.yml is in the correct format (#1671 )	5 years ago
Oscar Santiago	72902af473	Correcte syntax of rate example (#1641 ) * Correcte syntax of rate example * Update docs/logql.md Co-Authored-By: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	2af69cb57c	Frontend & Querier query statistics instrumentation. (#1661 ) * wip stats frontend Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * wip stats frontend Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * wip Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Updates cortex and add a record metric function. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add some tests in the mix Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Removes unused tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Replace global by an injected interface. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds a test to make sure the stats middleware update response statistics. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
kanata	d9e3defee8	loki-canary: fix indent of DaemonSet manifest written in .md file (#1648 )	5 years ago
Cyril Tovena	f25e42b058	Query frontend service should be headless. (#1665 ) Queriers need to connect to Pod IP discovered via headless service not a load balanced one. my bad, found by @pracucci @pstibrany.	5 years ago
Aditya C S	b70f691cd4	Support custom prefix name in metrics stage (#1664 )	5 years ago
Robert Fratto	267dbe0085	pkg/promtail/positions: handle empty positions file (#1660 ) If the positions file is empty, unmarshaling it will lead to a nil map being created. This commit ensures that positions is always initialized to be non-nil. Potentially handles #1659.	5 years ago
Takayuki Watanabe	675a5f35fe	Convert second(Integer class) to nanosecond precision (#1656 ) * Convert time(Integer) to nanosecond precision * Bump gem version	5 years ago
Takayuki Watanabe	973b96d094	Unite docs for fluentd plugin (#1634 ) * Use original README.md for fluentd plugin explanations `doc/client/fluentd.m` includes obsolete explanations and it confuses new users. For example, label_keys option was removed at https://github.com/grafana/loki/pull/1186 but `fluentd.md` has the explanation. It's simple to maitain `fluentd/fluent-plugin-grafana-loki/README.md` for the explantion of the output plugin and use the link when we share how to use it. * Remove `label_keys` option and simplify usage for `drop_single_key` * Fix environment variable: FLUENT_CONFIG -> FLUENTD_CONFIG `docker-compose up` fails due to the wrong environment variable specifying the fluentd config. As a result this causes the following error ``` docker-compose up --build WARNING: The LOKI_USERNAME variable is not set. Defaulting to a blank string. WARNING: The LOKI_PASSWORD variable is not set. Defaulting to a blank string. Building fluentd Step 1/17 : FROM fluent/fluentd:v1.3.2-debian ---> 4790aaf4d1e5 Step 2/17 : USER root ---> Using cache ---> 7b54da6cec9e Step 3/17 : WORKDIR /home/fluent ---> Using cache ---> a161d2fcf64b Step 4/17 : ENV PATH /fluentd/vendor/bundle/ruby/2.3.0/bin:$PATH ---> Using cache ---> b67529aad0b5 Step 5/17 : ENV GEM_PATH /fluentd/vendor/bundle/ruby/2.3.0 ---> Using cache ---> 3a8b05beb185 Step 6/17 : ENV GEM_HOME /fluentd/vendor/bundle/ruby/2.3.0 ---> Using cache ---> d68a94345cb4 Step 7/17 : ENV FLUENTD_DISABLE_BUNDLER_INJECTION 1 ---> Using cache ---> 70f9bbf646e8 Step 8/17 : COPY docker/Gemfile* /fluentd/ ---> Using cache ---> 5f8b2f6ffe1a Step 9/17 : RUN buildDeps="sudo make gcc g++ libc-dev ruby-dev" && apt-get update && apt-get install -y --no-install-recommends $buildDeps libsystemd0 net-tools libjemalloc1 && gem install bundler --version 1.16.2 && bundle config silence_root_warning true && bundle install --gemfile=/fluentd/Gemfile --path=/fluentd/vendor/bundle && sudo gem sources --clear-all && SUDO_FORCE_REMOVE=yes apt-get purge -y --auto-remove -o APT::AutoRemove::RecommendsImportant=false $buildDeps && rm -rf /var/lib/apt/lists/* /home/fluent/.gem/ruby/2.3.0/cache/.gem /tmp/ /var/tmp/* /usr/lib/ruby/gems//cache/.gem ---> Using cache ---> 36c960a53c2c Step 10/17 : COPY docker/entrypoint.sh /fluentd/entrypoint.sh ---> Using cache ---> 7f8d72ae63ca Step 11/17 : COPY lib/fluent/plugin/out_loki.rb /fluentd/plugins/out_loki.rb ---> Using cache ---> d09473ee4f25 Step 12/17 : COPY docker/conf/ /fluentd/etc/loki/ ---> Using cache ---> 00d0439ef3c8 Step 13/17 : ENV FLUENTD_CONF="/fluentd/etc/loki/fluentd.conf" ---> Using cache ---> 2d33a002baaf Step 14/17 : ENV FLUENTD_OPT="" ---> Using cache ---> c314df064756 Step 15/17 : ENV LOKI_URL "https://logs-us-west1.grafana.net" ---> Using cache ---> df78c829d416 Step 16/17 : ENV LD_PRELOAD="/usr/lib/x86_64-linux-gnu/libjemalloc.so.1" ---> Using cache ---> 3d7d14cf37f5 Step 17/17 : ENTRYPOINT ["/fluentd/entrypoint.sh"] ---> Using cache ---> 82c70c2354ac Successfully built 82c70c2354ac Successfully tagged fluentd:loki Starting docker_fluentd_1 ... done Attaching to docker_fluentd_1 fluentd_1 \| /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:769:in `initialize': No such file or directory @ rb_sysopen - /fluentd/etc/loki/fluentd.conf (Errno::ENOENT) fluentd_1 \| from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:769:in `open' fluentd_1 \| from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:769:in `read_config' fluentd_1 \| from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/supervisor.rb:479:in `run_supervisor' fluentd_1 \| from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/lib/fluent/command/fluentd.rb:314:in `<top (required)>' fluentd_1 \| from /usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require' fluentd_1 \| from /usr/lib/ruby/2.3.0/rubygems/core_ext/kernel_require.rb:55:in `require' fluentd_1 \| from /fluentd/vendor/bundle/ruby/2.3.0/gems/fluentd-1.6.2/bin/fluentd:8:in `<top (required)>' fluentd_1 \| from /fluentd/vendor/bundle/ruby/2.3.0/bin/fluentd:22:in `load' fluentd_1 \| from /fluentd/vendor/bundle/ruby/2.3.0/bin/fluentd:22:in `<main>' docker_fluentd_1 exited with code 1 ``` * Use docs/clients/fluentd/README.md for fluent-plugin-grafana-loki explanation * Arrange list order based on number * Revert "Fix environment variable: FLUENT_CONFIG -> FLUENTD_CONFIG" This reverts commit 8ed58ac97a82d5536321fb9a76120fed766ae506. * Elaborate the way to use docker image * Fix grammar: remove unnecessary with * Add disclaimer for multi-worker usage	5 years ago
Edward Welch	e18810949f	canary needs its logo Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Matt Mendick	422a40b958	Attempting to add `informational` only feedback for codecov (#1647 ) An attempt to try to add the `informational` flag (to not fail build steps) for the `codecov/patch` portion of the build steps. This is _not_ in their documentation, but there are lots of other things not correct in their documentation as noted on their community site, so I'm going to try this. Otherwise, I will submit another PR to turn the codecov/patch off and we'll just have stats for the whole project.	5 years ago
Owen Diehl	e0a77656fd	removes duplicate logRangeExprExt grammar (#1651 ) * removes duplicate logRangeExprExt grammar * linting errors	5 years ago
luki	9ecdcf5151	Added support for imagePullSecrets in Loki Helm chart (#1632 ) * Added support for imagePullSecrets in Loki Helm chart * Updating only path version for loki charts	5 years ago
Takayuki Watanabe	8f8cb80a11	Fix rubocop violation for fluentd/fluent-plugin-loki (#1646 ) * Don't use sudo to install bundler Follow [the official installation docs](https://github.com/rubygems/bundler#installation-and-usage). * Fix rubocop viloation: kind_of? -> is_a? ``` lib/fluent/plugin/out_loki.rb:76:21: C: Style/ClassCheck: Prefer Object#is_a? over Object#kind_of?. unless @uri.kind_of?(URI::HTTP) or @uri.kind_of?(URI::HTTPS) ^^^^^^^^ ``` * Fix rubocop violation ``` lib/fluent/plugin/out_loki.rb:78:9: C: Layout/EmptyLineAfterGuardClause: Add empty line after guard clause. end ``` * Fix rubocup violation: or -> \|\| ``` lib/fluent/plugin/out_loki.rb:76:38: C: Style/AndOr: Use \|\| instead of or. unless @uri.is_a?(URI::HTTP) or @uri.is_a?(URI::HTTPS) ^^ ``` * Fix rubocop violation: use single quoate ``` lib/fluent/plugin/out_loki.rb:77:38: C: Style/StringLiterals: Prefer single-quoted strings when you don't need string interpolation or special symbols. raise Fluent::ConfigError, "url parameter must be valid HTTP" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ``` * Ignore rubocop violation: configure method is still not complex Both rubocop and rspec fail with the current codes. Except for this rubocop violation, they were fixed. this cyclomatic complexity violation occurrs in configure method. However, it's still simple and the implementation could be changed during spec fixation. So, this violation should be ignored at this moment. ``` lib/fluent/plugin/out_loki.rb:72:7: C: Metrics/CyclomaticComplexity: Cyclomatic complexity for configure is too high. [7/6] def configure(conf) ... ^^^^^^^^^^^^^^^^^^^ ```	5 years ago
Ed Welch	cb798635f5	Improve promtail configuration docs (#1602 ) * fixing the promtail stage name docs to match their actual stage names, added the docker and cri stages, clarified and improved the examples a little. Signed-off-by: Edward Welch <edward.welch@grafana.com> * fixing newlines Signed-off-by: Edward Welch <edward.welch@grafana.com> * Update docs/clients/promtail/configuration.md Co-Authored-By: Robert Fratto <robert.fratto@grafana.com> * Update docs/clients/promtail/configuration.md Co-Authored-By: Robert Fratto <robert.fratto@grafana.com> * addressing feedback Signed-off-by: Edward Welch <edward.welch@grafana.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	5 years ago
Owen Diehl	80e938c412	adds query stats and org id options in logcli (#1638 )	5 years ago
Edward Welch	a85ce664ea	improve systemd field docs Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Robert Fratto	784c4ce232	ci: print error when getting tags fails (#1640 ) This commit also removes fatal logs. The pruning process isn't essential and should generally never cause the CI to report failure.	5 years ago
Robert Fratto	1fe5dc45b3	ci: prune docker tags prefixed with "master-" older than 90 days on merge (#1639 )	5 years ago
Cyril Tovena	375fc86af7	Fixes stats summary computation. (#1636 ) * Fixes stats summary computation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes division by zero Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Robert Fratto	d1ae91cea7	ci: pin plugins/manifest image tag (#1637 )	5 years ago
Aboubacar Toure	d83061279f	Promtail Helm Chart: Add support for extra environment variables (#1529 ) * Make Promtail's Helm chart support passing extra env variables * bump charts versions	5 years ago
Robert Fratto	f1dc58c48d	ci: make manifest publishing run serially	5 years ago
Owen Diehl	6930fb2a5c	adds stringer methods for all ast expr types (#1630 ) * adds stringer methods for all ast expr types * Update pkg/logql/ast.go Co-Authored-By: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Edward Welch	a135652e69	ignore markdown in codecoverage Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Robert Fratto	cf6fad29d4	Exempt proposals from stale bot (#1628 ) I think proposals should be something we always take a look at and decide to close manually.	5 years ago
Cyril Tovena	93eb4ad27c	Add statistics to query_range and instant_query API. (#1615 ) * Refactor stats package to use proto. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Merge statistics in the frontend. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve engine logging. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes GRPC by rolling back Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add a test to verify stats in the LogQL engine. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Set circle ci build image to 0.9.1 which contains protobuf regression Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix drone CI. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Change timing data from nanoseconds to seconds like Prometheus. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve naming of stats Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move stats property under data property like Prometheus. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adjust queryrange frontend to use the new stats property Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Cleanup unused structs. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation for stats API. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Format proto file. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds missing godoc on logql.Result Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Owen Diehl	1773900659	compiler guarantees for logql exprs (#1626 )	5 years ago
Shai Katz	39c28682c0	Dynamodb -> aws-dynamo (#1619 )	5 years ago
Roger Steneteg	87c2afceff	added ability to configure kernel setting fs.inotify.max_user_instances through init container to resolve issue with too many open files (#1620 ) Signed-off-by: Roger Steneteg <rsteneteg@ea.com>	5 years ago
Owen Diehl	a53477f8e4	cache key cant be reused when an interval changes (#1616 )	5 years ago
Pablo Castellano	94dd7565c3	Recommend using the latest schema version (v11) (#1608 )	5 years ago
Pedro Gomes	34b3a764c7	Fix wget syntax in documentation (#1609 ) * fix wget syntax in documentation * fix wget syntax in documentation	5 years ago
Owen Diehl	3e0ee04e7f	loki frontend docs additions (#1611 ) * loki frontend docs additions * s/cortex/loki/ Co-Authored-By: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/configuration/query-frontend.md Co-Authored-By: Cyril Tovena <cyril.tovena@gmail.com> * addresses pr comments * query frontend docs downstream via http, use 9091 as http port * removes grpc references in frontend yaml snippet * more comprehensive query frontend example description * makes query frontend example deployable alongside existing loki Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Owen Diehl	3e075497cd	Feature/per tenant splitby (#1565 ) * split by overrides by tenant * tenant aware metric query splitting * consistent split_queries_by_interval naming * updates readme * fixes rebase conflict * refactor to support limit based splitby intervals in all locations * simplifies limits cachesplitter * fixes comment	5 years ago
Cyril Tovena	891eae9af8	Fixes config change in the result cache (#1613 ) Since https://github.com/grafana/loki/pull/1612 we don't need the cache_split_interval anymore.	5 years ago
Matt Mendick	acb18b4f5d	Update codecov to add informational flag (#1614 ) Setting the `informational` flag for the project so that we don't mark the checks as failed if the patch percentage is 0. See https://github.com/grafana/loki/pull/1612/commits for an example of a failure when it should really just tell us the information.	5 years ago
Owen Diehl	018e6bcdfd	bumps cortex to 0.6.1 master (#1612 )	5 years ago
Owen Diehl	b7d23f41bd	Decouple logql engine/AST from execution context (#1605 ) * logql engine is an interface * [wip] begins agnostic logql evaluator work * decouples logql AST from execution context * healthcheck comments	5 years ago
Robert Fratto	576e479090	docs: clarify rules around escaping backslashes in YAML (#1601 ) YAML treats backslashes in double-quoted strings differently than backslashes in non-double-quoted strings. This commit clarifies the behavior for the regex stage. Closes #1597	5 years ago
Sándor Guba	c793d7df8e	add URI validation (#1603 )	5 years ago
Matt Mendick	0adad827a9	Codecov circleci test [WIP] (#1600 ) * Trying to get circle to run some tests/coverage * Trying again * Misspelling * Adding codecov.yml Adding codecov.yml with defaults, and adding in ignoring protobuf generated files * Adding yacc generated files to codecov ignore Adding yacc generated files to codecov ignore * Newline? Newline?	5 years ago
Cyril Tovena	f7ad6a18b6	Update tanka.md doc. (#1598 ) * Update tanka.md Fixed and tested see https://github.com/grafana/loki/issues/1591 * Update tanka.md * Update docs/installation/tanka.md Co-Authored-By: Robert Fratto <robert.fratto@grafana.com> Co-authored-by: Robert Fratto <robertfratto@gmail.com>	5 years ago
Peter Štibraný	2ad4d7aba3	Move chunks-inspect tool to Loki repo (#1577 ) * Move chunks-inspect tool to Loki repo Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added README.md Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added .gitignore. Added more description to README.md Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	5 years ago
André Bauer	b6f1088245	[loki helm chart] added ingress (#1585 ) * added ingress template Signed-off-by: André Bauer <andre.bauer@kiwigrid.com> * raised loki-stack chart version to 0.29.0 Signed-off-by: André Bauer <andre.bauer@kiwigrid.com>	5 years ago
polar3130	50c216a7b4	Helm/loki-stack: refresh default grafana.image.tag to 6.6.0 (#1590 ) * update grafana.image.tag in loki-stack' helm chart * bump the chart loki-stack version	5 years ago
polar3130	e642c28d93	Helm/loki-stack: add template for the service name to connect to loki (#1587 ) * add helper for the service name to connect to loki * Bump loki-chart version. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Ian L	cfaf89bdad	Fix typo in changelog for 1.3.0 (#1586 ) The last release was in December 2019. 1.3.0 was released in January 2020, not 2019.	5 years ago

1 2 3 4 5 ...

1232 Commits (814cc87eb2e1175b9664ef2137130e725705cf32) All Branches Search

1232 Commits (814cc87eb2e1175b9664ef2137130e725705cf32)

All Branches