apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Cyril Tovena	b27894fbf4	Adds the ability to hedge storage requests. (#4826 ) * Adds the ability to hedge request for all backends Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove race from tests Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove the race Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove the race Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Testing Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * More testing Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Setup credentials to avoid auth Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * improve tests Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * changelog Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Group the configuration Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	c6d3228263	Correctly set string in env variable in jsonnet (#4847 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	fc3ef3e7ce	Allow to set JAEGER_REPORTER_MAX_QUEUE_SIZE globally. (#4843 ) * Allow to set JAEGER_REPORTER_MAX_QUEUE_SIZE globally. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update production/ksonnet/loki/config.libsonnet	4 years ago
Cyril Tovena	54dc737583	Reduce tracing spans (#4842 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Danny Kopping	90cc715c3a	Allow for setting of per-tenant runtime configs (#4840 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Danny Kopping	4b1a09e91e	Set alert to fire after 15m, to match message (#4839 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
David Heinrich	29f2a09b0c	Loki mixin: Add grafonnet-lib as dependency (#4811 )	4 years ago
Hiroki Sakamoto	d7c35951c3	Use http prefix path correctly in promtail (#4832 ) * Use http prefix path correctly in promtail * Update changelog entry	4 years ago
Tom Wilkie	82c91641df	Use dependabot to keep gomod dependancies up to date. (#4834 ) Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	4 years ago
Callum Styan	10d4d4dc2b	Add a stat panel function so we can more easily create grid layouts via (#4836 ) the loki dashboard utils. Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Marco Pracucci	2b0d020146	Refactor pkg/util/server to avoid cortexpb import in downstream projects vendoring logql (#4833 ) Signed-off-by: Marco Pracucci <marco@pracucci.com>	4 years ago
Cyril Tovena	0a944670ef	Improve LogQL format stages requireLabel (#4769 ) * Improve LogQL format stages. This only includes required labels. ``` ➜ go test -benchmem -run=^$ -bench ^Benchmark_Pipeline ./pkg/logql/log -v -count 5 > after.txt && benchstat before.txt after.txt name old time/op new time/op delta _Pipeline/pipeline_bytes-16 13.8µs ± 6% 11.5µs ± 1% -16.42% (p=0.008 n=5+5) _Pipeline/pipeline_string-16 13.9µs ± 2% 11.5µs ± 2% -17.27% (p=0.008 n=5+5) _Pipeline/line_extractor_bytes-16 14.0µs ± 4% 11.6µs ± 0% -17.45% (p=0.016 n=5+4) _Pipeline/line_extractor_string-16 13.5µs ± 0% 11.5µs ± 0% -14.67% (p=0.008 n=5+5) _Pipeline/label_extractor_bytes-16 13.7µs ± 1% 11.7µs ± 1% -14.69% (p=0.008 n=5+5) _Pipeline/label_extractor_string-16 14.1µs ±11% 11.6µs ± 0% -17.89% (p=0.008 n=5+5) name old alloc/op new alloc/op delta _Pipeline/pipeline_bytes-16 9.51kB ± 0% 7.50kB ± 0% -21.19% (p=0.008 n=5+5) _Pipeline/pipeline_string-16 9.51kB ± 0% 7.50kB ± 0% -21.19% (p=0.008 n=5+5) _Pipeline/line_extractor_bytes-16 9.51kB ± 0% 7.50kB ± 0% -21.19% (p=0.008 n=5+5) _Pipeline/line_extractor_string-16 9.51kB ± 0% 7.50kB ± 0% ~ (p=0.079 n=4+5) _Pipeline/label_extractor_bytes-16 9.51kB ± 0% 7.50kB ± 0% -21.18% (p=0.008 n=5+5) _Pipeline/label_extractor_string-16 9.51kB ± 0% 7.50kB ± 0% -21.18% (p=0.008 n=5+5) name old allocs/op new allocs/op delta _Pipeline/pipeline_bytes-16 46.0 ± 0% 45.0 ± 0% -2.17% (p=0.008 n=5+5) _Pipeline/pipeline_string-16 46.0 ± 0% 45.0 ± 0% -2.17% (p=0.008 n=5+5) _Pipeline/line_extractor_bytes-16 46.0 ± 0% 45.0 ± 0% -2.17% (p=0.008 n=5+5) _Pipeline/line_extractor_string-16 46.0 ± 0% 45.0 ± 0% -2.17% (p=0.008 n=5+5) _Pipeline/label_extractor_bytes-16 46.0 ± 0% 45.0 ± 0% -2.17% (p=0.008 n=5+5) _Pipeline/label_extractor_string-16 46.0 ± 0% 45.0 ± 0% -2.17% (p=0.008 n=5+5) ``` Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * rollback model change Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * remove unused variable Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Dylan Guedes	347e3e37cf	Loki: Implement custom /config handler (#4785 ) * Implement custom /config handler. * Make `customConfigEndpointHandlerFn` public.	4 years ago
Hiroki Sakamoto	11bf736c90	Refactor tests of Promtail filetarget (#4802 ) * Refactor tests of Promtail filetarget * Move tests depend on inotify to filetargetmanager test * Add handling file creation event via channel case in filetarget test * Use Eventually function for waiting	4 years ago
Michel Hollands	e69ceefd84	Add LabelFilterer and Store wrapper (#4818 ) * Add LabelFilterer and Store wrapper Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Address review comments Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	4 years ago
Marco Pracucci	c53457feb9	Upgrade Cortex, Prometheus and Thanos (#4830 ) * Upgrade Cortex, Prometheus and Thanos Signed-off-by: Marco Pracucci <marco@pracucci.com> * Fixed imported ordering Signed-off-by: Marco Pracucci <marco@pracucci.com> * Fixed data type used for series ref when recovering from checkpoint/WAL Signed-off-by: Marco Pracucci <marco@pracucci.com> * Upgraded Thanos to fix arm build Signed-off-by: Marco Pracucci <marco@pracucci.com> * Run go mod tidy Signed-off-by: Marco Pracucci <marco@pracucci.com>	4 years ago
Kaviraj	1b63331e3d	Add support for `X-Query-Tags` (#4814 ) * Add support for `X-Query-Tags` 1. Now client can send any metadata about query via `X-Query-Tags` HTTP header 2. Also record `X-Query-Tags` in `metrics.go` for instant and range queries. * PR remarks * Make linter happy * Fix middleware next * Make safe parsing of the header * Add bit more test cases * Minor suggestions * Add middleware chain to querier handlers * Repopulate the HTTP headers before while Encoding	4 years ago
Salva Corts	ece671c146	Enhance logging on timeout tailing logs on canary (#4825 ) * Enhance logging on timeout tailing logs * Apply CR changes	4 years ago
Christian Haudum	7f54641166	Set correct `Content-Type` header in query response (#4828 ) * Set correct `Content-Type` header in query response Because the internal query request handlers did not set the response content type explicitly to `application/json`, and the external request handler takes the response content type from the internal response to set it for the resulting HTTP response, that response was also incorrectly returning `Content-Type: text/plain`. Setting the content type in the internal response correctly results in the expected `Content-Type` header `application/json; charset=UTF-8`. Fixes #4791 Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! Set correct `Content-Type` header in query response Signed-off-by: Christian Haudum <christian.haudum@gmail.com> * fixup! fixup! Set correct `Content-Type` header in query response Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	4 years ago
Danny Kopping	34a012adcf	Use common args in compactor and index-gateway (#4824 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Cyril Tovena	45ed6d560d	Fix up a merge conflict on log filter (#4815 ) * Fix up a merge conflict on log filter Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * use the same parameter order as the stdlib Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
李国忠	09f5a90710	[doc] wal: fix default value (#4810 )	4 years ago
Karsten Jeschkies	bbd737cdd4	Do not run manifest and deploy jobs in cron. (#4772 ) * Do not run manifest and deploy jobs in cron. * Remove `pull_request` event.	4 years ago
Callum Styan	b1242432d6	Refactor dashboard utils to include a separate function per template (#4807 ) variables and another for tag+links so we don't always have to use addClusterSelectorTemplate which adds cluster/namespace/tag/links all in one. Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Fredrik Ekre	18d8fee439	[doc]: Update URL for LokiLogger.jl (Julia client) (#4784 )	4 years ago
Hiroki Sakamoto	b1b82a6000	[Hot Fix] Merge improving case sensitive search correctly (#4804 ) * Improve case sensitive search to avoid allocations. ``` ❯ benchcmp before.txt after.txt benchmark old ns/op new ns/op delta Benchmark_LineFilter/default_true_(?i)foo-16 2400 2233 -6.96% Benchmark_LineFilter/simplified_true_(?i)foo-16 201 228 +13.13% Benchmark_LineFilter/default_false_(?i)foo-16 2443 2376 -2.74% Benchmark_LineFilter/simplified_false_(?i)foo-16 185 231 +24.96% benchmark old allocs new allocs delta Benchmark_LineFilter/default_true_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_true_(?i)foo-16 1 0 -100.00% Benchmark_LineFilter/default_false_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_false_(?i)foo-16 1 0 -100.00% benchmark old bytes new bytes delta Benchmark_LineFilter/default_true_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_true_(?i)foo-16 128 0 -100.00% Benchmark_LineFilter/default_false_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_false_(?i)foo-16 128 0 -100.00% ``` It's not much but for a billions line it makes a big difference. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Simplified version Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Cleanup Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	dc222dc98d	Improve case insensitive search to avoid allocations. (#4394 ) * Improve case sensitive search to avoid allocations. ``` ❯ benchcmp before.txt after.txt benchmark old ns/op new ns/op delta Benchmark_LineFilter/default_true_(?i)foo-16 2400 2233 -6.96% Benchmark_LineFilter/simplified_true_(?i)foo-16 201 228 +13.13% Benchmark_LineFilter/default_false_(?i)foo-16 2443 2376 -2.74% Benchmark_LineFilter/simplified_false_(?i)foo-16 185 231 +24.96% benchmark old allocs new allocs delta Benchmark_LineFilter/default_true_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_true_(?i)foo-16 1 0 -100.00% Benchmark_LineFilter/default_false_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_false_(?i)foo-16 1 0 -100.00% benchmark old bytes new bytes delta Benchmark_LineFilter/default_true_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_true_(?i)foo-16 128 0 -100.00% Benchmark_LineFilter/default_false_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_false_(?i)foo-16 128 0 -100.00% ``` It's not much but for a billions line it makes a big difference. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * typo Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Simplified version Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Cleanup Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Hiroki Sakamoto	8a914b5c2f	Aggregate inotify watcher to file target manager (#4794 ) * Aggregate inotify watcher * rename to target event handler * Add changelog entry * refactor: make event handler testable * Use context to handle done * doc: add description to sendFileCreateEvent	4 years ago
Karen Miller	2a6ddffb49	Docs: Modify label names of configuration blocks (#4787 ) * Docs: Add label names of configuration blocks * Docs: Match configuration block name with docs subsection name	4 years ago
Cyril Tovena	88feda41a0	Improve heap iterators. (#4731 ) Mostly improve allocations but I'm planning to do more using those benchmark. ``` name old time/op new time/op delta HeapIterator-16 3.87ms ± 6% 3.41ms ± 1% -11.92% (p=0.008 n=5+5) HeapSampleIterator-16 2.09ms ± 1% 2.09ms ± 1% ~ (p=0.421 n=5+5) name old alloc/op new alloc/op delta HeapIterator-16 10.5kB ± 0% 8.2kB ± 0% -21.88% (p=0.008 n=5+5) HeapSampleIterator-16 8.40kB ± 0% 6.10kB ± 0% -27.34% (p=0.000 n=5+4) name old allocs/op new allocs/op delta HeapIterator-16 12.0 ± 0% 5.0 ± 0% -58.33% (p=0.008 n=5+5) HeapSampleIterator-16 12.0 ± 0% 5.0 ± 0% -58.33% (p=0.008 n=5+5) ``` I want to introduce a difference between the need to dedupe vs order data. The later doesn't requires poping from the heap, we could actually use a sort.slice. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Hiroki Sakamoto	d61dd1872a	Expose Kafka message key in labels (#4745 ) * expose kafka message key in labels * add changelog entry * improve performance * goimported * fix label name in test * add empty message key test case * pass actual value in message key	4 years ago
Karsten Jeschkies	4c9e4f5f06	Make `` and `+` non-greedy to double regex filter speed. (#4775 ) Optimize regular expressions in filters. * Run original RE2 tests. * Run both tests. * Update pkg/logql/log/filter.go Co-authored-by: Bryan Boreham <bjboreham@gmail.com> * Update pkg/logql/log/filter.go Co-authored-by: Bryan Boreham <bjboreham@gmail.com> * Fix tests. * Format code. Co-authored-by: Bryan Boreham <bjboreham@gmail.com>	4 years ago
Callum Styan	53fc2d7390	Minor operational dashboard improvements + fix missing log template (#4780 ) selector. Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Sandeep Sukhani	8ddcc884fe	add logging in querier when live tailing request starts and ends (#4783 ) * add logging in querier when live tailing request starts and ends * Suggested changes Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Update pkg/querier/http.go Co-authored-by: Susana Ferreira <ssncferreira@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Susana Ferreira <ssncferreira@gmail.com>	4 years ago
Kaviraj	94113ee080	Logql `stdin` support only log queries (#4606 ) * Hack stdin client into LogCLI Add flag to choose what kind of client to make request to. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Label filter working Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Demo checkpoint1 Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Metrics query working. Issue was with default value of `step` (1 nanosecond). StepEvaluator try to go through every nanosecond to apply aggregate on sample data during the metric queries. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Basic tests for fileClient * Tests for logqueries direction * Use HeapIterator for Entries. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove some debug statements Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove support for metric queries. Stick with only log queries Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Small rough usage doc * Remove filesampleiterator * Fix some typos and tests * Fix breaking test cases Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make linter happy Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks. 1. Add `--stdin` in examples of the usage 2. Add `--stdin` in all the command help output * PR remarks - Use parsed labels correctly - Fix indendation with --stdin flag * Fix issue with direction * Fix linter * MaxInt64 -> MaxInt (to support even arm32 images) * Add note on calculating `step` value on the client side	4 years ago
Karen Miller	35ebe967ea	Docs: fix broken links (#4770 ) * Docs: fix broken links * Docs: fix another link name	4 years ago
Karsten Jeschkies	5ece938f3c	Run all benchmarks. (#4742 ) * Run all benchmarks. * Start debugging memchunk benchmark. * Do not iterate when closed. * Pass default tenant config. * Set default limits. * Fix two more benchmarks. * Enable cron trigger again.	4 years ago
Karsten Jeschkies	628747e4cb	Only run benchmarks on `loki-bench` cron. (#4753 ) Summary: Currently, all pipelines are run by the `loki-bench` bron scheduler. However, we only want `benchmark-cron` to run. That is why all other pipelines need to define their own trigger which defaults to `push` and `pull_request`.	4 years ago
Danny Kopping	c263f3ed60	Adding upgrade guide for recording rules (#4751 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Dylan Guedes	130878f3f6	Enrich WAL folder creation error message (#4705 ) * Enrich WAL folder creation error message. * Apply suggestions from code review Use %q and try absolute path. Co-authored-by: Mateusz Gozdek <mateusz@kinvolk.io> * Include file/path package. Co-authored-by: Mateusz Gozdek <mateusz@kinvolk.io>	4 years ago
Ed Welch	88ef940ede	Loki: Set querier worker max concurrent regardless of run configuration. (#4761 ) * always set the querier worker MaxConcurrentRequests * removing a test which doesn't apply as this setting isn't being set in worker_service.go anymore	4 years ago
Karen Miller	f05cecf194	Docs: inject newlines into knob descriptions to avoid horizontal scroll bar (#4733 )	4 years ago
Cyril Tovena	44d32c5ad4	Removes all GRPC warning. (#4757 ) This works for logcli, promtail and Loki. Cherry on top, removes a lot of dependencies. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
James Callahan	21556efa87	Promtail: improve GCP labels (#4628 ) * Promtail: GCP resource label prefix is now '__gcp_resource_labels_' * Promtail: turn GCP 'resource_type' into the internal label '__gcp_resource_type' * Promtail: add internal label with logName * Add upgrade notes for gcplog changes	4 years ago
Sandeep Sukhani	a707ced67f	index cleanup fixes while applying retention (#4741 ) * Add metric name to the label if missing for building index entries for deletion * fix calculation of table interval from table name * add changelog * add test for series cleanup without __name__ label	4 years ago
Cameron McDermott	5dc3af01fc	Add northflank to the adopters list (#4729 ) Signed-off-by: Champ-Goblem <cameron_mcdermott@yahoo.co.uk>	4 years ago
Cyril Tovena	81e67f89b3	Add GELF support for Promtail. (#4744 ) * Add Gelf support for Promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Changelog Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move change to MAIN Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update graylog to grafana remote. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add a test and check mod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add log messages around startup and shutdown Co-authored-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Karsten Jeschkies	1e796b070f	Give more context to rule parser errors. (#4730 ) Summary: - Give record and group name for failing parsing.	4 years ago
Karsten Jeschkies	c19a6c5bbc	Join contain filters into one. (#4528 ) * Join contain filters into one. * Update pkg/logql/log/filter.go Co-authored-by: Dylan Guedes <djmgguedes@gmail.com> * Test Filter method. * Test old and new filter consturctors. * Remove comment. * Define more benchmark cases. * Take care of empty contain filters. * Satisfy linter. * USe different method to filter. * Simplify all filter concat. * Format code. * Push regex filters to the end. * Remove unused test. * Add a few more tests. * Make filters private again. * Fix test failure. * Only accumulate successive contain filters. * Reverse accumulation. * Satisfy linter. * Remove old version. Co-authored-by: Dylan Guedes <djmgguedes@gmail.com>	4 years ago
Sandeep Sukhani	02d88462f3	allow applying retention at different interval than compaction with a config (#4736 ) * allow applying retention at different interval than compaction with a config * add changelog entry	4 years ago

1 2 3 4 5 ...

2709 Commits (b27894fbf4ddb3ae914a9df828f1c643d96137a0) All Branches Search

2709 Commits (b27894fbf4ddb3ae914a9df828f1c643d96137a0)

All Branches