apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Danny Kopping	34a012adcf	Use common args in compactor and index-gateway (#4824 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Cyril Tovena	45ed6d560d	Fix up a merge conflict on log filter (#4815 ) * Fix up a merge conflict on log filter Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * use the same parameter order as the stdlib Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
李国忠	09f5a90710	[doc] wal: fix default value (#4810 )	4 years ago
Gerard Vanloo	cbe60c6180	LOG 1838: Adding Promtail, Fluentd, and Openshift Logging docs (#104 )	4 years ago
Karsten Jeschkies	bbd737cdd4	Do not run manifest and deploy jobs in cron. (#4772 ) * Do not run manifest and deploy jobs in cron. * Remove `pull_request` event.	4 years ago
Callum Styan	b1242432d6	Refactor dashboard utils to include a separate function per template (#4807 ) variables and another for tag+links so we don't always have to use addClusterSelectorTemplate which adds cluster/namespace/tag/links all in one. Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Fredrik Ekre	18d8fee439	[doc]: Update URL for LokiLogger.jl (Julia client) (#4784 )	4 years ago
Hiroki Sakamoto	b1b82a6000	[Hot Fix] Merge improving case sensitive search correctly (#4804 ) * Improve case sensitive search to avoid allocations. ``` ❯ benchcmp before.txt after.txt benchmark old ns/op new ns/op delta Benchmark_LineFilter/default_true_(?i)foo-16 2400 2233 -6.96% Benchmark_LineFilter/simplified_true_(?i)foo-16 201 228 +13.13% Benchmark_LineFilter/default_false_(?i)foo-16 2443 2376 -2.74% Benchmark_LineFilter/simplified_false_(?i)foo-16 185 231 +24.96% benchmark old allocs new allocs delta Benchmark_LineFilter/default_true_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_true_(?i)foo-16 1 0 -100.00% Benchmark_LineFilter/default_false_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_false_(?i)foo-16 1 0 -100.00% benchmark old bytes new bytes delta Benchmark_LineFilter/default_true_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_true_(?i)foo-16 128 0 -100.00% Benchmark_LineFilter/default_false_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_false_(?i)foo-16 128 0 -100.00% ``` It's not much but for a billions line it makes a big difference. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Simplified version Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Cleanup Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	dc222dc98d	Improve case insensitive search to avoid allocations. (#4394 ) * Improve case sensitive search to avoid allocations. ``` ❯ benchcmp before.txt after.txt benchmark old ns/op new ns/op delta Benchmark_LineFilter/default_true_(?i)foo-16 2400 2233 -6.96% Benchmark_LineFilter/simplified_true_(?i)foo-16 201 228 +13.13% Benchmark_LineFilter/default_false_(?i)foo-16 2443 2376 -2.74% Benchmark_LineFilter/simplified_false_(?i)foo-16 185 231 +24.96% benchmark old allocs new allocs delta Benchmark_LineFilter/default_true_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_true_(?i)foo-16 1 0 -100.00% Benchmark_LineFilter/default_false_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_false_(?i)foo-16 1 0 -100.00% benchmark old bytes new bytes delta Benchmark_LineFilter/default_true_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_true_(?i)foo-16 128 0 -100.00% Benchmark_LineFilter/default_false_(?i)foo-16 0 0 +0.00% Benchmark_LineFilter/simplified_false_(?i)foo-16 128 0 -100.00% ``` It's not much but for a billions line it makes a big difference. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * typo Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Simplified version Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Cleanup Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Hiroki Sakamoto	8a914b5c2f	Aggregate inotify watcher to file target manager (#4794 ) * Aggregate inotify watcher * rename to target event handler * Add changelog entry * refactor: make event handler testable * Use context to handle done * doc: add description to sendFileCreateEvent	4 years ago
Karen Miller	2a6ddffb49	Docs: Modify label names of configuration blocks (#4787 ) * Docs: Add label names of configuration blocks * Docs: Match configuration block name with docs subsection name	4 years ago
Sashank Agarwal	e1ebd3ec89	LOG-1840: Dev Preview Docs on how to get started with hacking on loki-operator (#99 )	4 years ago
Cyril Tovena	88feda41a0	Improve heap iterators. (#4731 ) Mostly improve allocations but I'm planning to do more using those benchmark. ``` name old time/op new time/op delta HeapIterator-16 3.87ms ± 6% 3.41ms ± 1% -11.92% (p=0.008 n=5+5) HeapSampleIterator-16 2.09ms ± 1% 2.09ms ± 1% ~ (p=0.421 n=5+5) name old alloc/op new alloc/op delta HeapIterator-16 10.5kB ± 0% 8.2kB ± 0% -21.88% (p=0.008 n=5+5) HeapSampleIterator-16 8.40kB ± 0% 6.10kB ± 0% -27.34% (p=0.000 n=5+4) name old allocs/op new allocs/op delta HeapIterator-16 12.0 ± 0% 5.0 ± 0% -58.33% (p=0.008 n=5+5) HeapSampleIterator-16 12.0 ± 0% 5.0 ± 0% -58.33% (p=0.008 n=5+5) ``` I want to introduce a difference between the need to dedupe vs order data. The later doesn't requires poping from the heap, we could actually use a sort.slice. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Hiroki Sakamoto	d61dd1872a	Expose Kafka message key in labels (#4745 ) * expose kafka message key in labels * add changelog entry * improve performance * goimported * fix label name in test * add empty message key test case * pass actual value in message key	4 years ago
Karsten Jeschkies	4c9e4f5f06	Make `` and `+` non-greedy to double regex filter speed. (#4775 ) Optimize regular expressions in filters. * Run original RE2 tests. * Run both tests. * Update pkg/logql/log/filter.go Co-authored-by: Bryan Boreham <bjboreham@gmail.com> * Update pkg/logql/log/filter.go Co-authored-by: Bryan Boreham <bjboreham@gmail.com> * Fix tests. * Format code. Co-authored-by: Bryan Boreham <bjboreham@gmail.com>	4 years ago
Callum Styan	53fc2d7390	Minor operational dashboard improvements + fix missing log template (#4780 ) selector. Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Sandeep Sukhani	8ddcc884fe	add logging in querier when live tailing request starts and ends (#4783 ) * add logging in querier when live tailing request starts and ends * Suggested changes Co-authored-by: Danny Kopping <dannykopping@gmail.com> * Update pkg/querier/http.go Co-authored-by: Susana Ferreira <ssncferreira@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Susana Ferreira <ssncferreira@gmail.com>	4 years ago
Kaviraj	94113ee080	Logql `stdin` support only log queries (#4606 ) * Hack stdin client into LogCLI Add flag to choose what kind of client to make request to. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Label filter working Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Demo checkpoint1 Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Metrics query working. Issue was with default value of `step` (1 nanosecond). StepEvaluator try to go through every nanosecond to apply aggregate on sample data during the metric queries. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Basic tests for fileClient * Tests for logqueries direction * Use HeapIterator for Entries. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove some debug statements Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove support for metric queries. Stick with only log queries Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Small rough usage doc * Remove filesampleiterator * Fix some typos and tests * Fix breaking test cases Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make linter happy Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks. 1. Add `--stdin` in examples of the usage 2. Add `--stdin` in all the command help output * PR remarks - Use parsed labels correctly - Fix indendation with --stdin flag * Fix issue with direction * Fix linter * MaxInt64 -> MaxInt (to support even arm32 images) * Add note on calculating `step` value on the client side	4 years ago
Karen Miller	35ebe967ea	Docs: fix broken links (#4770 ) * Docs: fix broken links * Docs: fix another link name	4 years ago
Karsten Jeschkies	5ece938f3c	Run all benchmarks. (#4742 ) * Run all benchmarks. * Start debugging memchunk benchmark. * Do not iterate when closed. * Pass default tenant config. * Set default limits. * Fix two more benchmarks. * Enable cron trigger again.	4 years ago
Karsten Jeschkies	628747e4cb	Only run benchmarks on `loki-bench` cron. (#4753 ) Summary: Currently, all pipelines are run by the `loki-bench` bron scheduler. However, we only want `benchmark-cron` to run. That is why all other pipelines need to define their own trigger which defaults to `push` and `pull_request`.	4 years ago
Sashank Agarwal	bc2daf0342	LOG-1955: Dev Preview Doc to install storage size calculator on OpenShift (#105 ) * add doc to install storage size calculator * updated doc to install storage size calculator	4 years ago
Danny Kopping	c263f3ed60	Adding upgrade guide for recording rules (#4751 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Dylan Guedes	130878f3f6	Enrich WAL folder creation error message (#4705 ) * Enrich WAL folder creation error message. * Apply suggestions from code review Use %q and try absolute path. Co-authored-by: Mateusz Gozdek <mateusz@kinvolk.io> * Include file/path package. Co-authored-by: Mateusz Gozdek <mateusz@kinvolk.io>	4 years ago
Ed Welch	88ef940ede	Loki: Set querier worker max concurrent regardless of run configuration. (#4761 ) * always set the querier worker MaxConcurrentRequests * removing a test which doesn't apply as this setting isn't being set in worker_service.go anymore	4 years ago
Karen Miller	f05cecf194	Docs: inject newlines into knob descriptions to avoid horizontal scroll bar (#4733 )	4 years ago
Cyril Tovena	44d32c5ad4	Removes all GRPC warning. (#4757 ) This works for logcli, promtail and Loki. Cherry on top, removes a lot of dependencies. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Sashank Agarwal	8d7b66fe10	Add storage size calculator (#95 ) * add storage size calculator * updated go.sum * updated size calculator manifest * updated storage size calculator * updated storage size calculator	4 years ago
James Callahan	21556efa87	Promtail: improve GCP labels (#4628 ) * Promtail: GCP resource label prefix is now '__gcp_resource_labels_' * Promtail: turn GCP 'resource_type' into the internal label '__gcp_resource_type' * Promtail: add internal label with logName * Add upgrade notes for gcplog changes	4 years ago
Sandeep Sukhani	a707ced67f	index cleanup fixes while applying retention (#4741 ) * Add metric name to the label if missing for building index entries for deletion * fix calculation of table interval from table name * add changelog * add test for series cleanup without __name__ label	4 years ago
Cameron McDermott	5dc3af01fc	Add northflank to the adopters list (#4729 ) Signed-off-by: Champ-Goblem <cameron_mcdermott@yahoo.co.uk>	4 years ago
Cyril Tovena	81e67f89b3	Add GELF support for Promtail. (#4744 ) * Add Gelf support for Promtail. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Changelog Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move change to MAIN Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update graylog to grafana remote. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add a test and check mod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add log messages around startup and shutdown Co-authored-by: Edward Welch <edward.welch@grafana.com>	4 years ago
Karsten Jeschkies	1e796b070f	Give more context to rule parser errors. (#4730 ) Summary: - Give record and group name for failing parsing.	4 years ago
Karsten Jeschkies	c19a6c5bbc	Join contain filters into one. (#4528 ) * Join contain filters into one. * Update pkg/logql/log/filter.go Co-authored-by: Dylan Guedes <djmgguedes@gmail.com> * Test Filter method. * Test old and new filter consturctors. * Remove comment. * Define more benchmark cases. * Take care of empty contain filters. * Satisfy linter. * USe different method to filter. * Simplify all filter concat. * Format code. * Push regex filters to the end. * Remove unused test. * Add a few more tests. * Make filters private again. * Fix test failure. * Only accumulate successive contain filters. * Reverse accumulation. * Satisfy linter. * Remove old version. Co-authored-by: Dylan Guedes <djmgguedes@gmail.com>	4 years ago
Sandeep Sukhani	02d88462f3	allow applying retention at different interval than compaction with a config (#4736 ) * allow applying retention at different interval than compaction with a config * add changelog entry	4 years ago
Cyril Tovena	11071d4c31	Improves memchunk benchmark to account for block size. (#4645 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Callum Styan	0ee476b758	Simplify chunk flush rate % query. (#4711 ) Signed-off-by: Callum Styan <callumstyan@gmail.com>	4 years ago
Cyril Tovena	d81f757ecb	Refactor and simplify stats package. (#4712 ) * Refactor and simplify stats package. This PR refactors the stats package and make it smaller and simpler to work with. - It doesn't expose the context which can causes race when mutating it. - Uses concurrency primitive to ensure correctness - Replace trailers with in-batch statistics to propagate ingesters stats. Fixes #3366 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fix tests and lint issues. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes moar tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * mod-check Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * More fixes. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Owen Diehl	0116aa61c8	ensures components with required SRV lookups use the correct port (#4737 ) * ensures components with required SRV lookups use the correct port naming (_grpclb prefix) * Update production/ksonnet/loki/query-frontend.libsonnet Co-authored-by: Ed Welch <ed@oqqer.com> Co-authored-by: Ed Welch <ed@oqqer.com>	4 years ago
Jiří Sejkora	925de9e102	Docs: Fix a typo (#4726 )	4 years ago
Cyril Tovena	2f1e2fc3d2	Fixes Promtail User-Agent. (#4716 ) This was because promtail client was still user the old version.Version which is initialized at run-time via init. But if we use it also at init time there's no guarantee that the version will be set. So intead I'm using the original version variable stamped in the binary and not at runtime. Fixes #4686 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Karen Miller	6d520f95b3	Docs: small v2.4.1 release notes edits (#4718 )	4 years ago
Hiroki Sakamoto	1557dab34f	Add SASL&mTLS authentication support for Kafka in Promtail (#4663 ) * Add xdg-go module * Add mTLS, SASL/PLAIN, SASL/SCRAM authentication support * docs: Add authentication configuration * Add test tools for kafka authentication * Add test stacks for SSL, SASL/PLAIN, SASL/SCRAM, SASL over TLS authentication * Fix shelllint	4 years ago
Karsten Jeschkies	9762b31418	Only execute benchmarks on main. (#4710 ) * Only execute benchmarks on main. * Remove condition. * Update .drone/drone.jsonnet * Generate .drone.yml.	4 years ago
Karsten Jeschkies	5b9f5b9efa	Run benchmarks in cron jobs. (#4636 ) * Run benchmarks in cron jobs. * Increase benchmark timeout. * Trigger every four hours.	4 years ago
Ed Welch	413ffab235	update everything for 2.4.1 (#4701 )	4 years ago
Sandeep Sukhani	20726e6ba1	fix flaky retention tests (#4697 )	4 years ago
Ed Welch	90d5d24998	Project: Loki 2.4.1 release notes (#4688 ) * add 2.4.1 bug fixes * update changelog	4 years ago
Owen Diehl	e52e805144	Adds replication_factor doc to common config (#4683 ) Oops, looks like we missed adding this to the configuration docs.	4 years ago
Owen Diehl	4d8009cacc	overrides checks for nil tenant limits on AllByUserID (#4687 )	4 years ago

... 2 3 4 5 6 ...

2956 Commits (3d7e9cee362434e870459039cd02bfcb44cd43ce) All Branches Search

2956 Commits (3d7e9cee362434e870459039cd02bfcb44cd43ce)

All Branches