apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Owen Diehl	b72198c80a	better boltdb errmsg (#3139 )	4 years ago
Owen Diehl	95052943c4	swaps mutex for atomic (#3141 )	4 years ago
Karsten Jeschkies	776c9df9e3	Give another example for multiline. (#3138 ) * Give another example for multiline. Summary: This is a new example I've tested. It uses the zero-width space character `U+200B` to identify the first line of a multline block. * Update docs/sources/clients/promtail/stages/multiline.md Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> * Apply suggestions from code review Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Owen Diehl	ed649eec37	Don't fail writes due to full WAL disk (#3136 ) * dont fail writes on full wal disk * wal full failure will cause flush on shutdown * logs the first full WAL failure	4 years ago
Owen Diehl	fd94b8d30d	label_format no longer shardable and introduces the Shardable() metho… (#3137 ) * label_format no longer shardable and introduces the Shardable() method to Expr ifc * unused llint	4 years ago
Cyril Tovena	f1c4ba2f59	Add zstd and flate compressions algorithms. (#3064 ) * Add zstd and flate compressions algorithms. zstd has the highest ratio of all while flate is very simalar to gzip. I'm adding those mainly for posterity and to keep them benchmarked. This also update gzip and lz4 library which both have been improved. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add missing vendor change. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * update go.mod. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	82d96dec03	Improve distributors validation. (#3134 ) ```bash ❯ benchcmp before.txt after.txt benchmark old ns/op new ns/op delta Benchmark_Push-16 18708519 1348876 -92.79% benchmark old allocs new allocs delta Benchmark_Push-16 44 42 -4.55% benchmark old bytes new bytes delta Benchmark_Push-16 4008391 2079 -99.95% ``` Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Owen Diehl	c9b85b33ac	Integrates label replace into sharding code (#3132 ) * avoid sharding label replace * updates sharding tests * matrix stepper end-inclusive for rangeVectorIterator parity * Revert "matrix stepper end-inclusive for rangeVectorIterator parity" This reverts commit `2f34deab98`. * removes sharding equivalence tests due to interference by non-sharding bug in the control case	4 years ago
Danny Kopping	fcabfec470	Implementing line comments (#3126 ) * Implementing line comments Adding tests Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Further appeasement Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding tests to ensure that a # within a string is not incorrectly lexed as a comment Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Adding documentation Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Sam Coren	ca13e79f04	Update getting-in-touch.md (#3123 ) This page wasn't updated yet to reflect the community support channel shift from Grafana Community Slack -> Grafana Community Forums. Also added clarity re: support for Grafana Cloud-hosted Loki users and included community call information.	4 years ago
Michel Hollands	4f62f36af7	Update cortex to 1 6 (#3131 ) * Update Cortex to recent master (1.5.0+, 35e698bb56d6). Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Ignore set scheduler address. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Make linter happy. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Upgrade cortex to 1.6 Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Work around issues in go-openapi libraries Signed-off-by: Michel Hollands <michel.hollands@grafana.com> * Clean up go.mod and go.sum Signed-off-by: Michel Hollands <michel.hollands@grafana.com> Co-authored-by: Peter Štibraný <peter.stibrany@grafana.com>	4 years ago
Cyril Tovena	cdf4a73238	Improve tailer matching by using the index. (#3090 ) * Improve tailer matching by using the index. ``` ❯ benchcmp before.txt after benchmark old ns/op new ns/op delta Benchmark_instance_addNewTailer-16 537731 1479 -99.72% benchmark old allocs new allocs delta Benchmark_instance_addNewTailer-16 244 3 -98.77% benchmark old bytes new bytes delta Benchmark_instance_addNewTailer-16 22098 121 -99.45% ``` Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	fea5db12ed	Fixes LogQL documentation links. (#3128 ) * Fixes LogQL documentation ref links. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix old link. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
WuJie	ca344ca31a	fix time duration unit (#3124 ) time.ParseDuration does not support unit `d`	4 years ago
Cyril Tovena	c971e8e65a	Optimizes SampleExpr to remove unnecessary line_format. (#3065 ) * Optimizes SampleExpr to remove unnessary line_format. When doing count_over_time and rate(), it doesn't make sense to have a line_format since you're counting line, you don't really care about what the line contains. At the same time this set the foundation of for further optimization, like parsing only required labels during label parsing. I've also found a bug where `topk by(foo) (1...` where not correctly parsed. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * For all range vector operations. Except for bytes one which count bytes in lines. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/logql/optimize_test.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	4 years ago
李国忠	bd321fb4f2	lru cache logql.ParseLabels (#3092 ) * lru cache logql.ParseLabels * lru cache logql.ParseLabels * lru cache logql.ParseLabels * lru cache logql.ParseLabels * lru cache logql.ParseLabels	4 years ago
Val	5572366d93	Include instruction to enable variable expansion (#3115 )	4 years ago
Owen Diehl	72666dc799	self documenting pipeline process ifc (#3122 )	4 years ago
Owen Diehl	ad803af9dc	Wal/recover corruption (#3117 ) * simplifies recovery code and continues after errors * does not exit on wal recovery failure * log line parity * less scary error msgs * more descriptive errors * Update pkg/ingester/ingester.go Co-authored-by: Ed Welch <ed@oqqer.com> * Update pkg/ingester/ingester.go Co-authored-by: Ed Welch <ed@oqqer.com> Co-authored-by: Ed Welch <ed@oqqer.com>	4 years ago
Cyril Tovena	7682f133b6	Improve JSON parser and add labels parser hints. (#3080 ) * Improve JSON parser and add labels parser hints. This is a rework of the json parser, that now uses iteration over reflection allowing to avoid allocations. I've also implemented a way to guess and hints what labels needs to be parsed when doing metric queries, this means we can extract only the few labels required from the log line. benchcmp ``` ❯ benchcmp before.txt after.txt5 benchmark old ns/op new ns/op delta Benchmark_Parser/json/no_labels_hints-16 9889 3281 -66.82% Benchmark_Parser/logfmt/no_labels_hints-16 1624 1671 +2.89% Benchmark_Parser/logfmt/labels_hints-16 1601 790 -50.66% benchmark old allocs new allocs delta Benchmark_Parser/json/no_labels_hints-16 139 56 -59.71% Benchmark_Parser/logfmt/no_labels_hints-16 31 31 +0.00% Benchmark_Parser/logfmt/labels_hints-16 31 5 -83.87% benchmark old bytes new bytes delta Benchmark_Parser/json/no_labels_hints-16 3671 912 -75.16% Benchmark_Parser/logfmt/no_labels_hints-16 464 464 +0.00% Benchmark_Parser/logfmt/labels_hints-16 464 144 -68.97% ``` I've experienced a 2x to 4x improvement in my cluster. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * typos. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Owen Diehl	58987553a1	Disables the stream limiter until wal has recovered (#3114 ) * disables the stream limiter until wal has recovered * limiter disable/enable methods	4 years ago
Kaviraj	3edcda744e	mention the use of `config.expand-env` flag in the doc. (#3078 )	4 years ago
Owen Diehl	ee9c629f51	wal docs (#3026 )	4 years ago
Andrea Scarpino	3640d2d4a8	Update reference to old helm chart repo (#3084 )	4 years ago
nileshcs	92c7bb5513	Update docs for downstream_url (#3109 )	4 years ago
Cyril Tovena	e83f809dd7	Small fixes for the documentation. (#3088 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
coffee coder	03aaa34de8	Assign appropriate pvc size and class to compactor and ingester (#3074 )	4 years ago
Rajat Vig	001668b79d	Fix ingester PVC data declaration to use configured value (#3079 )	4 years ago
Benjamin Huo	52afadc027	Fix storage guide links (#3094 ) Signed-off-by: Benjamin <benjamin@yunify.com>	4 years ago
Ed Welch	58474191fe	fix indentation and add helm repo url (#3102 )	4 years ago
Ed Welch	022488180c	updating jsonnet for Loki 2.1.0 (#3101 )	4 years ago
Edward Welch	f3da167977	Merge branch 'release-2.1.0' # Conflicts: # CHANGELOG.md	4 years ago
Edward Welch	1b79df3754	add more notes to changelog	4 years ago
Edward Welch	ff224c3f72	update changelog and upgrade guide for 2.1.0	4 years ago
Heds Simons	d08871d4c7	fluent-bit: Rename Fluent Bit plugin output name. (#2974 ) This prevents a clash with the Loki plugin now included with the Fluent Bit agent by default. The output plugin is now named `grafana-loki`. Signed-off-by: Heds Simons <heds@whaleway.net> (cherry picked from commit `b195e94f39`)	4 years ago
Owen Diehl	b236f2ee27	adds the ability to read chunkFormatV3 while writing v2 (#2984 ) (cherry picked from commit `a8af1c0c84`)	4 years ago
Edward Welch	a54005f24e	update changelog (cherry picked from commit `d5141c05a7`)	4 years ago
Edward Welch	14385b1d54	Merge branch 'release-2.0.1' # Conflicts: # pkg/chunkenc/memchunk_test.go	4 years ago
Ed Welch	31f3c205e6	Helm: Disable CI (#3072 ) * Removing the helm chart ci build steps as the helm charts are in a new repo now. * remove helm targets from the makefile	4 years ago
Michel Hollands	48b65834a0	Make server publicly available (#3087 ) Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	4 years ago
Michel Hollands	e9001d8731	Make the moduleManager field public (#3077 ) Signed-off-by: Michel Hollands <michel.hollands@grafana.com>	4 years ago
Torsten Walter	6c8ad5258b	Deprecate Charts as they have been moved (#2720 ) * Deprecate Charts as they have been moved Signed-off-by: Torsten Walter <torsten.walter@syncier.com> * update docs and links to new chart location Co-authored-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Edward Welch	d5141c05a7	update changelog	5 years ago
Owen Diehl	35a627df49	adds the ability to read chunkFormatV3 while writing v2 (#2984 ) (cherry picked from commit `a8af1c0c84`)	5 years ago
Cyril Tovena	fbf17904f7	Fixes iota unexpected behaviour with bytes for chunk encoding. (#2945 ) * Fixes iota unexpected behaviour with bytes for chunk encoding. This was introducing incompatibilities since iota with bytes starts at 2. Seems like a weird conversion between iota int and byte. This can currenlty corrupt chunks, and previous chunks are not decodable. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * With iota correclty this time. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> (cherry picked from commit `fa7ea9cc2d`)	5 years ago
Edward Welch	8cd276d4ac	v3 of chunk encoding serializes all block data (#2934 ) (cherry picked from commit `663c872a4c`)	5 years ago
Cyril Tovena	3f99a07323	Remove regexes in the operational dashboard. (#3062 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	6d85c7c212	Add absent_over_time (#3053 ) * Add absent_over_time This adds absent_over_time which is super useful when alerting, it can be combine with any logql selector including parsers and filter to returns a timeseries with 1 when logs go missing. Fixes #2893 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds comment. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	3f0800dc44	Add function label_replace. (#3047 ) You might be wondering why do we need label_replace when we already have label_format. Well for two reasons: 1. It's nice to have something similar to Prometheus, so users building metric queries will feel right at home. 2. Interestingly, they are quite different in how they execute. label_format executes for every log line, however label_replace execute for every sample. Since you aggregate log lines into sample then label_replace is way more efficient at scale. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	4e7a123c77	Support rate for unwrap expressions. (#3048 ) This allows to bytes throughput if there were printed in a log line. Examples : ```logql sum by (device) (rate({app="network-dev"} \|= "192.16.8.1" \| json \| unwrap recv_bytes [1m])) ``` Closes #3044 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago

1 2 3 4 5 ...

2011 Commits (d357ad9e58a035bcdb5e0bf0a4ebebaba4de1797) All Branches Search

2011 Commits (d357ad9e58a035bcdb5e0bf0a4ebebaba4de1797)

All Branches