apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Heds Simons	d08871d4c7	fluent-bit: Rename Fluent Bit plugin output name. (#2974 ) This prevents a clash with the Loki plugin now included with the Fluent Bit agent by default. The output plugin is now named `grafana-loki`. Signed-off-by: Heds Simons <heds@whaleway.net> (cherry picked from commit `b195e94f39`)	4 years ago
Owen Diehl	b236f2ee27	adds the ability to read chunkFormatV3 while writing v2 (#2984 ) (cherry picked from commit `a8af1c0c84`)	4 years ago
Edward Welch	a54005f24e	update changelog (cherry picked from commit `d5141c05a7`)	4 years ago
Sandeep Sukhani	ae9c4b82ec	fix table deletion in table client for boltdb-shipper (#2960 )	5 years ago
Ed Welch	9ba5753e25	Loki: handle faults when opening boltdb files (#2988 ) * we also need to catch faults not just panics when opening boltdb files * fix lint * i'll get it one of these times * fix typo	5 years ago
Cyril Tovena	ec725db9d0	Add ProcessString to Pipeline. (#2972 ) * Add ProcessString to Pipeline. Most of the time, you have a buffer that you want to test again a log pipeline, when it passed you usually copy via string(buff). In some cases like headchunk and tailer you already have an allocated immutable string, since pipeline never mutate the line passed as parameter, we can create ProcessString pipeline method that will avoid re-allocating the line. benchmp: ``` ❯ benchcmp before.txt after.txt benchmark old ns/op new ns/op delta BenchmarkHeadBlockIterator/Size_100000-16 20264242 16112591 -20.49% BenchmarkHeadBlockIterator/Size_50000-16 10186969 7905259 -22.40% BenchmarkHeadBlockIterator/Size_15000-16 3229052 2202770 -31.78% BenchmarkHeadBlockIterator/Size_10000-16 1916537 1392355 -27.35% BenchmarkHeadBlockSampleIterator/Size_100000-16 18364773 16106425 -12.30% BenchmarkHeadBlockSampleIterator/Size_50000-16 8988422 7730226 -14.00% BenchmarkHeadBlockSampleIterator/Size_15000-16 2788746 2306161 -17.30% BenchmarkHeadBlockSampleIterator/Size_10000-16 1773766 1488861 -16.06% benchmark old allocs new allocs delta BenchmarkHeadBlockIterator/Size_100000-16 200039 39 -99.98% BenchmarkHeadBlockIterator/Size_50000-16 100036 36 -99.96% BenchmarkHeadBlockIterator/Size_15000-16 30031 31 -99.90% BenchmarkHeadBlockIterator/Size_10000-16 20029 29 -99.86% BenchmarkHeadBlockSampleIterator/Size_100000-16 100040 40 -99.96% BenchmarkHeadBlockSampleIterator/Size_50000-16 50036 36 -99.93% BenchmarkHeadBlockSampleIterator/Size_15000-16 15031 31 -99.79% BenchmarkHeadBlockSampleIterator/Size_10000-16 10029 29 -99.71% benchmark old bytes new bytes delta BenchmarkHeadBlockIterator/Size_100000-16 27604042 21203941 -23.19% BenchmarkHeadBlockIterator/Size_50000-16 13860654 10660652 -23.09% BenchmarkHeadBlockIterator/Size_15000-16 4231360 3271363 -22.69% BenchmarkHeadBlockIterator/Size_10000-16 2633436 1993420 -24.30% BenchmarkHeadBlockSampleIterator/Size_100000-16 17799137 14598973 -17.98% BenchmarkHeadBlockSampleIterator/Size_50000-16 7433260 5833137 -21.53% BenchmarkHeadBlockSampleIterator/Size_15000-16 2258099 1778096 -21.26% BenchmarkHeadBlockSampleIterator/Size_10000-16 1393600 1073605 -22.96% ``` Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * add some precision about why Sum64 is not a concern. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update pkg/chunkenc/memchunk.go Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	5 years ago
Cyril Tovena	06a89ea0ee	Fixes vector grouping injection. (#2975 ) * Fixes vector grouping injection. During an improvement I introduced a bug where we would pre-aggregate some range vector aggregations, although the result is not the same. We can only inject vector grouping in range vector if the operation is associative through grouping. This is not the case for max/min/stddev/stddvar/quantile/avg_over_time. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * got linted. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	221fd382a9	Move CI to helm3. (#2986 ) * Move CI to helm3. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Rollback to v3.2.3 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Ed Welch	0b84ef8868	Promtail: Update debian image and use a newer libsystemd (#2957 ) * use a newer libsystemd which understands compression needed in some of the newer OS distros * add comments	5 years ago
Anton Nehaev	3d27b1f468	docs: added loki4j to the list of unofficial clients (#2869 )	5 years ago
Ed Welch	6d442673b7	adding a function to safely open boltdb files and recover from any panics thrown by boltdb when opening a file. (#2983 )	5 years ago
LTek-online	56830bc78b	Changed incorrect headers of sections in the promtail config docu (#2636 ) The configuration documentation of promtails contains some errors where the headers of the sections don't match the actual configs. Notably configuration keys like 'server' and 'clients' have been mislabeled as 'server_config' and 'client_config'. This merge request is aimed to correct that so that it matches the configuration as in the written config files to avoid confusion.	5 years ago
Cyril Tovena	9807f7c43e	Avoid parsing labels when tailer is sending from a stream. (#2973 ) * Avoid parsing labels when tailer is sending from a stream. This also include some code cleanup. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * I got linted. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Björn Rabenstein	e14463b2a3	Improve promtail alerts to retain the namespace label (#2976 ) The `PromtailFileMissing` should actually work in this simplified form. Please let me know if I'm missing something.	5 years ago
Sandeep Sukhani	14a5e22c31	add missing ingester query routes in loki reads and operational dashboard (#2961 )	5 years ago
Christian Zunker	57f8159c93	[Helm Chart Loki] Add needed k8s objects for alerting config: (#2965 ) - ConfigMap containing the rules - VolumeMount for rules - scratch mount for rule parsing Fixes #2964 Signed-off-by: Christian Zunker <christian.zunker@codecentric.cloud>	5 years ago
Christian Zunker	b5817127a5	Remove `helm init` (#2967 ) As helm v2 is EOF, I removed the commands only present in helm v2. Fixes #2966 Signed-off-by: Christian Zunker <christian.zunker@codecentric.cloud>	5 years ago
Yuichi Sawada	27dddef475	Fix logcli logql document url (#2968 )	5 years ago
Cyril Tovena	8ea5fd173f	Implement io.WriteTo by chunks. (#2962 ) This allows to totally defer the buffer creation to the user. `Marshal(w io.Writer) error` Now don't even need to create a buffer. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Christian Simon	a7d4774859	Add community forum to README.md (#2969 )	5 years ago
Cyril Tovena	a62f81f1cf	Improve tailer matcher function. (#2959 ) Don't create a map on every new push of a stream or appearance of a new stream. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	4da505b413	Fixes the Stringer of the byte label operator. (#2946 ) This would cause the operator to become a numeric one once stringified. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Karsten Jeschkies	29be929a8c	Test label filter for bytes. (#2941 ) * Test label filter for bytes. Summary: - Adds a new test to `ast_test` for filtering by bytes.\| - Test another case than `B`. * Test all combinations of byte sizes.	5 years ago
Owen Diehl	1b6465d940	bumps rules-action ref to logqlv2+ version (#2951 )	5 years ago
Sandeep Sukhani	cd723c0479	Boltdb shipper query readiness (#2911 ) * add support for downloading index on startup in boltdb-shipper for query readiness * tests * pass context to load tables function to be able to cancel the operation * add missing call to tablemanager.stop when loading of tables fail	5 years ago
Tom Wilkie	1c8dd3e11a	Add a few more instructions to logcli --help. (#2948 ) Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	5 years ago
Cyril Tovena	61ba02e2c4	Limit series for metric queries. (#2903 ) * Work in progress limit series. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * First draft of the series limiter. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add limiter to query-frontend. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add documentation. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fix build Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fmted Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint and build fix Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update docs/sources/configuration/_index.md Co-authored-by: achatterjee-grafana <70489351+achatterjee-grafana@users.noreply.github.com> * Review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Reduce // for to fix flaky test. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: achatterjee-grafana <70489351+achatterjee-grafana@users.noreply.github.com>	5 years ago
Ed Welch	901562e040	update loki-stack to use latest logstash version (#2940 )	5 years ago
Heds Simons	d7de3b459f	Docs: Corrects Fluent Bit documentation link to build the plugin. (#2942 ) * Corrects Fluent Bit documentation link to build the plugin. Signed-off-by: Heds Simons <heds@whaleway.net> * Update docs/sources/clients/fluentbit/_index.md Co-authored-by: achatterjee-grafana <70489351+achatterjee-grafana@users.noreply.github.com> Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: achatterjee-grafana <70489351+achatterjee-grafana@users.noreply.github.com>	5 years ago
Cyril Tovena	fa7ea9cc2d	Fixes iota unexpected behaviour with bytes for chunk encoding. (#2945 ) * Fixes iota unexpected behaviour with bytes for chunk encoding. This was introducing incompatibilities since iota with bytes starts at 2. Seems like a weird conversion between iota int and byte. This can currenlty corrupt chunks, and previous chunks are not decodable. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * With iota correclty this time. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	14a5fda15b	Only append tailed entries if needed. (#2931 ) * Only append tailed entries if needed. This avoid to doing allocations on slices when there is no tailers. We could potentially pooled the slice too but the tailing code is using the stream in an async fashion so we can't put it back. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * cleanup Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Owen Diehl	663c872a4c	v3 of chunk encoding serializes all block data (#2934 )	5 years ago
Cyril Tovena	58f8117618	Skip journald bad message. (#2928 ) Unfortunatelly I can't show the message itself without forking the library we are using. Fixes #2812. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Diana Payton	78bb4bcef7	Update CODEOWNERS (#2933 )	5 years ago
Cyril Tovena	e1ab2cc509	Cleanup labels parsing. (#2929 ) * Cleanup labels parsing. Make sure we only use one type of labels parsing.This just reduce the amount of code we have to maintain. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes a test. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	18e29236f4	Fixes all in one grpc registrations. (#2930 ) We can only register push server once, in all in one, we want to register only ingester. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	049c7acc12	Improve logql parser allocations. (#2927 ) * Improve logql parser allocations. Also moving labels parsing into logql package, and I'm not shy to say that promql is faster for this. So we're using promql for parser, it's faster because their lexer is more sophisticated than ours. Result are impressive. ``` ❯ benchcmp before.txt after.txt benchmark old ns/op new ns/op delta Benchmark_ParseLabels-16 24394 8745 -64.15% benchmark old allocs new allocs delta Benchmark_ParseLabels-16 156 20 -87.18% benchmark old bytes new bytes delta Benchmark_ParseLabels-16 24976 2099 -91.60% ``` Combined with #2926, I think we should be able to get rid of `util.ToClientLabels`. But that's for another PR. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes a test. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	2303f1bfa1	Cache label strings in ingester to improve memory usage. (#2926 ) * Add benchmark for base stats. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Cache labels string in ingester to improve memory usage. This reduce allocations by a lot, but assume that labels comes in sorted which is not ensure in the distributors. The distributors will take a performance hit, but that's easier to scale or improve later.(added some todos) see benchmark: ``` ❯ benchcmp before.txt after.txt benchmark old ns/op new ns/op delta Benchmark_PushInstance-16 43505 4950 -88.62% benchmark old allocs new allocs delta Benchmark_PushInstance-16 240 12 -95.00% benchmark old bytes new bytes delta Benchmark_PushInstance-16 42568 1787 -95.80% ``` Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * 🤦 wrong hashing. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Tom Manning	a5cc650d33	Distributor registers logproto.Pusher service to receive logs via GRPC (#2922 )	5 years ago
Chance Zibolski	f0d4adc53d	promtail: Add support for using syslog message timestamp (#2914 ) Currently promtail sets the timestamp of incoming syslog messages to the time it was received by promtail. In some cases, it is preferable to use the source timestamp instead. This adds a new `use_message_timestamp` option to the syslog target config, which allows users to opt-in to the behavior of using the timestamp on the message, if one exists.	5 years ago
Owen Diehl	bdf8dca5b1	loki delete namespace ruler api (#2918 )	5 years ago
Cyril Tovena	6e79cee85d	Fixes race condition in tailer since logql v2. (#2917 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	5738611d64	Fixes logql.QueryType. (#2913 ) The bug was introduced with LogQL extensions. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Robert Fratto	ca311c4d52	expose underlying promtail client (#2910 )	5 years ago
Fredrik Enestad	c14b443b7b	Add max_cache_freshness_per_query to docs (#2909 )	5 years ago
Cyril Tovena	dfd2e2090e	Fixes metric query issue with no grouping. (#2902 ) This would remove all labels for metrics queries that does not have grouping, instead of adding all labels. It was introduced by https://github.com/grafana/loki/pull/2875 I added a regression test. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	095b4a1cb7	Fixes a panic with the logql.NoopPipeline. (#2901 ) Totally forgot that now we can't share this across multiple queries since they hold a map. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Sho Okada	9900e69820	Fix error 'Unexpected: ("$", "$") while parsing field definition' (#2895 )	5 years ago
Matt Young	80539a296a	gateway: fix regression in tanka jsonnet (#2899 ) Seeing the following when importing loki... evaluating jsonnet: RUNTIME ERROR: {snip}everquoteinc/loki-du/tanka/vendor/loki/gateway.libsonnet:97:5-6 Unexpected: "$" while parsing field definition Related to: https://github.com/grafana/loki/pull/2852 `cb383d6906`	5 years ago
Cyril Tovena	070a145ea6	Improve the chunksize test. (#2892 ) This gives now the ratio, and the characters inserted in human readable format. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago

1 2 3 4 5 ...

1885 Commits (d08871d4c7e3b8dbf6d55954a141f83b55e09fc4) All Branches Search

1885 Commits (d08871d4c7e3b8dbf6d55954a141f83b55e09fc4)

All Branches