apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Ed Welch	e1aea518ce	update jsonnet for 2.3.0 (#4109 )	4 years ago
Owen Diehl	572bbe15ec	Discard/ooo (#4104 ) * stream includes tenant id * expose out_of_order discarded metrics	4 years ago
Sandeep Sukhani	67fe2d68a3	fix finding tables which would have out of retention data (#4107 )	4 years ago
Karsten Jeschkies	c3aaebe509	Support frontend V2 with query scheduler. (#4071 ) * Support Cortex Frontend V2. * Format code. * Start query scheduler in Docker compose. * Model query flow in sequence diagram. * Model calls to downstreamer. * Move diagram to docs. * Embed generated SVG. * Descripe calls. * Launch Cortex query scheduler. * Disable sharding for now. * Log which framework is used. * Configure querier to use scheduler. * Remove unwanted docs. * Enable query splitting again. * Document scheduler address. * Document new scheduler options for frontend as well. * Remove unused querier option. * Use new query-scheduler module in Loki. * Remove unused option. * Document `max_queriers_per_tenant`.	4 years ago
Karen Miller	f9b0ef33c0	Mark recording rules as an experimental feature. (#4105 )	4 years ago
Travis Patterson	8a2081a39e	Distributor: Truncate rather than drop log lines (#4051 ) * Truncate rather than drop logs - When log lines are longer than maxLineSize, truncate them to maxLineSize rather than dropping them Fixes: #3747 * Review feedback: - Rename 'max_line_size_should_truncate' to 'max_line_size_truncate' - Add configurable truncated indicator - Add Truncated Line metric - Changed truncated metrics to have the name mutated_{samples,bytes}_total * Linter * Review Feedback - Make metric variable names match metric names - Add benchmarks - reduce truncation allocs by 100x * Linter * Remove truncation indicator	4 years ago
Daniel Wright	c00af4d38a	Update lambda-promtail documentation example (#4098 ) Closes #4097	4 years ago
Jennifer Villa	ab1c38ad99	Update the docs to install Loki with Tanka (#4083 ) * Update to the Loki tanka install docs to reflect changes made in tanka. Also pulled up the docs piece about the bolt-db-shipper-shared-store so users know they must modify it, rather than seeing it as a note further down. I think we're probably still missing one more update to the yaml to add the `schema_config` override, but that can come as a separate pr. * Adding the schema config block. Think we should update here because we otherwise default to gcs, which will throw an error if the user wants to use aws s3. * Updated the value we recommend for 'from' * Update docs/sources/installation/tanka.md Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> * Apply suggestions from code review Thank you Karen! Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> * Tried to get more clarify around how I"m describing the object storage type. * Update docs/sources/installation/tanka.md Typos begone! Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com> Co-authored-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> Co-authored-by: Karen Miller <84039272+KMiller-Grafana@users.noreply.github.com>	4 years ago
Diana Payton	9ea59f2062	Create pull_request_template.md (#3913 )	4 years ago
Karsten Jeschkies	5a5bcb16e2	Document 0 meaning for retries. (#4096 )	4 years ago
Cyril Tovena	1efeace644	Fixes instant queries in the frontend. (#4091 ) * Fixes instant queries in the frontend. This is a set of fixes for instant queries: - correctly propagate statistics. - correctly convert sampleStream to vector. - correctly marshal to json. - correctly encode the time for the request. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Robby Milo	c14172dc63	remove docs test (#4090 )	4 years ago
Cyril Tovena	10bd165996	Fixes unaligned shards between ingesters and storage. (#4087 ) * Fixes unaligned shards between ingesters and storage. Currently shards computation are not correctly aligned between ingester and storage causing bad metric results. - Fixed the hash caculation which was missing the metric name `logs`. - Revert some changes from `5f0e2453fe` which was not keeping the alignement of shards. For example if the shard is 9 of 16 total, then it should also be 9 and 25 of 32. The previous commit was trying to use 10 and 11 of 32. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * better tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Dmitry Tolstoy	d6f2d4a041	Change service names in docker-compose files (#3768 ) Co-authored-by: Dmitry Tolstoy <33700018+A-styler@users.noreply.github.com>	4 years ago
Sandeep Sukhani	138ca71dd5	add a method to check whether error is due to a missing object in storage while reading or deleting the object (#4081 )	4 years ago
Danny Kopping	52da3844f9	Ruler: Adding group_key label to recording_rules_samples_queue_capacity metric (#4080 ) * Adding group_key label to recording_rules_samples_queue_capacity metric Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Patrick Huy	968aae4f2a	Doc: Promtail: the label created for the message in the cri stage is called content (#4067 )	4 years ago
Michał Sochoń	eda7f31356	Bump fluent-bit base image to 1.8 (#4059 )	4 years ago
Cyril Tovena	ac6ace8dbd	Make `ParseExternalKey` from the chunk package alloc free. (#4075 ) ``` ~/go/src/github.com/grafana/loki main* ⇣ ❯ benchcmp before.txt after.txt2 benchmark old ns/op new ns/op delta Benchmark_ParseExternalKey-16 569 415 -27.03% benchmark old allocs new allocs delta Benchmark_ParseExternalKey-16 2 0 -100.00% benchmark old bytes new bytes delta Benchmark_ParseExternalKey-16 96 0 -100.00% ``` This is a very hot function in Loki being used for every chunk reference we get from the index. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Cyril Tovena	88c25965da	Inject the org-id if possible from the start. (#4068 ) This allows the http logger to include the org-id. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Danny Kopping	a3414a5d9b	Promtail: handling tight loop in journal follow logic (#4066 ) * Handling EBADMSG explicitly, and preventing tight loop Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Sandeep Sukhani	19aec6e6a3	fix broken TestCachingStorageClientStoreQueries (#4074 )	4 years ago
Danny Kopping	f0542c04e1	Updating drone signature (#4072 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Sandeep Sukhani	d31f8676fd	Optimize index queries and caching (#4070 ) * Use RangeValuePrefix for building queries for Series IDs * optimize index store queries and caching by not doing broad queries	4 years ago
Cyril Tovena	a74947de18	Restoring drone signature (#4069 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com> Co-authored-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Karen Miller	808c808714	Clarify prose about querier frontend min-sharding-lookback (#4050 ) * Clarify prose about querier frontend min-sharding-lookback Docs edit of prose from https://github.com/grafana/loki/pull/4047. * Update docs/sources/configuration/_index.md Co-authored-by: Danny Kopping <dannykopping@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com> Co-authored-by: Danny Kopping <dannykopping@gmail.com>	4 years ago
Cyril Tovena	32e55c3043	Fork cortex chunk storage into Loki. (#3842 ) The chunk package has been forked from this commit for future reference and licensing. `09fe17c0e6`	4 years ago
Danny Kopping	14f8faf544	Group memcached queries by container (#4057 ) Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Owen Diehl	56256bfd5b	Unordered chunks (#4001 ) * merge feature/unordered-replay * interoperable head chunks * memchunk block interop * retain ordered memchunk optimizations when possible * tests+bench for unordered chunk reads * reorder on chunk close * [wip] ingester stream unorderd * unordered writes default in testware config, fixes OOO bug & removes unused lastChunkTimestamp var * validity window is 1/2 of max age & fixes old transfer test * more consistent headblock checking/creation * more cohesive encoding tests * unordered stream test with validity bounds * compat - unordered * reinstates memchunk defaults when rebounding & updates storage test compatibility * lint * reorder across blocks doesnt overflow * respect chunk configs during rebounding when possible * only sync checks on ordered writes	4 years ago
Cyril Tovena	4c2feb32b5	Fixes test helper `newChunk` in the storage pkg. (#4056 ) I wanted to test that overlapping chunks are correctly re-ordered and bump into a rounding issue. Keeping both for future will avoid the same mistake. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Karen Miller	1e85036409	Revise wording of query frontend service configuration (#4052 ) * Revise wording of query frontend service configuration * Add ClusterIP and publishNotReadyAddresses to Kubernetes YAML	4 years ago
Oleg Zaytsev	b4086dfe33	Upgrade Prometheus and Cortex (#4049 ) This bumps prometheus up to the changes from https://github.com/prometheus/prometheus/pull/9083 and Cortex to https://github.com/cortexproject/cortex/pull/4380 Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>	4 years ago
Danny Kopping	0c6b4dc8c9	Ruler: implementing write relabelling on recording rule samples (#4048 ) * Implementing write relabelling Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com> * Appeasing the linter Signed-off-by: Danny Kopping <danny.kopping@grafana.com>	4 years ago
Owen Diehl	a8a861b21a	adds query-frontend service hints for k8s, adapted from jsonnet (#4045 )	4 years ago
Cyril Tovena	3f3d10afcc	Add min_sharding_lookback limits to the frontends (#4047 ) * Add min_sharding_lookback limits to the frontends Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * improve doc. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Karen Miller	551d68210f	Fix docs typo: IP Matching section "=f" becomes "=" (#4039 )	4 years ago
Arve Knudsen	7b11de86c9	loki-build-image: Fix (#4034 ) Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 years ago
Karen Miller	826fdfa3b9	Docs: add weights to YAML metadata to order the LogQL subsections in the nav panel (#4031 )	4 years ago
Cyril Tovena	6c05970ba1	Improve the sweep lag panel in the retention dashboard. (#4030 ) This uses now a graph panel which shows us lags over time. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Karsten Jeschkies	17f4a73a24	Filter instant queries and shard them. (#3984 ) * Filter instan queries and shard them. * [WIP] Test instant query sharding * Trace casting error. * WRap LokiInstantRequest for Params interface. * Convert paras to request. * Convert vector. * Use proper query time stamp. * Assert number of calls. * Convert vector to multiple samples. * Format code. * Use type switch. * Format code. * Rename Matrix to proto conversion. * Remvoe comment on caching. * Update pkg/querier/queryrange/roundtrip_test.go Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove nil middlware. * Handle LokiInstantRequest correctly. * Assert reponse type. * Return LokiPromResponse. * Verify err in tests. * Set shards. * Correct result type. * Use limits middleware. * Use shars parameter in querier. * Return vector. * Unify params. * Change direction to FORWARD. Co-authored-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Bearice Ren	5970ab9b1e	Update _index.md (#4029 ) As mentioned in #3259, permission `s3:ListObjects` is needed, updating the document.	4 years ago
Arve Knudsen	3e385464c6	Chore: Upgrade Prometheus and Cortex (#4017 ) * Chore: Upgrade Prometheus Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Upgrade Cortex Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Upgrade Cortex Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Fix build errors Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Fix build errors Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Fix build errors Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * Undo unnecessary changes Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 years ago
Arve Knudsen	bd30921981	loki-build-image: Upgrade golangci-lint and Go (#4028 ) * loki-build-image: Upgrade golangci-lint Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> * loki-build-image: Upgrade Go Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 years ago
Jack Baldry	e22e666ca4	fix: Restore /config endpoint and correct handlerFunc for buildinfo (#4027 ) As far as I can tell from reading the "next" documentation, the /loki/api/v1/status/buildinfo endpoint should return the build information. The /version endpoint is also listed further down in the documentation but from the code prior to this change, it looks like it should perform the same function as buildinfo endpoint so I have removed it. I've updated the documentation to reflect my changes. Signed-off-by: Jack Baldry <jack.baldry@grafana.com>	4 years ago
Kaviraj	bfb24e6a4c	Ip matcher for LogQL (#3986 ) * IP matcher and filter via netaddr.IP package Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Adding IP filter into label filter gramer 1. ast tests 2. parse tests Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Label filters all test cases passes Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Rename ipFilter -> ipLabelFilter Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * More tests Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Remove testlogs.txt Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make linter happy Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add more cases to the benchmark Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * PR remarks 1. support NEQ 2. reduce allocation. 3. Minor tweaks Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make IP filter work as line filter 1. Add necessary interface implementation 2. More tests for parser and ast Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Make linter happy Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Bug with filter matcher Its wierd bug. Not handing string() method breaks the parser :( Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Split Line and Label filter to different struct. It got out of hands to handle both in same struct. Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add basic doc for IP matcher Signed-off-by: Kaviraj <kavirajkanagaraj@gmail.com> * Add docs feedback from Karen * Label filter add patter error report * PR remarks 1. Indendation fix 2. Remove string() interface for ip label filte * Linter happy * PR remaks * Fix ip label matcher string() method if pattern is invalid * Fix label filter tests * Have local copy of `pattern` in label filter to use in string() * Rebase conflicts * ast.go fixes	4 years ago
Cyril Tovena	fed9115627	Improve decoding of JSON responses. (#4019 ) * Improves frontend allocations Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improves also labels Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * refactoring. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add some more tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes tests and review feedback. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	4 years ago
Karen Miller	391984dded	Revise portions of the docs LogQL section (#4012 ) * Revise portions of the docs LogQL section * Update query diagram per review request	4 years ago
李国忠	29cc5ad8be	[ui] add '/config' page (#3619 ) * [ui] add '/config' page * config.go * lint	4 years ago
Karen Miller	0e519b46e0	Docs: correct fluentbit config value for DqueSync (#4026 )	4 years ago
Sandeep Sukhani	8a9abdfe16	Compactor improvements (#4018 ) * use previously compacted file as seed file and copy index into it * allow configuring compactor to compact multiple tables at a time	4 years ago

1 2 3 4 5 ...

2383 Commits (e1aea518ce5a9f82a4a815e643bb4a63df71ec88) All Branches Search

2383 Commits (e1aea518ce5a9f82a4a815e643bb4a63df71ec88)

All Branches