Like Prometheus, but for logs.

prometheushacktoberfestgrafanacloudnativeloggingloki

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Ed Welch 45caba4459 Loki: Remove the bypass for "limited" queries (#7510) ... **What this PR does / why we need it**: Limited queries are queries which don't have a filter expression. Now all log queries will be handled by the LogFilterTripperware which will result in them being split by time (they previously were not) Signed-off-by: Edward Welch <edward.welch@grafana.com> **Which issue(s) this PR fixes**: We've found that very large timeframe `limited` queries will be sent to queriers and then ingesters and can stall out the read path because of the large time ranges. Splitting these by time avoids this problem by keeping any subquery limited in length to the `split_by_interval`. It's important to note that this will likely increase some extra work done by limited queries as more work for these will be parallelized and can result in extra data being processed. This will be the same as how filter queries are handled now, so it will be no worse than that. In fact this was an optimization based on the premise that it's advantageous not to split/shard limited queries but we are seeing this not be the case when limited queries are run over very large time ranges matching streams with huge volumes and combined with parsers like `| json` **Special notes for your reviewer**: **Checklist** - [ ] Reviewed the `CONTRIBUTING.md` guide - [ ] Documentation added - [x] Tests updated - [x] `CHANGELOG.md` updated - [ ] Changes that require user attention or interaction to upgrade are documented in `docs/sources/upgrading/_index.md` Signed-off-by: Edward Welch <edward.welch@grafana.com>		3 years ago
..
queryrangebase	Results cache fix improvements (#7444)	3 years ago
benchmarkutils_test.go	Loki Query Frontend (#1442)	6 years ago
codec.go	Replace deprecated `io/ioutil` with `io` and `os` packages (#7212)	3 years ago
codec_test.go	Replace deprecated `io/ioutil` with `io` and `os` packages (#7212)	3 years ago
downstreamer.go	Fix result cache misses on sharded queries (#7429)	3 years ago
downstreamer_test.go	fix test increase timeout (#7022)	3 years ago
extensions.go	TSDB/query-planning-groundwork (#6367)	4 years ago
limits.go	Use dskit/tenant intead of loki/pkg/tenant. (#5724)	4 years ago
limits_test.go	Invalidate caches on delete (#5661)	4 years ago
log_result_cache.go	Use dskit/tenant intead of loki/pkg/tenant. (#5724)	4 years ago
log_result_cache_test.go	[Frontend] Log Result Cache (#5502)	4 years ago
metrics.go	adds result cache key version comparison metrics (#7323)	3 years ago
ordering.go	Loki Query Frontend (#1442)	6 years ago
prometheus.go	Replace deprecated `io/ioutil` with `io` and `os` packages (#7212)	3 years ago
prometheus_test.go	Add cache usage statistics (#6317)	4 years ago
queryrange.pb.go	[TSDB] Indexgateway Protobuf refactor (#6841)	3 years ago
queryrange.proto	[TSDB] Indexgateway Protobuf refactor (#6841)	3 years ago
querysharding.go	Fix result cache misses on sharded queries (#7429)	3 years ago
querysharding_test.go	Fix result cache misses on sharded queries (#7429)	3 years ago
roundtrip.go	Loki: Remove the bypass for "limited" queries (#7510)	3 years ago
roundtrip_test.go	Loki: Remove the bypass for "limited" queries (#7510)	3 years ago
shard_resolver.go	[TSDB] 600MB max per shard in query planning (#7004)	3 years ago
shard_resolver_test.go	[TSDB] 600MB max per shard in query planning (#7004)	3 years ago
split_by_interval.go	avoid using bloomfilters for chunks in stats calls by avoiding duplicates (#7209)	3 years ago
split_by_interval_test.go	Preserve interval parameter when splitting queries by time (#5622)	4 years ago
split_by_range.go	[TSDB] Use index sampling to determine shard factor (#6396)	4 years ago
split_by_range_test.go	Adapt queryTimeout to be a per-tenant configuration (#6835)	3 years ago
stats.go	fix(stats_collector): Do not collect stats for failed requests. (#6878)	3 years ago
stats_test.go	fix(stats_collector): Do not collect stats for failed requests. (#6878)	3 years ago