apitech/loki - loki - Gitea: Git with a cup of tea

Commit Graph

Author	SHA1	Message	Date
Jeroen Op 't Eynde	22fbfe2255	fix(loki-mixin): refer to super.annotations (#2873 ) fixes #2729	5 years ago
Periklis Tsirakidis	899e8cc95b	Add config options for loki dashboards (#2617 )	5 years ago
Fredrik Enestad	ac840413a4	typo in operational dashboard (#2612 ) seconds_seconds => seconds	5 years ago
Sandeep Sukhani	409eb31a5c	fix closing bracket in dashboards from loki-mixin (#2599 )	5 years ago
Sandeep Sukhani	6dd2e9ef34	Read, Write and operational dashboard improvements (#2584 ) 1. Add bigtable, boltdb-shipper to read/write dashboards. 2. Add boltdb-shipper to operational dashboard. 3. Record latency for write operation in boltdb-shipper.	5 years ago
Cyril Tovena	365235bdc6	Refactor mixin routes and add series API. (#2185 ) Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Ed Welch	fdf6208dd4	Fix datasource and variable dropdown choices (#2162 )	5 years ago
beorn7	a5aa34137a	Adjust Loki dashboards to the new label order - container_name and pod_name have disappeared in K8s 1.16. - We are changing the instance name in Prometheus (and removing it in Loki altogether). The instance name used to be the pod name, so switch usage of the instance label to the pod label. The pod label will generally only appear as a target label with rolling out recent changes to target labels. This will unfortunately break dashboards if looking at older data.	5 years ago
Owen Diehl	89d80a6fc4	Feature/querysharding ii (#1927 ) * [wip] sharding evaluator/ast * [wip] continues experimenting with ast mapping * refactoring in preparation for binops * evaluators can pass state to other evaluators * compiler alignment * Evaluator method renamed to StepEvaluator * chained evaluator impl * tidying up sharding code * handling for ConcatSampleExpr * downstream iterator * structure for downstreaming asts * outlines sharding optimizations * work on sharding mapper * ast sharding optimizations * test for different logrange positions * shard mapper tests * stronger ast sharding & tests * shardmapper tests for string->string * removes sharding evaluator code * removes unused ctx arg * Revert "removes sharding evaluator code" This reverts commit `55d41b9519`. * interfaces for downstreaming, type conversions * sharding plumbing on frontend * type alignment in queryrange to downstream sharded queriers * downstreaming support for sharding incl storage code * removes chainedevaluator * comment alignment * storage shard injection * speccing out testware for sharding equivalence * [wip] shared engine refactor * sorting streams, sharding eval fixes * downstream evaluator embeds defaultevaluator * other pkgs adopt logql changes * metrics & logs use same middleware instantiation process * wires up shardingware * middleware per metrics/logfilter * empty step populating StepEvaluator promql.Matrix adapter * sharding metrics * log/span injection into sharded engine * sharding metrics avoids multiple instantiation * downstreamhandler tracing * sharding parameterized libsonnet * removes querier replicas * default 32 concurrency for workers * jsonnet correct level override * unquote true in yaml * lowercase error + downstreamEvaluator defaults to embedded defaultEvaluator * makes shardRecorder private * logs query on failed parse * refactors engine to be multi-use, minimizes logger injection, generalizes Query methods, removes Engine interface * basic tests for querysharding mware * [wip] concurrent evaluator * integrates stat propagation into sharding evaluator * splitby histogram * extends le bounds for bytes processed * byte throughput histogram buckets to 40gb * chunk duration mixin * fixes merge w/ field rename * derives logger in sharded engine via ctx & logs some downstream evaluators * moves sharded engine to top, adds comments * logs failed merge results in stats ctx * snapshotting stats merge logic is done more effectively * per query concurrency controlled via downstreamer * unexports decodereq * queryrange testware * downstreamer tests * pr requests	5 years ago
Björn Rabenstein	d343c09aa9	Accept suffixes to pod name in instance labels (#2080 ) Currently, the instance label is just the pod name, but that's insufficient, cf. https://github.com/grafana/deployment_tools/issues/3441 . In the near future, we'll suffix the pod name in the instance label with container name and/or port name. To make this mixin still work, adjust the `instance` label matcher. Signed-off-by: beorn7 <beorn@grafana.com>	5 years ago
Cyril Tovena	bce4470a5b	Recover from panic in http and grpc handlers. (#2059 ) * Recover from panic in http and grpc handlers. I don't see any good reason to crash any component during a bad request. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add alerts to the mixin for panics. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * 😡 gomod Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Ed Welch	2629e9a3d6	fixes the cpu usage graphs (#2044 ) Signed-off-by: Ed Welch <edward.welch@grafana.com>	5 years ago
Joe Elliott	236d3728d5	Swapped to container restarts over terminated reasons (#2043 ) Signed-off-by: Joe Elliott <number101010@gmail.com>	5 years ago
Ed Welch	fd99dbc926	Dashboard: Loki Operational improvements (#2041 ) * fixing indentation so I can see diffs better Signed-off-by: Ed Welch <edward.welch@grafana.com> * add rows for chunks, streams, dropped samples. success rate graphs now only look at 5xx errors (4xx are considered "successful") Limited the mouseover to only show the active line for a bunch of graphs. Signed-off-by: Ed Welch <edward.welch@grafana.com>	5 years ago
Tom Wilkie	0170249eae	Put loki-mixin and promtail-mixin dashboards in a folder.	5 years ago
Tom Wilkie	8e5fa03de3	s/dashboards/grafanaDashboards. Signed-off-by: Tom Wilkie <tom@grafana.com>	5 years ago
Joe Elliott	61bfa20ad5	Dashboard Cleanup (#1767 ) * Removed env references from operational dashboard Signed-off-by: Joe Elliott <number101010@gmail.com> * Updated refresh on template vars Signed-off-by: Joe Elliott <number101010@gmail.com> * Standard formatting Signed-off-by: Joe Elliott <number101010@gmail.com> * Removed env references Signed-off-by: Joe Elliott <number101010@gmail.com> * Added queries Signed-off-by: Joe Elliott <number101010@gmail.com> * memory => working set Signed-off-by: Joe Elliott <number101010@gmail.com>	5 years ago
Joe Elliott	e0d9be19e7	Move dashboards out into their own json files (#1766 ) Signed-off-by: Joe Elliott <number101010@gmail.com>	5 years ago
Edward Welch	f9e37e2997	breakout promtail mixin to be separate. Signed-off-by: Edward Welch <edward.welch@grafana.com>	5 years ago
Cyril Tovena	f3332272ed	Update Loki mixin to include frontend QPS and latency. (#1497 ) Also rework frontend route registration to name metrics and spans correctly. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	5 years ago
Cyril Tovena	4153740a12	Loki Query Frontend (#1442 ) * Adds frontend to Loki. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improves tests. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes sneaky bug in entries sorting. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes the split by interval. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Tweak jsonnet deployments and add a way to lint/fmt. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * lint. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * fix timezone issue. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve tests and rollback change in loghttp package. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes a flaky test that might run one more goroutine. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes windows build. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve tracing in the split by interval. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add test stream to proto conversion. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Fixes flappy retry test. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove err shadowing in stopQueryFrontend as it was confusing. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Refactor grpc message size in the libsonnet config file. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Don't check auth header for GRPC TransferChunks. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Query frontend (#3) * frontend codec merging optimizations * codec benchmarks * removes unused bounds code in queryrange ordering * [wip] splitby uses channels instead of sub batching intervals * splitBy channel limit test * single allocation for merging entries from a single stream * skip merging loki responses when limit is already hit * removes checks for unlimited queries in queryrange * removes splitByInterval{,.interval} spans * removes interval_batch_size from jsonnet lib * moves benchmark utils to own file * renames markers -> entries * priority queue comments * Removes unused logRequest. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Sets the cache interval to the same split interval. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Missing import libsonnet for the frontend. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Frontend should not be a cluster IP. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> Co-authored-by: Owen Diehl <ow.diehl@gmail.com>	5 years ago
Ed Welch	f7aaf6ef55	use regex label matcher to not alert on any tail route latencies (#1221 ) * use regex label matcher to not alert on any tail route latencies * simplify regex	6 years ago
Edward Welch	5be5b4dd8e	sum the bad words by name and level such that there isn't a spike during rollouts (previously summing by instance meant a new instance had no old metrics to compare to causing a spike in the output)	6 years ago
Edward Welch	385abd8cef	update dashboards to include the new /loki/api/v1/* endpoints in addition to the deprecated /api/prom/*	6 years ago
Joe Elliott	dd4c1387b6	Remove rules that reference no longer existing metrics Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Joe Elliott	d5758e39d7	Update loki operational (#1212 ) * Added deployment annotations and cassandra metrics * Added wrapper annotations Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Joe Elliott	1c1dfa98d7	Adding Operational dashboards (#1188 ) * First pass added dashboards Signed-off-by: Joe Elliott <number101010@gmail.com> * Added dummy rows field b/c the kubernetes-mixin fails if they don't exist Signed-off-by: Joe Elliott <number101010@gmail.com> * Added Dynamo and S3 Signed-off-by: Joe Elliott <number101010@gmail.com>	6 years ago
Joe Elliott	b835e2082a	Fix Loki Chunks Dashboard (#1126 ) This commit cleans up the Loki Chunks dashboard either by renaming incorrectly named series or adding needed metrics. Added new metrics: - loki_ingester_memory_chunks - loki_ingester_memory_streams - loki_ingester_chunk_utilization - loki_ingester_chunk_compression_ratio The following metrics were already being published with a different name. Fixed in the dashboard: - cortex_chunk_store_index_entries_per_chunk - cortex_ingester_flush_queue_length - loki_ingester_chunk_entries	6 years ago
Edward Welch	4354f8031e	Removing the loki-frontend dashboard as it only has one panel which is duplicated in the loki-reads panel, we can bring it back when add more to the loki frontend.	6 years ago
Edward Welch	7b31c6634d	sum the read dashboard by route and make sure we are only showing query and label routes (not tail)	6 years ago
sh0rez	6595d8df57	BREAKING fix(loki-mixin): rename rules key (#691 ) Renames the `prometheus_rules` key to `prometheusRules` to comply to the spec (https://github.com/monitoring-mixins/docs/blob/master/design.pdf) BREAKING `prometheus_rules` is not available anymore	6 years ago
Edward Welch	dc2190f80b	updating the loki dashboards to use the metrics from the new gateway	6 years ago
Edward Welch	947428d77e	Adding a check to make sure we don't set tailer offset past the end of the file. Fixing lagging alert to also catch when the read_bytes is past the end of the file. Adding an alert to let us know if we are missing tailing of any files.	6 years ago
Ed	ca1a5be975	Adding metric and alert to notify promtail falling behind (#412 ) * Adding the metric promtail_file_bytes_total which will report on the total size of each file with an active tailer. Added an alert which will fire whenever the total bytes for a file is 100kb or more ahead the read bytes for more than 15mins. Added an additional alert to track client bytes ready to send (encoded bytes) vs actually sent so we can add an alert on promtail send failures and still track stats on encoded bytes being sent. * Moving where we update the total file bytes outside the tailer so it shouldn't get hung up by tailer issues. * Recording file size based on Glob matches rather than what we are tailing to give even better insight	6 years ago
Tom Wilkie	899faf1e6c	Don't commit jsonnet lock file. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	e7931a50d0	Fix promtail active targets & files dashboard. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	6d19632215	add active files and targets to promtail dashboard. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	60ea486a31	Add lines & bytes read to promtail dashboard. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	928acc17a2	Look for promtail image in promtail dashboards. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	ffe109384b	Tweak Loki Writes dashboards, add resource request and limits to distributor and ingester ksonnet. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	97a87f5af0	Fixup Loki monitoring mixin (#248 ) * Fix the mixin to reference the mixin-utils pkg. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * s/g.selector/utils.selector/ Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Actually import utils. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Don't cut corners with replacing. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	6 years ago
Tom Wilkie	db114b60da	Move all the config for various ways of deploying Loki into one place. (#125 ) * Move all the config for various ways of deploying Loki into one place. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Fix reference to consul ksonnet module. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Move getting started docs into the production dir. Remove the raw docker commands, only use the compose file. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Spell production correctly. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Tweaks Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * Tweak docs and docker compose setup; put config in images. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com> * typo Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	7 years ago

42 Commits (a62f81f1cf15d49e02958ae9a6097e84986ea336)