22 Commits (0449a7d9f315a3f2e6e6719f5cced7b189587030)

Author	SHA1	Message	Date
George Robinson	789cfc31e3	Alerting: Fix use of > instead of >= when checking the For duration (#46011)	3 years ago
Yuriy Tseretyan	984c95de63	Do not store EvaluationString in Evaluation. (#44606) ... * do not store evaluation string in Evaluation. * reduce number of buckets to store for a single state	3 years ago
George Robinson	5e2280ceee	Add metrics to ngalert scheduler (#44602) ... This pull request adds metrics to the ngalert scheduler so we can see how long it takes to evaluate a tick.	3 years ago
George Robinson	c932dc959c	Alerting: Add Ref ID to DatasourceNoData and DatasourceError alerts (#42630)	4 years ago
gotjosh	dd5a2e5128	Alerting: Clear alerting rule evaluation errors after intermittent failures (#42386) ... * Alerting: Clear alerting rule evaluation errors after intermittent failures When an alert transitioned in a way that `alerting -> error -> (alerting|nodata)`, the error provided by the `error` state would never be cleared thus the API and UI would show the health as an error.	4 years ago
George Robinson	1b26d4d88e	Alerting: Create DatasourceError alert if evaluation returns error (#41869) ... * Alerting: Create DatasourceError alert if evaluation returns error * Alerting: Add docs for DatasourceError alert * Alerting: Fix DatasourceError alert does not have dashboard_uid label * Alerting: Add break when datasource_uid found * Alerting: Update TestProcessEvalResults	4 years ago
Yuriy Tseretyan	610643a668	Alerting: Special alert instance if rule is in state NoData (#40540) ... * do not suppress NoData state * extract conversion of state to postable alert + tests * create a special alert instance if nodata * use NoData when converting from Keep Last State instead of Alerting * add silence during migration if NoData is mapped to KeepLastState.	4 years ago
George Robinson	27609dc2c5	Fix alerts with evaluation interval more than 30 seconds resolving in Alertmanager (#39513)	4 years ago
gotjosh	dd502f22eb	Alerting: Fix alert flapping in the internal alertmanager (#38648) ... * Alerting: Fix alert flapping in the alertmanager fixes a bug that caused Alerts that are evaluated at low intervals (sub 1 minute), to flap in the Alertmanager. Mostly due to a combination of `EndsAt` and resend delay. The Alertmanager uses `EndsAt` as a heuristic to know whenever it should resolve a firing alert, in the case that it hasn't heard back from the alert generation system. Because grafana sent the alert with an `EndsAt` which is equal to the `For` of the alert itself, and we had a hard-coded 1 minute re-send delay (only applicable to firing alerts) this meant that a firing alert would resolve in the Alertmanager before we re-notify that it still firing. This commit, increases the `EndsAt` by 3x the the resend delay or alert interval (depending on which one is higher). The resendDelay has been decreased to 30 seconds.	4 years ago
Kyle Brandt	aa904a5a04	NGAlert: Send resolve signal to alertmanager on alerting -> Normal (#37363)	4 years ago
George Robinson	456dac1303	Expand the value of math and reduce expressions in annotations and labels (#36611) ... * Expand the value of math and reduce expressions in annotations and labels This commit makes it possible to use the values of reduce and math expressions in annotations and labels via their RefIDs. It uses the Stringer interface to ensure that "{{ $values.A }}" still prints the value in decimal format while also making the labels for each RefID available with "{{ $values.A.Labels }}" and the float64 value with "{{ $values.A.Value }}"	4 years ago
David Parrott	19f18bcecc	Alerting: annotation on state change (#36535) ... * WIP * Add annotation on alert state change * move annotation creation to manager * praise the linter! * add debug msg when creating annotation	4 years ago
David Parrott	4732f832f7	Alerting: recalculate EndsAt (#35830) ... * setEndsAt * one more test case * add should clause to tests	4 years ago
David Parrott	20d356947c	set state correctly and test (#34680)	4 years ago
David Parrott	7a83d1f9ff	Alerting resend delay for sending to notifiers (#34312) ... * adds resend delay to avoid saturating notifier * correct method signatures * pr feedback	4 years ago
David Parrott	25485100b0	Alerting: Trim results when at processing instead of on ticker (#34248) ... * Trim results when at processing instead of on ticker * User RWMutex correctly * remove comment	4 years ago
David Parrott	bbb7bbf891	Alerting: Remove back end logic for supporting KeepLastState (#34242) ... * Removed back end logic for supporting KeepLastState * Map keep_state correctly in migrations	4 years ago
Kyle Brandt	63b2dd06a5	Alerting: Set "value" with evalmatches in G Managed (#34075) ... When, and currently only when using a classic condition, evaluation information is added (which is like the EvalMatches from dashboard alerting). This is returned via the API and can be included in notifications by reading the `__value__` label attached `.Alerts` in the template. It is a string.	4 years ago
David Parrott	b1a8c67689	Alerting return evaluation errors to /rules (#33663) ... * Set and return errors produced by evaluation results * test fixup	4 years ago
Kyle Brandt	7823842c5d	Alerting: Load annotations from rule into State cache (#33542) ... for https://github.com/grafana/alerting-squad/issues/127	4 years ago
Sofia Papagiannaki	1e380e869e	[Alerting]: some fixes (#33538) ... * Fix fialure when adding state annotations * Fix get org rules API Do not fail response if user has no access to view a namespace. Do not include the namespace in the response instead. * lint	4 years ago
David Parrott	788bc2a793	Alerting: refactor state tracker (#33292) ... * set processing time * merge labels and set on response * use state cache for adding alerts to rules * minor cleanup * add support for NoData and Error results * rename test * bring in changes from other PRs tha have been merged * pr feedback * add integration test * close state tracker cleanup on context.Done * fixup test * rename state tracker * set EvaluationDuration on Result * default labels set as constants * separate cache and state from manager * use RWMutex in cache	4 years ago