prometheus

Commit Graph

Author	SHA1	Message	Date
Julien Pivotto	a5671a002f	API: Add a /api/v1/features endpoint Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	1 week ago
Julien Pivotto	5b26619565	web/api: Add maximum limit validation to TSDB status endpoint Add a maximum limit of 10,000 to the TSDB status endpoint to prevent resource exhaustion from excessively large limit values, as we preallocate []Stat for up to the limit: `make([]Stat, 0, length)`. Note that the endpoint acquires a cardinality mutex during stats calculation, so this can not be run in parallel. Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	1 week ago
Julien Pivotto	1a853e23db	Add start_timestamp field for unit tests. This commit adds support for configuring a custom start timestamp for Prometheus unit tests, allowing tests to use realistic timestamps instead of starting at Unix epoch 0. Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	2 weeks ago
Gabriel Filion	9f0b52d73a	docs: Describe how time() is set to start at 0 in unit tests The return value of functions relating to the current time, e.g. time(), is set by promtool to start at timestamp 0 at the start of a test's evaluation. This has the very nice consequence that tests can run reliably without depending on when they are run. It does, however, mean that tests will give out results that can be unexpected by users. If this behaviour is documented, then users will be empowered to write tests for their rules that use time-dependent functions. (Closes: prometheus/docs#1464) Signed-off-by: Gabriel Filion <lelutin@torproject.org>	2 weeks ago
Ben Edmunds	0e682a70a6	RW2: Allow custom scope in azuread (#17483 ) Signed-off-by: Ben Edmunds <sammybenblue2@gmail.com>	2 weeks ago
Łukasz Mierzwa	8a1086a128	feat: Add flag that blocks lvl 1 compactions until upload is confirmed in an external JSON file (#17435 ) * Delay compactions until Thanos uploads all blocks Using Thanos sidecar with Prometheus requires us to disable TSDB compactions on Prometheus side by setting --storage.tsdb.min-block-duration and --storage.tsdb.max-block-duration to the same value. See https://thanos.io/tip/components/sidecar.md. The main problem this avoids is that Prometheus might compact given block before Thanos uploads it, creating a gap in Thanos metrics. Thanos does not upload compacted blocks because that would upload the same sample multiple times. You can tell Thanos to upload compacted blocks but that is aimed at one time migrations. This patch creates a bridge between Thanos and Prometheus by allowing Prometheus to read the shipper file Thanos creates, where it tracks which blocks were already uploaded, and using that data delays compaction of blocks until they are marked as uploaded by Thanos. Thanks to this both services can coordinate with each other (in a way) and we can stop disabling compaction on Prometheus side when Thanos uploads are enabled. The reason to have this is that disabling compactions have very dramatic performance cost. Since most time series exist for longer than a single block duration (2h by default) large chunks of block index will reference the same series, so 10 * 2h blocks will each have an index that is usually fairly big and is almost the same for all 10 blocks. Compaction de-duplicates the index so merging 10 blocks together would leave us with a single index that is around the same size as each of these 10 2h blocks would have (plus some extra for series that only exists in some blocks, but not all). Every range query that iterates over all 10 blocks would then have to read each index and so we're doing 10x more work then if we had a single compacted block. Signed-off-by: Lukasz Mierzwa <l.mierzwa@gmail.com> * Rename structs and functions to make this more generic Signed-off-by: Lukasz Mierzwa <l.mierzwa@gmail.com> * Address review comments Signed-off-by: Lukasz Mierzwa <l.mierzwa@gmail.com> * Cache UploadMeta for 1 minute Signed-off-by: Lukasz Mierzwa <l.mierzwa@gmail.com> --------- Signed-off-by: Lukasz Mierzwa <l.mierzwa@gmail.com>	2 weeks ago
Ben Kochie	b415208a90	Update Prometheus Agent doc (#17591 ) * Add a nav title to fix docs website generator. * Make it more clear that "Prometheus Agent" is a mode, not a seaparate service. * Add to index. * Cleanup some wording. * Add a downsides section. Signed-off-by: SuperQ <superq@gmail.com> (cherry picked from commit `d0d2699dc5`)	4 weeks ago
Ben Kochie	d0d2699dc5	Update Prometheus Agent doc (#17591 ) * Add a nav title to fix docs website generator. * Make it more clear that "Prometheus Agent" is a mode, not a seaparate service. * Add to index. * Cleanup some wording. * Add a downsides section. Signed-off-by: SuperQ <superq@gmail.com>	4 weeks ago
beorn7	be4efd740c	cmd: Make feature flag `native-histograms` a no-op. Signed-off-by: beorn7 <beorn@grafana.com>	1 month ago
zenador	c64dd612ef	PromQL: Fix bug with inconsistent results for queries with OR expression and EnableDelayedNameRemoval (#17161 ) Signed-off-by: Jeanette Tan <jeanette.tan@grafana.com> Signed-off-by: zenador <zenador@users.noreply.github.com> Co-authored-by: Björn Rabenstein <github@rabenste.in>	1 month ago
Raul Leite	407b697ee2	structure adjusted as reccomended Corrected the structure of the explanation regarding how samples are organized in the chunks directory and the handling of deletion records. Signed-off-by: Raul Leite <sp4wn.root@gmail.com>	1 month ago
Raul Leite	c9827ef983	Fix formatting in storage.md extra space removed Signed-off-by: Raul Leite <sp4wn.root@gmail.com>	1 month ago
Raul Leite	e022a727a8	I’ve proposed a slight rewording of this section to improve clarity and readability. (On-Disk Layout Paragraph) Signed-off-by: Raul Leite <sp4wn.root@gmail.com>	1 month ago
Bartlomiej Plotka	f50ff0a40a	feat: rename CreatedTimestamp to StartTimestamp (#17523 ) Partially fixes https://github.com/prometheus/prometheus/issues/17416 by renaming all CT* names to ST* in the whole codebase except RW2 (this is done in separate [PR](https://github.com/prometheus/prometheus/pull/17411)) and PrometheusProto exposition proto. ``` CreatedTimestamp -> StartTimestamp CreatedTimeStamp -> StartTimestamp created_timestamp -> start_timestamp CT -> ST ct -> st ``` Signed-off-by: bwplotka <bwplotka@gmail.com>	1 month ago
Charles Korn	0fbe5af961	Fix heading for `limitk` docs Signed-off-by: Charles Korn <charleskorn@users.noreply.github.com>	1 month ago
matt-gp	1b52ab9e3b	feat: AWS ECS Service Discovery Signed-off-by: matt-gp <small_minority@hotmail.com>	1 month ago
Minh Nguyen	9f93c2d2e1	promtool: Add Remote Write 2.0 support to push metrics command (#17417 ) * add feature flag for remote write v2 Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * change from number to protobuf_message Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix test Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix name Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * run make cli-documentation Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix help Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * run make cli-documentation Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> --------- Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com>	2 months ago
Minh Nguyen	c8f1de18a7	[RW2] Fix type and unit labels propagation in Remote Write v2 receiver to prioritize type-and-unit-labels feature (#17387 ) * fix Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix nits & update docs Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix docs Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> --------- Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com>	2 months ago
geogrego	58dbe927d5	docs: minor improvement for docs Signed-off-by: geogrego <geogrego@outlook.com>	2 months ago
Minh Nguyen	ad4b59c504	tsdb: Deprecate retention flags; add tsdb.retention runtime configuration (#17026 ) * Move storage from CL to config file Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * Fix .md Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * run make cli-documentation Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * run make cli-documentation Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * nit_fixed Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * add test and update configuration.md Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix lint Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> --------- Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com>	2 months ago
Sylvain Rabot	50de066a7e	Add urlQueryEscape to template functions Signed-off-by: Sylvain Rabot <sylvain@abstraction.fr>	2 months ago
György Krajcsovits	c929578718	feat(nh): mark native histograms as stable in docs Fixes: #16572 Mark as stable means that breaking changes are only allowed together with major version release of Prometheus. Co-authored-by: Björn Rabenstein <beorn@grafana.com> Signed-off-by: George Krajcsovits <krajorama@users.noreply.github.com> Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com>	2 months ago
Julius Volz	ae83804ab0	docs: Minor formatting/typo fixes in the HTTP API docs (#17339 ) Signed-off-by: Julius Volz <julius.volz@gmail.com>	2 months ago
Arve Knudsen	ef42c088ba	OTLP: Add configuration parameters to control label name translation (#17345 ) As a follow-up to #17344, add two configuration parameters for controlling label name translation, both defaulting to on for backwards compatibility (currently these behaviours are hardcoded as enabled): * otlp.label_name_underscore_sanitization => Prefix label names starting with a single underscore with key_ when translating OTel attribute names * otlp.label_name_preserve_multiple_underscores => Keep multiple consecutive underscores in label names when translating OTel attribute names Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	2 months ago
Arve Knudsen	f5804e7cf2	Remove configuration parameters Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	2 months ago
Arve Knudsen	dd3a607d2d	Add configuration parameters Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	2 months ago
Julius Volz	8b1bd7d6c3	ui: Allow viewing detailed relabeling steps for each discovered target This adds: * A `ScrapePoolConfig()` method to the scrape manager that allows getting the scrape config for a given pool. * An API endpoint at `/api/v1/targets/relabel_steps` that takes a pool name and a label set of a target and returns a detailed list of applied relabeling rules and their output for each step. * A "show relabeling" link/button for each target on the discovery page that shows the detailed flow of all relabeling rules (based on the API response) for that target. Note that this changes the JSON encoding of the relabeling rule config struct to output the original snake_case (instead of camelCase) field names, and before merging, we need to be sure that's ok :) See my comment about that at https://github.com/prometheus/prometheus/pull/15383#issuecomment-3405591487 Fixes https://github.com/prometheus/prometheus/issues/17283 Signed-off-by: Julius Volz <julius.volz@gmail.com>	2 months ago
beorn7	ad7d1aed99	Phase out native histogram feature flag The detailed plan for this is laid out in https://github.com/prometheus/prometheus/issues/16572 . This commit adds a global and local scrape config option `scrape_native_histograms`, which has to be set to true to ingest native histograms. To ease the transition, the feature flag is changed to simply set the default of `scrape_native_histograms` to true. Further implications: - The default scrape protocols now depend on the `scrape_native_histograms` setting. - Everywhere else, histograms are now "on by default". Documentation beyond the one for the feature flag and the scrape config are deliberately left out. See https://github.com/prometheus/prometheus/pull/17232 for that. Signed-off-by: beorn7 <beorn@grafana.com>	2 months ago
Will Bollock	e894a22b88	feat: add config label to refresh metrics Adds a `config` label (similar to `prometheus_sd_discovered_targets`) to refresh metrics to help identify the source of refresh issues or performance stats. In particular for HTTP SD, it can be common to have multiple disparate HTTP SD sources that should be identified and not lumped together. For example if one HTTP SD service has failures, that should be evident in its own time series seperate from other HTTP SD sources. `config` seemed more appropriate than `endpoint` as a general standard for `prometheus_sd` metrics. Docs were also updated for HTTP SD to point at the new refresh metrics rather than the older metrics. Signed-off-by: Will Bollock <wbollock@linode.com>	2 months ago
Devansh Sehgal	abf67c8641	docs: document sigv4.use_fips_sts_endpoint in <http_config> Signed-off-by: Devansh Sehgal <devanshsehgal02@gmail.com>	2 months ago
beorn7	e94031abd2	docs: Clarify the handling of negative histograms Signed-off-by: beorn7 <beorn@grafana.com>	3 months ago
Bryan Boreham	a59f3e090b	[DOCS] API: Document the lookback_delta parameter Signed-off-by: Bryan Boreham <bjboreham@gmail.com>	3 months ago
Julien	4199c2f45a	Add anchored and smoothed to vector selectors. (#16457 ) * Add anchored and smoothed to vector selectors. This adds "anchored" and "smoothed" keywords that can be used following a matrix selector. "Anchored" selects the last point before the range (or the first one after the range) and adds it at the boundary of the matrix selector. "Smoothed" applies linear interpolation at the edges using the points around the edges. In the absence of a point before or after the edge, the first or the last point is added to the edge, without interpolation. Exemple usage * `increase(caddy_http_requests_total[5m] anchored)` (equivalent of caddy_http_requests_total - caddy_http_requests_total offset 5m but takes counter reset into consideration) * `rate(caddy_http_requests_total[step()] smoothed)` Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com> * Update docs/feature_flags.md Co-authored-by: Charles Korn <charleskorn@users.noreply.github.com> Signed-off-by: Julien <291750+roidelapluie@users.noreply.github.com> * Smoothed/Anchored rate: Add more tests Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com> * Anchored/Smoothed modifier: error out with histograms Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com> --------- Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com> Signed-off-by: Julien <291750+roidelapluie@users.noreply.github.com> Co-authored-by: Charles Korn <charleskorn@users.noreply.github.com>	3 months ago
Simon Pasquier	dde7d6ad37	doc: clarify start/end for label API endpoints (#17217 ) Because the label API endpoints read from the TSDB indexes, they can return information for series which are present in the index but have no samples in the queried interval. Add similar note for the series endpoint. Signed-off-by: Simon Pasquier <spasquie@redhat.com>	3 months ago
dancer1325	a14faab435	docs(): fix gettingStarted outdated graph reference /graph does NOT exist anymore in the new React app. It has been refactored within /query Signed-off-by: dancer1325 <alfredotic0809@gmail.com>	3 months ago
Aditya Tiwari	1c974108f3	docs: fix typos and formatting in querying functions and storage Signed-off-by: Aditya Tiwari <adityatiwari342005@gmail.com>	3 months ago
Daniel Gospodinow	562d13e930	docs: minor grammar improvements in `basics.md` (#17077 ) Corrected minor grammatical errors in the documentation. Signed-off-by: Daniel Gospodinow <danielgospodinow@gmail.com>	4 months ago
Craig Ringer	1ce84d8e2f	feat(promql): add first_over_time and ts_of_first_over_time Add a first_over_time function, and corresponding ts_of_first_over_time function. Both are behind the experimental functions feature flag. Signed-off-by: Craig Ringer <craig.ringer@enterprisedb.com>	4 months ago
bragi92	20580b6ba8	remote_write azure auth : add workload identity support (#16788 ) * initial changes Signed-off-by: Kaveesh Dubey <kadubey@microsoft.com> * . Signed-off-by: Kaveesh Dubey <kadubey@microsoft.com> * fix comments Signed-off-by: Kaveesh Dubey <kadubey@microsoft.com> * fix tenantid test Signed-off-by: Kaveesh Dubey <kadubey@microsoft.com> * style Signed-off-by: Kaveesh Dubey <kadubey@microsoft.com> * Update storage/remote/azuread/azuread.go Co-authored-by: Bartlomiej Plotka <bwplotka@gmail.com> Signed-off-by: bragi92 <kadubey@microsoft.com> * Update storage/remote/azuread/azuread.go Co-authored-by: Bartlomiej Plotka <bwplotka@gmail.com> Signed-off-by: bragi92 <kadubey@microsoft.com> * Update storage/remote/azuread/azuread.go Co-authored-by: Bartlomiej Plotka <bwplotka@gmail.com> Signed-off-by: bragi92 <kadubey@microsoft.com> * Update storage/remote/azuread/azuread.go Co-authored-by: Bartlomiej Plotka <bwplotka@gmail.com> Signed-off-by: bragi92 <kadubey@microsoft.com> * Update storage/remote/azuread/azuread.go Co-authored-by: Bartlomiej Plotka <bwplotka@gmail.com> Signed-off-by: bragi92 <kadubey@microsoft.com> * Update storage/remote/azuread/azuread.go Co-authored-by: Bartlomiej Plotka <bwplotka@gmail.com> Signed-off-by: bragi92 <kadubey@microsoft.com> * Update storage/remote/azuread/azuread.go Co-authored-by: Bartlomiej Plotka <bwplotka@gmail.com> Signed-off-by: bragi92 <kadubey@microsoft.com> * pr feedback Signed-off-by: Kaveesh Dubey <kadubey@microsoft.com> --------- Signed-off-by: Kaveesh Dubey <kadubey@microsoft.com> Signed-off-by: bragi92 <kadubey@microsoft.com> Co-authored-by: Bartlomiej Plotka <bwplotka@gmail.com>	4 months ago
beorn7	1071c82b42	docs: counter vs. gauge histogram behavior with `+`/`-` This mostly handles the cases mentioned in #16576. However, there are some related changes in here, too: - Some line formatting to avoid lines longer than 80 characters. - Establish in basics.md that histograms have a counter vs. gauge "flavor" that is also stored in the sample and not just by convention as for float samples. - Add the documentation of the unary minus, which was missing so far. This require a bit of restructuring. - Cleaned up a few references to "Prometheus" that should better refer to "PromQL" (and "Prometheus's query language" → "PromQL" etc.). I decided to not explain in all detail when and how PromQL detects an incompatible counter reset. The spec is linked from basics.md, so the minority that might be interested in this can still look it up. Signed-off-by: beorn7 <beorn@grafana.com>	4 months ago
shk1999	6851b1095c	chore(configuration.md): fix unit_testing_rules typo Signed-off-by: shk1999 <sh.karimi@vasl.ir>	4 months ago
machine424	a48d348811	chore: exclude experimental /v1/ endpoints from stability guarantees a bunch is marked as experimental in https://prometheus.io/docs/prometheus/latest/querying/api/ Signed-off-by: machine424 <ayoubmrini424@gmail.com>	4 months ago
Olivier Lemasle	da9b8b2f8d	chore(configuration.md): Fix typo Signed-off-by: Olivier Lemasle <o.lemasle@gmail.com>	5 months ago
Arthur Silva Sens	3602785a89	Support including scope metadata as metric labels (#16878 ) * Support including scope metadata as metric labels Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com> * Ensure Scope Name, Version and Schema URL aren't overriden by attributes Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com> --------- Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com>	5 months ago
machine424	b74c3ce153	chore(configuration.md): adjust kubernetes DS config Signed-off-by: machine424 <ayoubmrini424@gmail.com>	5 months ago
machine424	a9f6fdd910	feat(discovery/kubernetes): allow attaching namespace metadata to ingress and service roles. with the help of claude-4-sonnet Signed-off-by: machine424 <ayoubmrini424@gmail.com>	5 months ago
Bryan Boreham	ad5aadacdd	make cli-documentation Signed-off-by: Bryan Boreham <bjboreham@gmail.com>	5 months ago
Bryan Boreham	065c0ca664	Update Agent docs for new --agent flag Signed-off-by: Bryan Boreham <bjboreham@gmail.com>	5 months ago
Bryan Boreham	3c8d76a55f	Fix up: feature flag and Katakoda have gone Signed-off-by: Bryan Boreham <bjboreham@gmail.com>	5 months ago
Owen Williams	d2f1f4fb27	config: Add UnderscoreEscapingWithoutSuffixes translation strategy (#16849 ) The last permutation of the translation options does underscore translation but does not add suffixes. This translation option already exists in Mimir as otel_metric_suffixes_enabled, indicating external demand for this strategy. There is an accompanying update to prometheus-docs to explain the use of this mode: https://github.com/prometheus/docs/pull/2688 Signed-off-by: Owen Williams <owen.williams@grafana.com>	5 months ago

1 2 3 4 5 ...

1099 Commits (main)