prometheus

Commit Graph

Author	SHA1	Message	Date
hridyesh bisht	b64d56cbf3	Fix a couple of broken links in configuration.md (#18045 ) Signed-off-by: kakabisht <kakabisht07@gmail.com>	2 days ago
George Krajcsovits	6fec996722	docs(api): clarify metadata vs remote protocols (#17481 ) Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com>	5 days ago
Ian Kerins	4383499997	promtool: support missing promql syntax features (#17926 ) Namely promql-duration-expr and promql-extended-range-selectors. This allows promtool to e.g. check rules files using syntax gated by these features. Signed-off-by: Ian Kerins <git@isk.haus>	6 days ago
Mohammad Abbasi	a19a5314a3	fix(docs): typo in prometheus_agent.md doc Signed-off-by: Mohammad Abbasi <mohammad.v184@gmail.com>	7 days ago
Matt	cf9d093f8f	prw2: Move Remote Write 2.0 CT to be per Sample; Rename to ST (start timestamp) (#17411 ) (#17600 ) Relates to https://github.com/prometheus/prometheus/issues/16944#issuecomment-3164760343 Signed-off-by: bwplotka <bwplotka@gmail.com> Signed-off-by: matt-gp <small_minority@hotmail.com> Co-authored-by: Bartlomiej Plotka <bwplotka@gmail.com>	1 week ago
Eric Eastwood	f0f40b970d	Document special labels that affect scraping and targets (`__address__`, `__scheme__`, `__metrics_path__`, `__scrape_interval__`, `__scrape_timeout__`) (#17765 ) Signed-off-by: Eric Eastwood <contact@ericeastwood.com>	2 weeks ago
Julien	75f94903b3	Add OpenAPI 3.2 specification generation for Prometheus HTTP API (#17825 ) * Add OpenAPI 3.2 specification generation for Prometheus HTTP API This commit introduces an OpenAPI specification for the Prometheus API. After testing multiple code-generation servers with built-in APIs, this implementation uses an independent spec file outside of the critical path. This spec file is tested with a framework present in this pull request. The specification helps clients know which parameters they can use and is served at /api/v1/openapi.yaml. The spec file will evolve with the Prometheus API and has the same version number. Downstream projects can tune the APIs presented in the spec file with configuration options using the IncludePaths setting for path filtering. In the future, there is room to generate a server from this spec file (e.g. with interfaces), but this is out of scope for this pull request. Architecture: - Core OpenAPI infrastructure (openapi.go): Dynamic spec building, caching, and thread-safe spec generation - Schema definitions (openapi_schemas.go): Complete type definitions for all API request and response types - Path specifications (openapi_paths.go): Endpoint definitions with parameters, request bodies, and response schemas - Examples (openapi_examples.go): Realistic request/response examples - Helper functions (openapi_helpers.go): Reusable builders for common OpenAPI structures Testing: - Comprehensive test suite with golden file validation - Test helpers package for API testing infrastructure - OpenAPI compliance validation utilities The golden file captures the complete specification for snapshot testing. Update with: go test -run TestOpenAPIGolden -update-openapi-spec REVIEWERS: The most important thing to check would be the OpenAPI golden file (web/api/v1/testdata/openapi_golden.yaml). Test scenarios are important as they test the actual OpenAPI spec validity. Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com> * Add OpenAPI 3.1 support with version selection Add support for both OpenAPI 3.1 and 3.2 specifications with version selection via openapi_version query parameter. Defaults to 3.1 for broader compatibility Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com> * Enhance OpenAPI examples and add helper functions - Add timestampExamples helper for consistent time formatting - Add exampleMap helper to simplify example creation - Improve example summaries with query details - Add matrix result example for range vector queries Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com> * web/api: Add AtST method to test helper iterators Implement the AtST() method required by chunkenc.Iterator interface for FakeSeriesIterator and FakeHistogramSeriesIterator test helpers. The method returns 0 as these test helpers don't use start timestamps Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com> * OpenAPI: Add minimum coverage test Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com> * OpenAPI: Improve examples handling Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com> --------- Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	2 weeks ago
Jeanette Tan	df31bfd59d	Update docs about ignoring info metrics Signed-off-by: Jeanette Tan <jeanette.tan@grafana.com>	3 weeks ago
Ganesh Vernekar	8721871cf7	docs: Document the stale_series_compaction_threshold config file option (#17928 ) Signed-off-by: Ganesh Vernekar <ganesh.vernekar@reddit.com> Signed-off-by: Björn Rabenstein <beorn@grafana.com> Co-authored-by: Björn Rabenstein <beorn@grafana.com>	3 weeks ago
Julius Volz	90dbdcd5dc	Fix a missing space/newline in the binop docs Signed-off-by: Julius Volz <julius.volz@gmail.com>	4 weeks ago
Julius Volz	d3b6e61487	Put binop fill modifiers behind a feature flag Signed-off-by: Julius Volz <julius.volz@gmail.com>	1 month ago
Julius Volz	4c97952210	Document new fill binop modifiers Signed-off-by: Julius Volz <julius.volz@gmail.com>	1 month ago
Arthur Silva Sens	1e317d0098	Add configuration option to control `extra-scrape-metrics` (#17606 )	1 month ago
Julien Pivotto	bbd1e63783	docs: Update API documentation for missing features - Add stats parameter documentation for query endpoints. - Add documentation for new /api/v1/scrape_pools endpoint (added in v2.42). Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	1 month ago
matt-gp	9b6e244b83	AWS SD: ECS Bridge Mode Previously the AWS SD ECS Role only discovered instances that used `awsvpc` network mode, which attaches a dedicated Elastic Network Interface (ENI). This change adds in additional logic so that we discover instances that are using `host` and `bridge` networking modes, where the IP address is that of the EC2 instance that is hosting the container. Also this change exposes a number of additional labels that relate to the EC2 instance when the launch type is `EC2`. Signed-off-by: matt-gp <small_minority@hotmail.com>	2 months ago
Aditya Tiwari	146080186d	promtool: Add --lint flag to check metrics command to allow disabling linting (#17669 ) * promtool: allow cardinality with metrics linting and add --lint to check metrics Signed-off-by: ADITYA TIWARI <adityatiwari342005@gmail.com> * fix/ci: Simplify test case variable declaration Remove unnecessary variable declaration in test cases. Signed-off-by: ADITYA TIWARI <142050150+ADITYATIWARI342005@users.noreply.github.com> * promtool: avoid Tee for --lint=none Signed-off-by: ADITYA TIWARI <adityatiwari342005@gmail.com> * promtool: validate at least one feature enabled in check metrics addresses feedback to ensure the command does something useful now fails with clear error when both --lint=none and no --extended flag. Signed-off-by: ADITYA TIWARI <adityatiwari342005@gmail.com> --------- Signed-off-by: ADITYA TIWARI <adityatiwari342005@gmail.com> Signed-off-by: ADITYA TIWARI <142050150+ADITYATIWARI342005@users.noreply.github.com>	2 months ago
Jorge Turrado Ferrero	cdc31d96f9	feat: Document how to authenticate STACKIT Service Accounts using RFC7523 (#17645 )	2 months ago
Julien Pivotto	d0b122a711	PromQL: duration expression: add range() Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	2 months ago
Julien Pivotto	a5671a002f	API: Add a /api/v1/features endpoint Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	2 months ago
Julien Pivotto	5b26619565	web/api: Add maximum limit validation to TSDB status endpoint Add a maximum limit of 10,000 to the TSDB status endpoint to prevent resource exhaustion from excessively large limit values, as we preallocate []Stat for up to the limit: `make([]Stat, 0, length)`. Note that the endpoint acquires a cardinality mutex during stats calculation, so this can not be run in parallel. Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	2 months ago
Jorge Turrado	f0325c5875	apply feedback Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>	2 months ago
Julien Pivotto	1a853e23db	Add start_timestamp field for unit tests. This commit adds support for configuring a custom start timestamp for Prometheus unit tests, allowing tests to use realistic timestamps instead of starting at Unix epoch 0. Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	2 months ago
Jorge Turrado Ferrero	e69806289a	chore: Update docs to reflect new oauth parameters Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>	2 months ago
Gabriel Filion	9f0b52d73a	docs: Describe how time() is set to start at 0 in unit tests The return value of functions relating to the current time, e.g. time(), is set by promtool to start at timestamp 0 at the start of a test's evaluation. This has the very nice consequence that tests can run reliably without depending on when they are run. It does, however, mean that tests will give out results that can be unexpected by users. If this behaviour is documented, then users will be empowered to write tests for their rules that use time-dependent functions. (Closes: prometheus/docs#1464) Signed-off-by: Gabriel Filion <lelutin@torproject.org>	2 months ago
Ben Edmunds	0e682a70a6	RW2: Allow custom scope in azuread (#17483 ) Signed-off-by: Ben Edmunds <sammybenblue2@gmail.com>	2 months ago
Łukasz Mierzwa	8a1086a128	feat: Add flag that blocks lvl 1 compactions until upload is confirmed in an external JSON file (#17435 ) * Delay compactions until Thanos uploads all blocks Using Thanos sidecar with Prometheus requires us to disable TSDB compactions on Prometheus side by setting --storage.tsdb.min-block-duration and --storage.tsdb.max-block-duration to the same value. See https://thanos.io/tip/components/sidecar.md. The main problem this avoids is that Prometheus might compact given block before Thanos uploads it, creating a gap in Thanos metrics. Thanos does not upload compacted blocks because that would upload the same sample multiple times. You can tell Thanos to upload compacted blocks but that is aimed at one time migrations. This patch creates a bridge between Thanos and Prometheus by allowing Prometheus to read the shipper file Thanos creates, where it tracks which blocks were already uploaded, and using that data delays compaction of blocks until they are marked as uploaded by Thanos. Thanks to this both services can coordinate with each other (in a way) and we can stop disabling compaction on Prometheus side when Thanos uploads are enabled. The reason to have this is that disabling compactions have very dramatic performance cost. Since most time series exist for longer than a single block duration (2h by default) large chunks of block index will reference the same series, so 10 * 2h blocks will each have an index that is usually fairly big and is almost the same for all 10 blocks. Compaction de-duplicates the index so merging 10 blocks together would leave us with a single index that is around the same size as each of these 10 2h blocks would have (plus some extra for series that only exists in some blocks, but not all). Every range query that iterates over all 10 blocks would then have to read each index and so we're doing 10x more work then if we had a single compacted block. Signed-off-by: Lukasz Mierzwa <l.mierzwa@gmail.com> * Rename structs and functions to make this more generic Signed-off-by: Lukasz Mierzwa <l.mierzwa@gmail.com> * Address review comments Signed-off-by: Lukasz Mierzwa <l.mierzwa@gmail.com> * Cache UploadMeta for 1 minute Signed-off-by: Lukasz Mierzwa <l.mierzwa@gmail.com> --------- Signed-off-by: Lukasz Mierzwa <l.mierzwa@gmail.com>	2 months ago
Ben Kochie	b415208a90	Update Prometheus Agent doc (#17591 ) * Add a nav title to fix docs website generator. * Make it more clear that "Prometheus Agent" is a mode, not a seaparate service. * Add to index. * Cleanup some wording. * Add a downsides section. Signed-off-by: SuperQ <superq@gmail.com> (cherry picked from commit `d0d2699dc5`)	3 months ago
Ben Kochie	d0d2699dc5	Update Prometheus Agent doc (#17591 ) * Add a nav title to fix docs website generator. * Make it more clear that "Prometheus Agent" is a mode, not a seaparate service. * Add to index. * Cleanup some wording. * Add a downsides section. Signed-off-by: SuperQ <superq@gmail.com>	3 months ago
beorn7	be4efd740c	cmd: Make feature flag `native-histograms` a no-op. Signed-off-by: beorn7 <beorn@grafana.com>	3 months ago
zenador	c64dd612ef	PromQL: Fix bug with inconsistent results for queries with OR expression and EnableDelayedNameRemoval (#17161 ) Signed-off-by: Jeanette Tan <jeanette.tan@grafana.com> Signed-off-by: zenador <zenador@users.noreply.github.com> Co-authored-by: Björn Rabenstein <github@rabenste.in>	3 months ago
Raul Leite	407b697ee2	structure adjusted as reccomended Corrected the structure of the explanation regarding how samples are organized in the chunks directory and the handling of deletion records. Signed-off-by: Raul Leite <sp4wn.root@gmail.com>	3 months ago
Raul Leite	c9827ef983	Fix formatting in storage.md extra space removed Signed-off-by: Raul Leite <sp4wn.root@gmail.com>	3 months ago
Raul Leite	e022a727a8	I’ve proposed a slight rewording of this section to improve clarity and readability. (On-Disk Layout Paragraph) Signed-off-by: Raul Leite <sp4wn.root@gmail.com>	3 months ago
Bartlomiej Plotka	f50ff0a40a	feat: rename CreatedTimestamp to StartTimestamp (#17523 ) Partially fixes https://github.com/prometheus/prometheus/issues/17416 by renaming all CT* names to ST* in the whole codebase except RW2 (this is done in separate [PR](https://github.com/prometheus/prometheus/pull/17411)) and PrometheusProto exposition proto. ``` CreatedTimestamp -> StartTimestamp CreatedTimeStamp -> StartTimestamp created_timestamp -> start_timestamp CT -> ST ct -> st ``` Signed-off-by: bwplotka <bwplotka@gmail.com>	3 months ago
Bryan Boreham	beea578b20	Make dump-series a --format flag on the dump command Signed-off-by: Bryan Boreham <bjboreham@gmail.com>	3 months ago
smallfish	5560397a70	promtool: add dump-series Signed-off-by: smallfish <smallfish.xy@gmail.com>	3 months ago
Charles Korn	0fbe5af961	Fix heading for `limitk` docs Signed-off-by: Charles Korn <charleskorn@users.noreply.github.com>	3 months ago
matt-gp	1b52ab9e3b	feat: AWS ECS Service Discovery Signed-off-by: matt-gp <small_minority@hotmail.com>	3 months ago
Minh Nguyen	9f93c2d2e1	promtool: Add Remote Write 2.0 support to push metrics command (#17417 ) * add feature flag for remote write v2 Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * change from number to protobuf_message Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix test Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix name Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * run make cli-documentation Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix help Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * run make cli-documentation Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> --------- Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com>	4 months ago
Minh Nguyen	c8f1de18a7	[RW2] Fix type and unit labels propagation in Remote Write v2 receiver to prioritize type-and-unit-labels feature (#17387 ) * fix Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix nits & update docs Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix docs Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> --------- Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com>	4 months ago
geogrego	58dbe927d5	docs: minor improvement for docs Signed-off-by: geogrego <geogrego@outlook.com>	4 months ago
Minh Nguyen	ad4b59c504	tsdb: Deprecate retention flags; add tsdb.retention runtime configuration (#17026 ) * Move storage from CL to config file Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * Fix .md Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * run make cli-documentation Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * run make cli-documentation Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * nit_fixed Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * add test and update configuration.md Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> * fix lint Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com> --------- Signed-off-by: pipiland2612 <nguyen.t.dang.minh@gmail.com>	4 months ago
Sylvain Rabot	50de066a7e	Add urlQueryEscape to template functions Signed-off-by: Sylvain Rabot <sylvain@abstraction.fr>	4 months ago
György Krajcsovits	c929578718	feat(nh): mark native histograms as stable in docs Fixes: #16572 Mark as stable means that breaking changes are only allowed together with major version release of Prometheus. Co-authored-by: Björn Rabenstein <beorn@grafana.com> Signed-off-by: George Krajcsovits <krajorama@users.noreply.github.com> Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com>	4 months ago
Julius Volz	ae83804ab0	docs: Minor formatting/typo fixes in the HTTP API docs (#17339 ) Signed-off-by: Julius Volz <julius.volz@gmail.com>	4 months ago
Arve Knudsen	ef42c088ba	OTLP: Add configuration parameters to control label name translation (#17345 ) As a follow-up to #17344, add two configuration parameters for controlling label name translation, both defaulting to on for backwards compatibility (currently these behaviours are hardcoded as enabled): * otlp.label_name_underscore_sanitization => Prefix label names starting with a single underscore with key_ when translating OTel attribute names * otlp.label_name_preserve_multiple_underscores => Keep multiple consecutive underscores in label names when translating OTel attribute names Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 months ago
Arve Knudsen	f5804e7cf2	Remove configuration parameters Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 months ago
Arve Knudsen	dd3a607d2d	Add configuration parameters Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com>	4 months ago
Julius Volz	8b1bd7d6c3	ui: Allow viewing detailed relabeling steps for each discovered target This adds: * A `ScrapePoolConfig()` method to the scrape manager that allows getting the scrape config for a given pool. * An API endpoint at `/api/v1/targets/relabel_steps` that takes a pool name and a label set of a target and returns a detailed list of applied relabeling rules and their output for each step. * A "show relabeling" link/button for each target on the discovery page that shows the detailed flow of all relabeling rules (based on the API response) for that target. Note that this changes the JSON encoding of the relabeling rule config struct to output the original snake_case (instead of camelCase) field names, and before merging, we need to be sure that's ok :) See my comment about that at https://github.com/prometheus/prometheus/pull/15383#issuecomment-3405591487 Fixes https://github.com/prometheus/prometheus/issues/17283 Signed-off-by: Julius Volz <julius.volz@gmail.com>	4 months ago
beorn7	ad7d1aed99	Phase out native histogram feature flag The detailed plan for this is laid out in https://github.com/prometheus/prometheus/issues/16572 . This commit adds a global and local scrape config option `scrape_native_histograms`, which has to be set to true to ingest native histograms. To ease the transition, the feature flag is changed to simply set the default of `scrape_native_histograms` to true. Further implications: - The default scrape protocols now depend on the `scrape_native_histograms` setting. - Everywhere else, histograms are now "on by default". Documentation beyond the one for the feature flag and the scrape config are deliberately left out. See https://github.com/prometheus/prometheus/pull/17232 for that. Signed-off-by: beorn7 <beorn@grafana.com>	4 months ago

1 2 3 4 5 ...

1128 Commits (main)