prometheus

Commit Graph

Author	SHA1	Message	Date
beorn7	a7c519930e	histograms: Add Compact method to the normal integer Histogram And use the new method to call to compact Histograms during parsing. This happens for both `Histogram` and `FloatHistogram`. In this way, if targets decide to optimize the exposition size by merging spans with empty buckets in between, we still get a normalized results. It will also normalize away any valid but weird representations like empty spans, spans with offset zero, and empty buckets at the start or end of a span. The implementation seemed easy at first as it just turns the `compactBuckets` helper into a generic function (which now got its own file). However, the integer Histograms have delta buckets instead of absolute buckets, which had to be treated specially in the generic `compactBuckets` function. To make sure it works, I have added plenty of explicit tests for `Histogram` in addition to the `FloatHistogram` tests. I have also updated the doc comment for the `Compact` method. Based on the insights now expressed in the doc comment, compacting with a maxEmptyBuckets > 0 is rarely useful. Therefore, this commit also sets the value to 0 in the two cases we were using 3 so far. We might still want to reconsider, so I don't want to remove the maxEmptyBuckets parameter right now. Signed-off-by: beorn7 <beorn@grafana.com>	3 years ago
Julien Pivotto	8f3bcfac93	Move to github actions (#11235 ) Signed-off-by: Julien Pivotto <roidelapluie@o11y.eu> Signed-off-by: Julien Pivotto <roidelapluie@o11y.eu>	3 years ago
Julius Volz	0b03ef73cf	Run Windows tests only for releases (#11154 ) Signed-off-by: Julius Volz <julius.volz@gmail.com> Signed-off-by: Julius Volz <julius.volz@gmail.com>	3 years ago
David Leadbeater	fba3e847dc	Check syntax of example configurations (#10753 ) * Check syntax of example configurations Fix a mistake in the hetzner and vultr configs. Also it's easier not to fight the build system, and this will lint example code, so ignore a lint issue in custom-sd. Signed-off-by: David Leadbeater <dgl@dgl.cx> * No need to import Makefile.common, it just complicates things Signed-off-by: David Leadbeater <dgl@dgl.cx>	3 years ago
Julien Pivotto	dc8b673299	Build the UI when making UI tarball (#10578 ) We run ui-install on ci but not ui-build. This PR resolves that. Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	3 years ago
Julien Pivotto	1186974715	Publish UI release artefact in our github releases (#10577 ) This will make UI static files part of the release artefacts, for consumption by downstream distributions. Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	3 years ago
Julien Pivotto	8abef6d661	Proper support for go modules. (#10486 ) * Proper support for go modules. This pull requests makes Prometheus go-mod compatible. The general idea is to release the Prometheus libraries as v0.x releases, next to the v2.x tags used by end users. This is done by mirroring Prometheus 2.x tags with Prometheus 0.x tags. When v2.X.0 is released, we would release v0.X.0. Pre-go mod versions are retracted from go.mod. This is not nice but should work. Only v2.x tags will be built and released by CI. v0.x.x tags would just be normal tags in the repo, not promoted as releases. Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	3 years ago
Julien Pivotto	a236166c71	Store compiled web ui in CI (#10546 ) Some downstream distros fail to compile Prometheus UI (Debian, NixOS). This is an attempt to store compiled UI in circleci for them to consume it. Currently we do not expose this outside of circleci. Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu> Co-authored-by: Julien Pivotto <roidelapluie@o11y.eu>	3 years ago
Sylvain Rabot	c31a3e4c92	Build with Go 1.18 (#10501 ) * Build with Go 1.18 * Update golangci-lint version Signed-off-by: Sylvain Rabot <sylvain@abstraction.fr>	3 years ago
Augustin Husson	69e9eadfd3	stop codemirror sync (#10472 ) Signed-off-by: Augustin Husson <husson.augustin@gmail.com>	3 years ago
Simon Pasquier	6fae98faa8	.circleci/config.yml: bump prometheus/prometheus orb This change ensures that we don't use the deprecated Ubuntu images which are going to be unavailable starting May 31 2022 [1]. [1] https://circleci.com/blog/ubuntu-14-16-image-deprecation/ Signed-off-by: Simon Pasquier <spasquie@redhat.com>	3 years ago
Jan Fajerski	2c3d45c88a	Replace vfsgen with embed for static web assets (#10220 ) * remove vfsgen usages Signed-off-by: Jan Fajerski <jfajersk@redhat.com> * web: use embed package for static assets This requires go 1.16. Signed-off-by: Jan Fajerski <jfajersk@redhat.com> * circleci: drop go generate in web/ui Signed-off-by: Jan Fajerski <jfajersk@redhat.com> * Makefile: compress web assets before build This commit add compression before (and decompression after) prometheus is build. This ensures that gzipped assets are embeded in the prometheus binary, if the builtinassets build tag is passed. If the build tag is not passed this step is still executed but has no effect. All this is executed in a subshell so that we can run the decompress step even if the build step fails, but retain the exit code of promu. This cleanup could also cover interrupts, but I left that out for now. Signed-off-by: Jan Fajerski <jfajersk@redhat.com>	3 years ago
Julien Pivotto	8cc7b7e577	Split remote storage example in its own go mod (#10244 ) This commit removes the dependency between Prometheus and influx. Note: Go keeps adding the indirect dependencies in go.mod, I can't remove them. Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	3 years ago
Ben Kochie	4cc369ed1a	Update daily cron job (#10212 ) Pick a more random time of day to run the daily cron sync to avoid correlating with UTC 00:00. Signed-off-by: SuperQ <superq@gmail.com>	3 years ago
SuperQ	41b43c3b87	Update minimum Go version Update minimum required Go version to 1.16 due to use of standard library package `io/fs`. Signed-off-by: SuperQ <superq@gmail.com>	4 years ago
Julien Pivotto	e1408510e1	Update circleci orb Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	4 years ago
Julien Pivotto	06c0483045	Update circleci orb Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	4 years ago
Julien Pivotto	b48a1e9e9b	Revert "Replace vfsgen with embed for static web assets (#9719 )" (#9870 ) This reverts commit `ddaddc2a7a`.	4 years ago
Jan Fajerski	ddaddc2a7a	Replace vfsgen with embed for static web assets (#9719 ) * remove vfsgen usages Signed-off-by: Jan Fajerski <jfajersk@redhat.com> * web: use embed package for static assets This requires go 1.16. Signed-off-by: Jan Fajerski <jfajersk@redhat.com> * circleci: drop go generate in web/ui Signed-off-by: Jan Fajerski <jfajersk@redhat.com> * Makefile: compress web assets before build This commit add compression before (and decompression after) prometheus is build. This ensures that gzipped assets are embeded in the prometheus binary, if the builtinassets build tag is passed. If the build tag is not passed this step is still executed but has no effect. All this is executed in a subshell so that we can run the decompress step even if the build step fails, but retain the exit code of promu. This cleanup could also cover interrupts, but I left that out for now. Signed-off-by: Jan Fajerski <jfajersk@redhat.com> * [FIXME]: add new module dependency on common/assets and temp replace Signed-off-by: Jan Fajerski <jfajersk@redhat.com>	4 years ago
Darshan Chaudhary	9dcf8b2208	Add the ability to disable tsdb isolation (#9270 ) * Disable isolation in isolation struct Signed-off-by: darshanime <deathbullet@gmail.com> * Run tsdb tests with isolation disabled Signed-off-by: darshanime <deathbullet@gmail.com> * Check for isolation disabled in isoState.Close() Signed-off-by: darshanime <deathbullet@gmail.com> * use t.Skip to skip isolation tests when disabled Signed-off-by: darshanime <deathbullet@gmail.com> * address review comments Signed-off-by: darshanime <deathbullet@gmail.com> * fix test for defaultIsolationState Signed-off-by: darshanime <deathbullet@gmail.com> * Change flag name. Set flag in DB. Do not init txRing. Close isoState. Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com> * Test disabled isolation in CircleCI test_go Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com> * Skip isolation related tests in db_test.go Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com> Co-authored-by: Ganesh Vernekar <ganeshvern@gmail.com>	4 years ago
Julien Pivotto	c564984daa	Reduce Prometheus pull requests builds (#9666 ) * Reduce Prometheus builds Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	4 years ago
SuperQ	3cd2c033e2	Use Go 1.16+ install for mixin tests Use new `go install` syntax to fetch tools. Signed-off-by: SuperQ <superq@gmail.com>	4 years ago
Julien Pivotto	7c40eb52ef	Add sync_codemirror (#9379 ) * Add sync_codemirror Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	4 years ago
Julius Volz	47d6471bd7	Add UI linting to CircleCI Signed-off-by: Julius Volz <julius.volz@gmail.com>	4 years ago
Augustin Husson	27aec91914	review the UI ci and associated command Signed-off-by: Augustin Husson <husson.augustin@gmail.com>	4 years ago
SuperQ	e167a45c65	Add new Go build tags. Add new go:build comments based on 1.17 formatting[0]. [0]: https://golang.org/doc/go1.17#gofmt Signed-off-by: SuperQ <superq@gmail.com>	4 years ago
SuperQ	a1401c26b1	Build with Go 1.17 Update build to use Go 1.17. * Use golang-builder images for testing. * Update CircleCI go orb. * Use tools from golang-builder image. Signed-off-by: SuperQ <superq@gmail.com>	4 years ago
Augustin Husson	54dfee02b2	move codemirror-promql as a prometheus web module (#9188 ) * move codemirror-promql as a prometheus web module Signed-off-by: Augustin Husson <husson.augustin@gmail.com> * remove unecessary file for the codemirror module Signed-off-by: Augustin Husson <husson.augustin@gmail.com> * change license for Apache Signed-off-by: Augustin Husson <husson.augustin@gmail.com> * fix codemirror build Signed-off-by: Augustin Husson <husson.augustin@gmail.com>	4 years ago
Augustin Husson	7291563d4d	replace yarn by npm (#9198 ) Signed-off-by: Augustin Husson <husson.augustin@gmail.com>	4 years ago
Ganesh Vernekar	095f572d4a	Sync sparsehistogram branch with main (#9189 ) * Fix `kuma_sd` targetgroup reporting (#9157) * Bundle all xDS targets into a single group Signed-off-by: austin ce <austin.cawley@gmail.com> * Snapshot in-memory chunks on shutdown for faster restarts (#7229) Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com> * Rename links Signed-off-by: Levi Harrison <git@leviharrison.dev> * Remove Individual Data Type Caps in Per-shard Buffering for Remote Write (#8921) * Moved everything to nPending buffer Signed-off-by: Levi Harrison <git@leviharrison.dev> * Simplify exemplar capacity addition Signed-off-by: Levi Harrison <git@leviharrison.dev> * Added pre-allocation Signed-off-by: Levi Harrison <git@leviharrison.dev> * Don't allocate if not sending exemplars Signed-off-by: Levi Harrison <git@leviharrison.dev> * Avoid deadlock when processing duplicate series record (#9170) * Avoid deadlock when processing duplicate series record `processWALSamples()` needs to be able to send on its output channel before it can read the input channel, so reads to allow this in case the output channel is full. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * processWALSamples: update comment Previous text seems to relate to an earlier implementation. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * Optimise WAL loading by removing extra map and caching min-time (#9160) * BenchmarkLoadWAL: close WAL after use So that goroutines are stopped and resources released Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * BenchmarkLoadWAL: make series IDs co-prime with #workers Series are distributed across workers by taking the modulus of the ID with the number of workers, so multiples of 100 are a poor choice. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * BenchmarkLoadWAL: simulate mmapped chunks Real Prometheus cuts chunks every 120 samples, then skips those samples when re-reading the WAL. Simulate this by creating a single mapped chunk for each series, since the max time is all the reader looks at. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * Fix comment Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * Remove series map from processWALSamples() The locks that is commented to reduce contention in are now sharded 32,000 ways, so won't be contended. Removing the map saves memory and goes just as fast. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * loadWAL: Cache the last mmapped chunk time So we can skip calling append() for samples it will reject. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * Improvements from code review Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * Full stops and capitals on comments Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * Cache max time in both places mmappedChunks is updated Including refactor to extract function `setMMappedChunks`, to reduce code duplication. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * Update head min/max time when mmapped chunks added This ensures we have the correct values if no WAL samples are added for that series. Note that `mSeries.maxTime()` was always `math.MinInt64` before, since that function doesn't consider mmapped chunks. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> * Split Go and React Tests (#8897) * Added go-ci and react-ci Co-authored-by: Julien Pivotto <roidelapluie@inuits.eu> Signed-off-by: Levi Harrison <git@leviharrison.dev> * Remove search keymap from new expression editor (#9184) Signed-off-by: Julius Volz <julius.volz@gmail.com> Co-authored-by: Austin Cawley-Edwards <austin.cawley@gmail.com> Co-authored-by: Levi Harrison <git@leviharrison.dev> Co-authored-by: Julien Pivotto <roidelapluie@inuits.eu> Co-authored-by: Bryan Boreham <bjboreham@gmail.com> Co-authored-by: Julius Volz <julius.volz@gmail.com>	4 years ago
Levi Harrison	44e2834960	Split Go and React Tests (#8897 ) * Added go-ci and react-ci Co-authored-by: Julien Pivotto <roidelapluie@inuits.eu> Signed-off-by: Levi Harrison <git@leviharrison.dev>	4 years ago
Michal Wasilewski	3f686cad8b	fixes yamllint errors Signed-off-by: Michal Wasilewski <mwasilewski@gmx.com>	4 years ago
Michal Wasilewski	b6f0a17367	Add circle-ci config to install yamllint in the CI env Signed-off-by: Michal Wasilewski <mwasilewski@gmx.com>	4 years ago
Callum Styan	8fd73b1d28	Add Exemplar Remote Write support (#8296 ) * Write exemplars to the WAL and send them over remote write. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Update example for exemplars, print data in a more obvious format. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Add metrics for remote write of exemplars. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Fix incorrect slices passed to send in remote write. Signed-off-by: Callum Styan <callumstyan@gmail.com> * We need to unregister the new metrics. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address review comments Signed-off-by: Callum Styan <callumstyan@gmail.com> * Order of exemplar append vs write exemplar to WAL needs to change. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Several fixes to prevent sending uninitialized or incorrect samples with an exemplar. Fix dropping exemplar for missing series. Add tests for queue_manager sending exemplars Signed-off-by: Martin Disibio <mdisibio@gmail.com> * Store both samples and exemplars in the same timeseries buffer to remove the alloc when building final request, keep sub-slices in separate buffers for re-use Signed-off-by: Martin Disibio <mdisibio@gmail.com> * Condense sample/exemplar delivery tests to parameterized sub-tests Signed-off-by: Martin Disibio <mdisibio@gmail.com> * Rename test methods for clarity now that they also handle exemplars Signed-off-by: Martin Disibio <mdisibio@gmail.com> * Rename counter variable. Fix instances where metrics were not updated correctly Signed-off-by: Martin Disibio <mdisibio@gmail.com> * Add exemplars to LoadWAL benchmark Signed-off-by: Callum Styan <callumstyan@gmail.com> * last exemplars timestamp metric needs to convert value to seconds with ms precision Signed-off-by: Callum Styan <callumstyan@gmail.com> * Process exemplar records in a separate go routine when loading the WAL. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address review comments related to clarifying comments and variable names. Also refactor sample/exemplar to enqueue prompb types. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Regenerate types proto with comments, update protoc version again. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Put remote write of exemplars behind a feature flag. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address some of Ganesh's review comments. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Move exemplar remote write feature flag to a config file field. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address Bartek's review comments. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Don't allocate exemplar buffers in queue_manager if we're not going to send exemplars over remote write. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Add ValidateExemplar function, validate exemplars when appending to head and log them all to WAL before adding them to exemplar storage. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address more reivew comments from Ganesh. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Add exemplar total label length check. Signed-off-by: Callum Styan <callumstyan@gmail.com> * Address a few last review comments Signed-off-by: Callum Styan <callumstyan@gmail.com> Co-authored-by: Martin Disibio <mdisibio@gmail.com>	4 years ago
Ben Kochie	18c5fce892	Update yq checksum Use the correct release checksum, not the testing one. Signed-off-by: Ben Kochie <superq@gmail.com>	4 years ago
Ben Kochie	651a560254	Fix writing of yq in repo_sync Make sure binary path exists before writing. Signed-off-by: Ben Kochie <superq@gmail.com>	4 years ago
Ben Kochie	f55a3be90d	Fix typo in repo sync Use correct curl option for downloading yq binary. Signed-off-by: Ben Kochie <superq@gmail.com>	4 years ago
Ben Kochie	e73930e3d5	Sync CircleCI Orb version Add sync of the Prometheus CircleCI Orb version to the sync script. * Add `yq` to the repo sync CI job. NOTE: This will re-format the down-stream yaml config, it does not preserve whitespace and enforces some indenting rules. It does preserve comments. Signed-off-by: Ben Kochie <superq@gmail.com>	4 years ago
Julien Pivotto	c1f203a1b8	Use CircleCI parallelism This commit uses the CircleCI parallelism features, combined with the last changes in promu that enables this. Now all the pull requests will be built with all the platforms again, in less than 20 minutes. A side effect is that we now build Prometheus for 7 more os/arch combos: darwin-arm64 / illumos-amd64 / linux-mips / linux-mipsle / freebsd-arm64 / netbsd-arm64 / openbsd-arm64 Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	4 years ago
Ben Kochie	35b49230eb	Speed up PR builds * Update to latest promu. * Split up builds for PRs into a build matrix. * Keep non-matrix build pipeline for releases. Signed-off-by: Ben Kochie <superq@gmail.com>	4 years ago
Julien Pivotto	75e505babb	Upgrade to golang 1.16 Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	4 years ago
Julien Pivotto	432d5ebc6c	Rename default branch to main Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	4 years ago
Julien Pivotto	bdf7759eeb	Pin go version for windows to go1.15 Tests are failing with go 1.16 at the moment, and by default we test with latest go version. https://github.com/prometheus/prometheus/issues/8403 Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	4 years ago
Ben Kochie	000d7edec9	Remove inline Go vendor dir Remove the inline Go vendoring per Prometheus 2020 Dev Summit[0]. [0]: https://docs.google.com/document/d/1yuaPKLDvhJNXMF1ubsOOm5kE2_6dvCxHowBQIDs0KdU/edit Signed-off-by: Ben Kochie <superq@gmail.com> Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	4 years ago
mikeee	52109966af	Change the CI workflow to powershell and fixes the missing env var issue Signed-off-by: mikeee <hey@mike.ee>	4 years ago
mikeee	9ca24f9d24	Revert to get the latest version of Go Signed-off-by: mikeee <hey@mike.ee>	4 years ago
Julien Pivotto	3ead3926d1	Windows CI: downgrade golang Latest releases has a change in behaviour or a bug: bash: go: command not found bash: line 1: go: command not found bash: line 1: go: command not found Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	4 years ago
Julien Pivotto	c666879e3f	Remove fuzzit Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	5 years ago
Simon Pasquier	e693af6c01	.circleci/config.yml: check mixins (#6895 ) * .circleci/config.yml: check mixins Signed-off-by: Simon Pasquier <spasquie@redhat.com> * Run jsonnetfmt Signed-off-by: Simon Pasquier <spasquie@redhat.com> * Install tools in the image instead of using coreos/jsonnet-ci The latter is deprecated Signed-off-by: Simon Pasquier <spasquie@redhat.com> * Update jsonnetfile.json Signed-off-by: Simon Pasquier <spasquie@redhat.com>	5 years ago
Julien Pivotto	041da628f8	Update to go 1.15 (#7798 ) Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>	5 years ago

1 2

93 Commits (dependabot/github_actions/scripts/golangci/golangci-lint-action-8.0.0)