243 Commits (d5731fd5f87004a92f8f6e3800f01a79ddc9f66d)

Author	SHA1	Message	Date
Brian Brazil	9c03e11c2c	Hook OpenMetrics parser into scraping. ... Extend metadata api to support units. Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>	7 years ago
Brian Brazil	ffe7efb411	Prepare for multiple text formats ... Pass content type down to text parser. Add layer of indirection in front of text parser, and rename to avoid future clashes. Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>	7 years ago
Krasi Georgiev	47a673c3a0	process scrape loops reloading in parallel (#4526) ... The scrape manage receiver's channel now just saves the target sets and another backgorund runner updates the scrape loops every 5 seconds. This is so that the scrape manager doesn't block the receiving channel when it does the long background reloading of the scrape loops. Active and dropped targets are now saved in each scrape pool instead of the scrape manager. This is mainly to avoid races when getting the targets via the web api. When reloading the scrape loops now happens in parallel to speed up the final disared state and this also speeds up the prometheus's shutting down. Also updated some funcs signatures in the web package for consistency. Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	7 years ago
Fabian Reinartz	ad4c33c1ff	scrape,api: provide per-target metric metadata ... This adds a per-target cache of scraped metadata. The metadata is only available for the lifecycle of the attached target. An API endpoint allows to select metadata by metric name and a label selection of targets. Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Karsten Weiss	d79d573f71	Fix spelling mistakes found by codespell (#4065) ... Signed-off-by: Karsten Weiss <knweiss@gmail.com>	8 years ago
Simon Pasquier	2cbba4e948	scrape: fix data races ... This commit avoids passing the full scrape configuration down to the scrape loop to fix data races when the scrape configuration is being reloaded. Signed-off-by: Simon Pasquier <spasquie@redhat.com>	8 years ago
Simon Pasquier	8b89ab0173	scrape: add test detecting data races ... Signed-off-by: Simon Pasquier <spasquie@redhat.com>	8 years ago
Mario Trangoni	464e747f1e	fix some comments typos (#4059)	8 years ago
Krasi Georgiev	675ce533c9	refactored TestScrapeLoopAppend and added a test for empty labels	8 years ago
Krasi Georgiev	404b306fb9	Meta labels sd 3693 (#3805) ... Always keep the discovered labels up to date. add test that DiscoveredLabels are always updated	8 years ago
Krasi Georgiev	b75428ec19	rename package retrieve to scrape ... no fucnctinal changes just renaming retrieval to scrape	8 years ago
Krasi Georgiev	66bcb10f40	t.Fatal should be t.Fatalf in the one scrape test	8 years ago
Adam	f64014f70b	Fix the incrementing of prometheus_target_scrapes_exceeded_sample_limit_total (#3669) ... Once a scrape target has reached the samle_limit, any further samples from that target will continue to result in errSampleLimit. This means that after the completion of the append loop `err` must still be errSampleLimit, and so the metric would not have been incremented.	8 years ago
conorbroderick	658914ba27	Fix dropped target list growing forever	8 years ago
Krasi Georgiev	60ef2016d5	add a cancel func to the scrape pool as it is needed in the scrape loop select block	8 years ago
Krasi Georgiev	9c61f0e8a0	scrape pool doesn't rely on context as Stop() needs to be blocking to prevent Scrape loops trying to write to a closed TSDB storage.	8 years ago
Julius Volz	099df0c5f0	Migrate "golang.org/x/net/context" -> "context" (#3333) ... In some places, where ctxhttp or gRPC are concerned, we still need to use the old contexts.	8 years ago
Tobias Schmidt	40c278ee2d	Send a HTTP Accept header when scraping	8 years ago
Fabian Reinartz	437f51a85f	Fix cache maintenance on changing metric representations ... We were not properly maintaining the scrape cache when the same metric was exposed with a different string representation. This overall reduces the scraping cache's complexity, which fixes the issue and saves about 10% of memory in a scraping-only Prometheus instance.	8 years ago
Fabian Reinartz	1121b9f7d4	retrieval: cache dropped series, mutate labels in place	8 years ago
Fabian Reinartz	d21f149745	*: migrate to go-kit/log	8 years ago
Fabian Reinartz	5bed8af4cb	retrieval: pool scrape buffers ... This adds a bucketed buffer pool to the scrapers so we don't have to allocate a new buffer on each scrape or hold it fixed to the scrape loop. The latter can consume significant amounts of unused memory, e.g. 4GB when scraping 2MB /metrics from 2000 targets.	8 years ago
Fabian Reinartz	0efecea6d4	Adapt storage APIs to uint64 references	8 years ago
Tom Wilkie	db8128ceeb	Add label set as first parameter to AddFast, ingored by TSDB adapter.	9 years ago
Goutham Veeramachaneni	643c5837a0	Stop metrics that are 10mins ahead from now ... Fixes #2893 Signed-off-by: Goutham Veeramachaneni <goutham@boomerangcommerce.com>	9 years ago
Brian Brazil	a6ca391e6e	Reject scrapes with invalid utf-8 label values.	9 years ago
Goutham Veeramachaneni	507790a357	Rework logging to use explicitly passed logger ... Mostly cleaned up the global logger use. Still some uses in discovery package. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Julius Volz	6f66125809	retrieval: Fix "up" reporting for failed scrapes	9 years ago
Brian Brazil	37bc607e96	Rework sample limit to work for 2.0 ... Correctly update reported series. Increment prometheus_target_scrapes_exceeded_sample_limit_total. Add back unittests. Ignore stale markers when calculating sample limit. Fixes #2770	9 years ago
Fabian Reinartz	bc7aff8cef	retrieval: extract scrape cache	9 years ago
Fabian Reinartz	a83014f53c	retrieval: fix memory leak and consumption for caches	9 years ago
Fabian Reinartz	43ca652217	retrieval: Don't allocate map on every scrape	9 years ago
Fabian Reinartz	d289dc55c3	storage: update TSDB	9 years ago
Brian Brazil	bf38963118	Plumb through logger with target field to scrape loop.	9 years ago
Brian Brazil	d532272520	Add stalemarkers to synthetic series too when target stops.	9 years ago
Brian Brazil	b87d3ca9ea	Create stale markers when a target is stopped. ... When a target is no longer returned from SD stop() is called. However it may be recreated before the next scrape interval happens. So we wait to set stalemarkers until the scrape of the new target would have happened and been ingested, which is 2 scrape intervals. If we're shutting down the context will be cancelled, so return immediately rather than holding things up for potentially minutes waiting to safely set stalemarkers no newer than now. If the server starts immediately back up again all is well. If not, we're missing some stale markers.	9 years ago
Brian Brazil	3c45400130	Don't fail scrape if one sample violates ordering. ... In Prometheus 1.x one sample that is out of order or that has a duplicate timestamp is discarded, and the rest of the scrape ingestion continues on. This will now also be true for 2.0.	9 years ago
Brian Brazil	fd5c5a50a3	Add stale markers on parse error. ... If we fail to parse the result of a scrape, we should treat that as a failed scrape and add stale markers.	9 years ago
Brian Brazil	c0c7e32e61	Treat a failed scrape as an empty scrape for staleness. ... If a target has died but is still in SD, we want the previously scraped values to go stale. This would also apply to brief blips.	9 years ago
Brian Brazil	850ea412ad	If an explicit timestamp is provided, bypass staleness.	9 years ago
Brian Brazil	5060a0fc51	Add unittests for ingestion stale NaNs	9 years ago
Brian Brazil	4f35952cf3	Inject a stale NaN when sample disappears between scrapes.	9 years ago
Brian Brazil	beaa7d5a43	Move consistent NaN logic into the parser.	9 years ago
Brian Brazil	76acf7b9b1	Ensure all the NaNs we ingest have the same bit pattern.	9 years ago
Matt Layher	5e4f5fb5ad	retrieval: make scrape timeout header consistent with others	9 years ago
Matt Layher	fe4b6693f7	retrieval: add Scrape-Timeout-Seconds header to each scrape request (#2565) ... Fixes #2508.	9 years ago
Fabian Reinartz	c691895a0f	retrieval: cache series references, use pkg/textparse ... With this change the scraping caches series references and only allocates label sets if it has to retrieve a new reference. pkg/textparse is used to do the conditional parsing and reduce allocations from 900B/sample to 0 in the general case.	9 years ago
Fabian Reinartz	ad9bc62e4c	storage: extend appender and adapt it	9 years ago
beorn7	5dc01202d7	Retrieval: Remove some test lines that fail on Travis only ... These lines exercise an append in TestScrapeLoopWrapSampleAppender. Arguably, append shouldn't be tested there in the first place. Still it's weird why this fails on Travis: ``` --- FAIL: TestScrapeLoopWrapSampleAppender (0.00s) scrape_test.go:259: Expected count of 1, got 0 scrape_test.go:290: Expected count of 1, got 0 2017/01/07 22:48:26 http: TLS handshake error from 127.0.0.1:50716: read tcp 127.0.0.1:40265->127.0.0.1:50716: read: connection reset by peer FAIL FAIL github.com/prometheus/prometheus/retrieval 3.603s ``` Should anybody ever find out why, please revert this commit accordingly.	9 years ago
beorn7	3610331eeb	Retrieval: Do not buffer the samples if no sample limit configured ... Also, simplify and streamline the code a bit.	9 years ago