222 Commits (61b000ee0e6a6095ef194e18f47a42ebb51c2acb)

Author	SHA1	Message	Date
Ganesh Vernekar	61b000ee0e	Fix review comments ... Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>	7 years ago
Ganesh Vernekar	632dfb349e	Add new metrics. ... 1. 'prometheus_tsdb_wal_truncate_fail' for failed WAL truncation. 2. 'prometheus_tsdb_checkpoint_delete_fail' for failed old checkpoint delete. Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>	7 years ago
Julius Volz	5ae6c60d39	Handle a bunch of unchecked errors (#365) ... As discovered by "gosec". Signed-off-by: Julius Volz <julius.volz@gmail.com>	7 years ago
beorn7	3bc6c670fa	Revert "Remove `prometheus_` prefix from metrics" ... This reverts commit 98fe30438c. After some discussion, it was concluded that we want the full `prometheus_tsdb_...` prefix hardcoded in the library. Signed-off-by: beorn7 <beorn@soundcloud.com>	7 years ago
Chris Marchbanks	a8966cb53d	Fix race condition between gc and committing (#378) ... Signed-off-by: Chris Marchbanks <csmarchbanks@gmail.com>	7 years ago
beorn7	98fe30438c	Remove `prometheus_` prefix from metrics ... This can now be added by users of the library as needed with the new https://godoc.org/github.com/prometheus/client_golang/prometheus#WrapRegistererWithPrefix Signed-off-by: beorn7 <beorn@soundcloud.com>	7 years ago
Ganesh Vernekar	2945db18ca	Changes in series names (and types) exposed (#376) ... Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>	7 years ago
Fabian Reinartz	45071c657c	Properly initialize head time ... This fixes various issues when initializing the head time range under different starting conditions. Signed-off-by: Fabian Reinartz <freinartz@google.com>	7 years ago
Fabian Reinartz	1a5573b4ce	Migrate write ahead log ... On startup, rewrite the old write ahead log into the new format once. Signed-off-by: Fabian Reinartz <freinartz@google.com>	7 years ago
Fabian Reinartz	3e76f0163e	Address comments ... Signed-off-by: Fabian Reinartz <freinartz@google.com>	7 years ago
Fabian Reinartz	def912ce0e	Integrate new WAL and checkpoints ... Remove the old WAL and drop in the new one Signed-off-by: Fabian Reinartz <freinartz@google.com>	7 years ago
Benoît Knecht	1e1b2e163d	Make interval overlap comparisons more explicit ... Blocks are half-open intervals [a, b), while all other intervals (chunks, head, ...) are closed intervals [a, b]. Make that distinction explicit by defining `OverlapsClosedInterval()` methods for blocks and chunks, and using them in place of the more generic `intervalOverlap()` function. This change also fixes `db.Querier()` and `db.Delete()`, which could previously return one extraneous block at the end of the specified interval. Signed-off-by: Benoît Knecht <benoit.knecht@fsfe.org>	7 years ago
Fabian Reinartz	ea607b9fc3	Log series on rollback ... Signed-off-by: Fabian Reinartz <freinartz@google.com>	7 years ago
codwu	84a45cb79a	add rwmutex to prevent concurrent map read when delete series ... Signed-off-by: codwu <wuhan9087@163.com>	7 years ago
Matt Bostock	55ea5ae6b1	head: Rename highTimestamp to maxt ... `maxt` seems more consistent with `mint` and other uses of `maxt` elsewhere in the code, if I've understand the intent correctly.	7 years ago
Simon Pasquier	79defa54df	Fix crash when a series has no block	7 years ago
Matt Bostock	bc97c6c6be	Misc fixes (#285) ... * Fix typo in head.go pralellize -> paralellize * Remove commented out code It's dead code, remove it. * Correct reference to sample buffer	7 years ago
Matt Bostock	50211e89ad	Fix typos in comments (#254) ... a the -> the timestmap -> timestamp badded -> padded its -> it is callers -> caller's	8 years ago
Fabian Reinartz	67f0ca8f0e	Move index and chunk encoders to own packages	8 years ago
Goutham Veeramachaneni	3158b03e6c	Select series with label unset for != and !~ ... Fixes https://github.com/prometheus/prometheus/issues/3575 Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in> Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	8 years ago
Goutham Veeramachaneni	05d62ca842	Make sure gc'ed chunks are handled properly ... Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	8 years ago
Fabian Reinartz	f1512a368a	Expose ChunkSeriesSet and lookups methods.	8 years ago
Fabian Reinartz	3ef4326114	Refactor tombstone reader types	8 years ago
Fabian Reinartz	e5ce2bef43	Add explicit error to Querier.Select ... This has been a frequent source of debugging pain since errors are potentially delayed to a much later point. They bubble up in an unrelated execution path.	8 years ago
Julius Volz	1dad3370fd	Close WAL when closing the DB ... Also, the `wal` field of the `DB` was not used anywhere, so this removes it.	8 years ago
Oren Shomron	6ca5e52b69	Typo in prometheus_tsdb_head_samples_appended_total description (#188)	8 years ago
Fabian Reinartz	82796db37b	Ensure near-empty chunks end at correct boundary ... We were determining a chunk's end time once it was one quarter full to compute it so all chunks have uniform number of samples. This accidentally skipped the case where series started near the end of a chunk range/block and never reached that threshold. As a result they got persisted but were continued across the range. This resulted in corrupted persisted data.	8 years ago
Fabian Reinartz	9749aa2a3e	head: limit WAL sample processing batch size	8 years ago
Fabian Reinartz	d17104f1f0	Prefix all metrics with `prometheus_*`	8 years ago
Fabian Reinartz	ea817e169b	Return nop iterator for invalid chunk references	8 years ago
Fabian Reinartz	6dcca97755	Fix race in symbol table re-creation	8 years ago
Fabian Reinartz	065f42f58c	head: track number of series not found errors in metric	8 years ago
Fabian Reinartz	88305e7612	Access chunk time range while holding lock	8 years ago
Fabian Reinartz	106eaf39d1	Ensure workers terminated fully before reading unknownRefs	8 years ago
Fabian Reinartz	665955da48	Clarify postings index semantics, handle staleness ... The postings list index may point to series that no longer exist during garbage collection. This clarifies that this is valid behavior. It would be possible, though more complex, to always keep them in sync. However, series existance means nothing in itself as the queried time range defines whether there's actual data. Thus our definition is sane overall as long as drift is kept small.	8 years ago
Fabian Reinartz	fb9da52b11	Add more verbose error handling for closing, reduce locking ... This commit introduces error returns in various places and is explicit about closing persisted blocks. {Index,Chunk,Tombstone}Readers are more consistent about their Close() method. Whenever a reader is retrieved, the corresponding close method must eventually be called. We use this to track pending readers against persisted blocks. Querier's against the DB no longer hold a read lock for their entire lifecycle. This avoids long running queriers to starve new ones when we have to acquire a write lock when reloading blocks.	8 years ago
Fabian Reinartz	7efb830d70	wal: parallelize sample processing	8 years ago
Simon Pasquier	e858c0826c	Fix innocuous typo in variable names ... This change fixes the variable names holding the tsdb_head_max_time and tsdb_head_min_time metrics. It is a cosmetic change to improve the code readability as the metric values are taken from the correct variables.	8 years ago
Fabian Reinartz	d3682d701c	wal: decode and process in separate threads.	8 years ago
Fabian Reinartz	cd2e26b7fc	Load postings in batch on startup ... This allows to insert IDs to postings out of order until a trigger function is called. This avoids the insertion sort we usually do which can be very costly since WAL entries are more out of order than regular adds.	8 years ago
Goutham Veeramachaneni	203012169a	snapshot: Remove truncation check to restore func. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	c35d3a65bd	Add levels to all log lines. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	1e88ba06b4	Use boolean function instead of postings to drop WAL series ... There is not guarantee or requirement for WAL writers to only add series entries in increasing order of IDs. A postings list cannot look back and thus unordered WAL entries would skip over IDs to not truncate from the WAL. We replace it with a simple boolean check function that does not require order.	8 years ago
Fabian Reinartz	6ee254e353	Ensure postings are always sorted ... IDs for new series are handed out before the postings are locked. Thus series are not indexed in order of their IDs, which could result in only partially sorted postings list. Iterating over those silently skipped elements as the sort invariant was violated.	8 years ago
Fabian Reinartz	162a48e4f2	Create series with ID recorded in WAL when reading it back	8 years ago
Fabian Reinartz	7ada9cd805	Simplify series create logic in head	8 years ago
Fabian Reinartz	ab8d9b9706	Add missing unlock on early return	8 years ago
Fabian Reinartz	f904cd385f	Do not build a superflous 'all' postings	8 years ago
Fabian Reinartz	6892fc6dcb	Finish old WAL segment async, default to no fsync ... We were still fsyncing while holding the write lock when we cut a new segment. Given we cannot do anything but logging errors, we might just as well complete segments asynchronously. There's not realistic use case where one would fsync after every WAL entry, thus make the default of a flush interval of 0 to never fsync which is a much more likely use case.	8 years ago
Fabian Reinartz	1d5f85817d	Fix various races	8 years ago