63 Commits (4dd740e4cc2d6fb490a94deec899bb4ddb191eb4)

Author	SHA1	Message	Date
Ganesh Vernekar	61d0868966	Fix TestCorrectNumTombstones (#399) ... Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>	7 years ago
Ganesh Vernekar	6e712963e2	Fix updating of NumTombstones in block.Delete(..) (#385) ... Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>	7 years ago
Krasi Georgiev	d05611c027	removed some unused code and moved mockSeriesSet in querier_test (#394) ... Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	7 years ago
Krasi Georgiev	d38516b1c2	remove unused changes variable (#391) ... This was added in 55a9b5428a and later not used after some refactoring in following PRs. Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	7 years ago
Chris Marchbanks	2db59a71a6	Fix assert order being backwards in a few places (#388) ... Signed-off-by: Chris Marchbanks <csmarchbanks@gmail.com>	7 years ago
Goutham Veeramachaneni	9c8ca47399	Fix filehandling for windows (#392) ... * Fix filehandling for windows Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Fix more windows filehandling issues Windows: Close files before deleting Checkpoints. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close writers in case of errors so they can be deleted Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close block so that it can be deleted. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close file to delete it Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close dir so that it can be deleted. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: close files so that they can be deleted. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Review feedback Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	7 years ago
Fabian Reinartz	45071c657c	Properly initialize head time ... This fixes various issues when initializing the head time range under different starting conditions. Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Fabian Reinartz	7841d417b3	Ensure blocks are time-ordered in memory ... We assume in multiple places that the block list held by DB has blocks sequential by time. A regression caused us to hold them ordered by ULID, i.e. by creation time instead. Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Benoît Knecht	24b223c161	db: add test for Querier returning too many blocks ... Due to the way blocks used to overlap by 1 millisecond (see #347), when requesting a 2-hour interval starting at `blocks[1].MinTime`, the `Querier` would consider three blocks: `blocks[0]`, `blocks[1]` and `blocks[2]`, because `blocks[0].MaxTime` and `blocks[2].MinTime` were in that interval. However, if the blocks don't overlap, only two blocks should be returned: `blocks[1]` and `blocks[2]`. This test ensures that it's indeed the case. Signed-off-by: Benoît Knecht <benoit.knecht@fsfe.org>	8 years ago
Benoît Knecht	4ed6b9ed72	db: add test for chunks that span beyond a block's boundaries ... Signed-off-by: Benoît Knecht <benoit.knecht@fsfe.org>	8 years ago
Fabian Reinartz	af9003dcef	Add resilience to crashes during deletion ... Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
codwu	cd145c90d5	remove `put` function and use RLock in `Iter` function ... Signed-off-by: codwu <wuhan9087@163.com>	8 years ago
codwu	84a45cb79a	add rwmutex to prevent concurrent map read when delete series ... Signed-off-by: codwu <wuhan9087@163.com>	8 years ago
Krasi Georgiev	6094f35aa2	simplify if-else,test before the tombstone failure, more comments ... Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	8 years ago
Krasi Georgiev	f31a0d6457	add Test for Tombstone Cleaning after a failure ... Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	8 years ago
Fabian Reinartz	76c1b2cdb6	Ensure correct block order on reload ... Due to a regression blocks were no longer ordered by time before being stored in memory. This made data intermittently become unavailable for queries. Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Alexey Palazhchenko	64cce683cc	gofmt -s. ... Signed-off-by: Alexey Palazhchenko <alexey.palazhchenko@gmail.com>	8 years ago
Bartek Plotka	15b5d89222	db: Addressed comments. ... Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	8 years ago
Bartek Plotka	cc306ef0d5	Added grouping by overlap range. ... Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	8 years ago
Bartek Plotka	7412e2b44b	Added more cases and modified one var name. ... Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	8 years ago
Bartek Plotka	f07d829946	db: Tiny tuning of algo + added proper print. ... Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	8 years ago
Bartek Plotka	1e60f02066	db: Simplified tests. ... Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	8 years ago
Bartek Plotka	51ce1cc7ff	db: Fixed validateBlockSequence. ... Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	8 years ago
Bartek Plotka	a9b28a6aa0	db: Added tests for validateBlockSequence to confirm a bug. ... (That's why test fails) Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	8 years ago
Fabian Reinartz	8cd32d8fd4	Improve usability of snapshots	8 years ago
Krasi Georgiev	eb6cdbcb5b	some test funcitons didn't cleanup after themselves.	8 years ago
Simon Pasquier	e9fc37be61	Count the total and failed block cutoffs	8 years ago
Goutham Veeramachaneni	3158b03e6c	Select series with label unset for != and !~ ... Fixes https://github.com/prometheus/prometheus/issues/3575 Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in> Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	8 years ago
Goutham Veeramachaneni	667b5575e9	Close db so that file space is reclaimed immediately after delete. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Callum Styan	ca4e817372	move test utils to it's own package so we can use it in tests for other packages in tsdb repo	8 years ago
Callum Styan	670c2917e2	use test utils in db_test	8 years ago
Goutham Veeramachaneni	e7445d00b0	Add a function to cleanup tombstones. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	41fd9c66ef	Close the retention blocks before deleting them. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	1fc94a02d1	Don't retry failed compactions. ... Fixes prometheus/prometheus#3487 Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	1627a47640	A copy is being assigned newChunk not the original ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	e5ce2bef43	Add explicit error to Querier.Select ... This has been a frequent source of debugging pain since errors are potentially delayed to a much later point. They bubble up in an unrelated execution path.	8 years ago
Julius Volz	1dad3370fd	Close WAL when closing the DB ... Also, the `wal` field of the `DB` was not used anywhere, so this removes it.	8 years ago
Fabian Reinartz	fb9da52b11	Add more verbose error handling for closing, reduce locking ... This commit introduces error returns in various places and is explicit about closing persisted blocks. {Index,Chunk,Tombstone}Readers are more consistent about their Close() method. Whenever a reader is retrieved, the corresponding close method must eventually be called. We use this to track pending readers against persisted blocks. Querier's against the DB no longer hold a read lock for their entire lifecycle. This avoids long running queriers to starve new ones when we have to acquire a write lock when reloading blocks.	8 years ago
Dimitrij Denissenko	c9fc2af6c0	Add test for snapshot	8 years ago
Goutham Veeramachaneni	afaf12fe45	Compress the series chunk details in index. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	c36d574290	Replace single head lock with granular locks ... This adds various new locks to replace the single big lock on the head. All parts now must be COW as they may be held by clients after initial retrieval. Series by ID and hashes are now held in a stripe lock to reduce contention and total holding time during GC. This should reduce starvation of readers.	8 years ago
Fabian Reinartz	5cf2662074	Refactor WAL into Head and misc improvements	8 years ago
Fabian Reinartz	3901b6e70b	Remove multiple heads ... This changes the structure to a single WAL backed by a single head block. Parts of the head block can be compacted. This relieves us from any head amangement and greatly simplifies any consistency and isolation concerns by just having a single head.	8 years ago
Goutham Veeramachaneni	7438ed7035	Expose Intervals type for use by TombstoneReader. ... TombstoneReader is exposed but Intervals is not. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	3065be97d8	Fix and document locking order for DB	9 years ago
Goutham Veeramachaneni	9bf7aa9af1	Misc. fixes incorporating feedback. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Fabian Reinartz	39df7e2bba	Switch blocks to ULID directories, drop sequenc numbers	9 years ago
Fabian Reinartz	285bc07030	Switch append refs to string	9 years ago
Goutham Veeramachaneni	22c1b5b492	Make SeriesSets use tombstones. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	34a86af3c6	Move tombstones to their own thing. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago