117 Commits (4dd740e4cc2d6fb490a94deec899bb4ddb191eb4)

Author	SHA1	Message	Date
Ganesh Vernekar	6e712963e2	Fix updating of NumTombstones in block.Delete(..) (#385) ... Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>	7 years ago
Krasi Georgiev	d05611c027	removed some unused code and moved mockSeriesSet in querier_test (#394) ... Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	7 years ago
Julius Volz	5ae6c60d39	Handle a bunch of unchecked errors (#365) ... As discovered by "gosec". Signed-off-by: Julius Volz <julius.volz@gmail.com>	7 years ago
Ganesh Vernekar	77d2c7cf3d	Added metric for symbol table size ... Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>	7 years ago
Benoît Knecht	1e1b2e163d	Make interval overlap comparisons more explicit ... Blocks are half-open intervals [a, b), while all other intervals (chunks, head, ...) are closed intervals [a, b]. Make that distinction explicit by defining `OverlapsClosedInterval()` methods for blocks and chunks, and using them in place of the more generic `intervalOverlap()` function. This change also fixes `db.Querier()` and `db.Delete()`, which could previously return one extraneous block at the end of the specified interval. Signed-off-by: Benoît Knecht <benoit.knecht@fsfe.org>	8 years ago
Fabian Reinartz	d907928e57	Clarify docs, error on unexpected meta read errors ... Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Fabian Reinartz	af9003dcef	Add resilience to crashes during deletion ... Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
codwu	cd145c90d5	remove `put` function and use RLock in `Iter` function ... Signed-off-by: codwu <wuhan9087@163.com>	8 years ago
codwu	84a45cb79a	add rwmutex to prevent concurrent map read when delete series ... Signed-off-by: codwu <wuhan9087@163.com>	8 years ago
Ganesh Vernekar	528439aa93	Cleanup new blocks on 'CleanTombstones' faliure. ... Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>	8 years ago
Goutham Veeramachaneni	f82a1fe4f2	Simplify stones counting. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Mario Trangoni	c2182820ed	fix megacheck issue: should omit values from range	8 years ago
Simon Pasquier	79defa54df	Fix crash when a series has no block	8 years ago
Fabian Reinartz	d09283f60a	Add repair of bad index version	8 years ago
Goutham Veeramachaneni	2c3400ab4e	Add block ULID to index reader errors ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Shubheksha Jalan	7b27dc2109	address review comments, fix index tests	8 years ago
Shubheksha Jalan	44052bc937	Make version for index format configurable	8 years ago
Shubheksha Jalan	129773b41a	merge BlockMeta and blockMeta struct, implement v1 and v2 index readers	8 years ago
Fabian Reinartz	1e55b7987f	Improve comments, handle allPostingsKey properly	8 years ago
Fabian Reinartz	67f0ca8f0e	Move index and chunk encoders to own packages	8 years ago
Goutham Veeramachaneni	3158b03e6c	Select series with label unset for != and !~ ... Fixes https://github.com/prometheus/prometheus/issues/3575 Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in> Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	8 years ago
Goutham Veeramachaneni	e7445d00b0	Add a function to cleanup tombstones. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	1fc94a02d1	Don't retry failed compactions. ... Fixes prometheus/prometheus#3487 Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	f1512a368a	Expose ChunkSeriesSet and lookups methods.	8 years ago
Fabian Reinartz	3ef4326114	Refactor tombstone reader types	8 years ago
Fabian Reinartz	e5ce2bef43	Add explicit error to Querier.Select ... This has been a frequent source of debugging pain since errors are potentially delayed to a much later point. They bubble up in an unrelated execution path.	8 years ago
Fabian Reinartz	d578b10d5c	chunk: make reader accept abstract ByteSlice	8 years ago
Fabian Reinartz	b7c3cfecbf	index: abstract ByteSlice and adjust indexReader ... This replaces the builtin byte slice with an interface for the index reader. This allows the complex decoding of the index file format to be used against more generalized implementations.	8 years ago
Sunny Klair	4fdf9b195c	Validate index TOC checksum on read	8 years ago
Fabian Reinartz	fb9da52b11	Add more verbose error handling for closing, reduce locking ... This commit introduces error returns in various places and is explicit about closing persisted blocks. {Index,Chunk,Tombstone}Readers are more consistent about their Close() method. Whenever a reader is retrieved, the corresponding close method must eventually be called. We use this to track pending readers against persisted blocks. Querier's against the DB no longer hold a read lock for their entire lifecycle. This avoids long running queriers to starve new ones when we have to acquire a write lock when reloading blocks.	8 years ago
Fabian Reinartz	78df406dac	Allocate and cache strings for persisted blocks ... This change loads the full symbol table when we open a persisted block and allocates a string for each. This ensures that strings retrieved through the index can be used after the block was closed. Before we backed the strings by the mmap'd byte regions which would segfault in this case. Also remove an inconsistency in the disk format and move both offset tables to the end (breaking change).	8 years ago
Goutham Veeramachaneni	8919baef03	Expose NewIndexReader() and cleanups ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	1ddedf2b30	Change series ID from uint32 to uint64	8 years ago
Fabian Reinartz	4cc37eecab	Refactor and add tests for compactor	8 years ago
Fabian Reinartz	5cf2662074	Refactor WAL into Head and misc improvements	8 years ago
Fabian Reinartz	3901b6e70b	Remove multiple heads ... This changes the structure to a single WAL backed by a single head block. Parts of the head block can be compacted. This relieves us from any head amangement and greatly simplifies any consistency and isolation concerns by just having a single head.	8 years ago
Goutham Veeramachaneni	7438ed7035	Expose Intervals type for use by TombstoneReader. ... TombstoneReader is exposed but Intervals is not. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	905af27cf9	Refactor compactor	9 years ago
Fabian Reinartz	66ff7b12e9	Pool Chunk objects during compaction	9 years ago
Fabian Reinartz	2644c8665c	Don't allocate ChunkMetas, reuse postings slices	9 years ago
Fabian Reinartz	96d7f540d4	Persist series without allocating the full set ... Change index persistence for series to not be accumulated in memory before being written as one large batch. `Labels` and `ChunkMeta` objects are reused. This cuts down memory spikes during compaction of multiple blocks significantly. As part of the the Index{Reader,Writer} now have an explicit notion of symbols and series must be inserted in order.	9 years ago
Fabian Reinartz	3410559c1b	Compact head block early ... Let older head blocks be compacted once the newest once has samples at 50% of its total range. This allows the memory of the compacted blocks to be released and garbage collected before a new head block gets created. Thereby the number of head blocks is 1 or 2 instead of 2 or 3 and memory spikes are reduced.	9 years ago
Fabian Reinartz	683b4c8c2a	Add list of source head blocks to meta.json	9 years ago
Goutham Veeramachaneni	261cd9f393	Incorporate feedback. ... Move back to {Enable, Disable}Compactions. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	a110a64abd	Add full Snapshot support ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	a1c8425357	Initial implementation of HeadBlock Snapshots ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	29c73f05f2	Make sure that mint and maxt are not modified. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	44e9ae38b5	Incorporate PR feedback. ... * Expose Stone as it is used in an exported method. * Move from tombstoneReader to []Stone for the same reason as above. * Make WAL reading a little cleaner. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	6febabeb28	Final delete fixes. ... * Make sure no reads happen on the block when delete is in progress. * Fix bugs in compaction. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	f29fb62fba	Make TombstoneReader a Getter. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago