21 Commits (fe67d2f16a930b790c3f323c19adaef18edbe97c)

Author	SHA1	Message	Date
Callum Styan	8326e410d0	decouple tsdb main.go (and tests) from prometheus/pkg	9 years ago
Callum Styan	ca4e817372	move test utils to it's own package so we can use it in tests for other packages in tsdb repo	9 years ago
Callum Styan	945b6b01aa	use test utils in index_test	9 years ago
Fabian Reinartz	b7c3cfecbf	index: abstract ByteSlice and adjust indexReader ... This replaces the builtin byte slice with an interface for the index reader. This allows the complex decoding of the index file format to be used against more generalized implementations.	9 years ago
Fabian Reinartz	fb9da52b11	Add more verbose error handling for closing, reduce locking ... This commit introduces error returns in various places and is explicit about closing persisted blocks. {Index,Chunk,Tombstone}Readers are more consistent about their Close() method. Whenever a reader is retrieved, the corresponding close method must eventually be called. We use this to track pending readers against persisted blocks. Querier's against the DB no longer hold a read lock for their entire lifecycle. This avoids long running queriers to starve new ones when we have to acquire a write lock when reloading blocks.	9 years ago
Fabian Reinartz	78df406dac	Allocate and cache strings for persisted blocks ... This change loads the full symbol table when we open a persisted block and allocates a string for each. This ensures that strings retrieved through the index can be used after the block was closed. Before we backed the strings by the mmap'd byte regions which would segfault in this case. Also remove an inconsistency in the disk format and move both offset tables to the end (breaking change).	9 years ago
Fabian Reinartz	c36d574290	Replace single head lock with granular locks ... This adds various new locks to replace the single big lock on the head. All parts now must be COW as they may be held by clients after initial retrieval. Series by ID and hashes are now held in a stripe lock to reduce contention and total holding time during GC. This should reduce starvation of readers.	9 years ago
Fabian Reinartz	1ddedf2b30	Change series ID from uint32 to uint64	9 years ago
Fabian Reinartz	2644c8665c	Don't allocate ChunkMetas, reuse postings slices	9 years ago
Fabian Reinartz	96d7f540d4	Persist series without allocating the full set ... Change index persistence for series to not be accumulated in memory before being written as one large batch. `Labels` and `ChunkMeta` objects are reused. This cuts down memory spikes during compaction of multiple blocks significantly. As part of the the Index{Reader,Writer} now have an explicit notion of symbols and series must be inserted in order.	9 years ago
Fabian Reinartz	df96d97dab	Move chunk checksum	9 years ago
Fabian Reinartz	778103b450	Add liecence file and headers	9 years ago
Goutham Veeramachaneni	86929ed090	Added Test For indexReader.LabelValues ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Fabian Reinartz	10c7c9acbe	Adjust import names to new repository organisation	9 years ago
Goutham Veeramachaneni	71e05a22c7	Add mockIndex And Refactor Tests To Use That	9 years ago
Fabian Reinartz	a8e8903350	Use ChunkMeta references for clarity ... This has been a common source of hard to debug issues. Its a premature and unbenchmarked optimization and semantically, we want ChunkMetas to be references in all changed cases.	9 years ago
Fabian Reinartz	d6fb6aaaa8	Rename paritionSeriesSet to mergedSeriesSet	9 years ago
Fabian Reinartz	5876a3303c	Add test for Index postings querying	9 years ago
Fabian Reinartz	ca1bc920b7	Test updates	9 years ago
Fabian Reinartz	8a7addfc44	Split persistence by chunk/index instead of read/write	9 years ago
Fabian Reinartz	2841499212	Simplify and split up iterators ... This simplifies some of the iterators by loading chunks from the ChunkReader earlier, filtering of chunks vs filtering or series is split into separate iterators for easier testing	9 years ago
Fabian Reinartz	ed63636de4	Add initial index write/read symmetry test.	9 years ago