48 Commits (4dd740e4cc2d6fb490a94deec899bb4ddb191eb4)

Author	SHA1	Message	Date
Chris Marchbanks	2db59a71a6	Fix assert order being backwards in a few places (#388) ... Signed-off-by: Chris Marchbanks <csmarchbanks@gmail.com>	7 years ago
Fabian Reinartz	22fd3ef24e	Deal with zero-length segments ... Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Fabian Reinartz	1a5573b4ce	Migrate write ahead log ... On startup, rewrite the old write ahead log into the new format once. Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Mario Trangoni	c0e888e82b	fix megacheck issues: os.SEEK_SET is deprecated: Use io.SeekStart, io.SeekCurrent, and io.SeekEnd.	8 years ago
Krasi Georgiev	eb6cdbcb5b	some test funcitons didn't cleanup after themselves.	8 years ago
Nipun	6537ee832c	Incorporated review comments	8 years ago
Nipun	cadae47522	fixed an issue in TestWALRestoreCorrupted	8 years ago
Fabian Reinartz	adb6be73dd	move label read function int labels pkg	8 years ago
Callum Styan	8326e410d0	decouple tsdb main.go (and tests) from prometheus/pkg	8 years ago
Callum Styan	ca4e817372	move test utils to it's own package so we can use it in tests for other packages in tsdb repo	8 years ago
Callum Styan	6c8bbf3f61	use test utils in wal_test	8 years ago
ranbochen	a27cf34a36	fix bugs on platform windows to pass all test case. (#192) ... * fix bugs on platform windows to pass all test case. * fix bugs on platform windows to pass all test case * clean up codes	8 years ago
ranbo chen	19340a382d	clean up codes	8 years ago
ranbo chen	b82b2d0c1b	fix bugs on platform windows to pass all test case.	8 years ago
Fabian Reinartz	80055bb95b	Truncate segments on broken header	8 years ago
Fabian Reinartz	d3682d701c	wal: decode and process in separate threads.	8 years ago
Bas Harenslak	5e1c258a98	Instrument WAL fsync	8 years ago
Fabian Reinartz	1e88ba06b4	Use boolean function instead of postings to drop WAL series ... There is not guarantee or requirement for WAL writers to only add series entries in increasing order of IDs. A postings list cannot look back and thus unordered WAL entries would skip over IDs to not truncate from the WAL. We replace it with a simple boolean check function that does not require order.	8 years ago
Fabian Reinartz	24362567b9	Fix test flakes	8 years ago
Fabian Reinartz	6892fc6dcb	Finish old WAL segment async, default to no fsync ... We were still fsyncing while holding the write lock when we cut a new segment. Given we cannot do anything but logging errors, we might just as well complete segments asynchronously. There's not realistic use case where one would fsync after every WAL entry, thus make the default of a flush interval of 0 to never fsync which is a much more likely use case.	8 years ago
Fabian Reinartz	c2916736be	Re-use slices on deocding the WAL. Fix tests.	8 years ago
Fabian Reinartz	0db4c227b7	Fix min/max time handling and concurrent crc32 usage	8 years ago
Fabian Reinartz	970bffec8d	Fix WAL errors and add tests for it	8 years ago
Fabian Reinartz	33e9bdf403	WAL refactoring and truncation fixes and test	8 years ago
Fabian Reinartz	1ddedf2b30	Change series ID from uint32 to uint64	8 years ago
Goutham Veeramachaneni	1698c516ad	[WIP]: WAL implementation ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	5cf2662074	Refactor WAL into Head and misc improvements	8 years ago
Fabian Reinartz	215a856f34	Just check for general error in WAL test ... Go 1.9 changed the returned error. Checking the exact message is too fragile.	8 years ago
Goutham Veeramachaneni	7438ed7035	Expose Intervals type for use by TombstoneReader. ... TombstoneReader is exposed but Intervals is not. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	44e9ae38b5	Incorporate PR feedback. ... * Expose Stone as it is used in an exported method. * Move from tombstoneReader to []Stone for the same reason as above. * Make WAL reading a little cleaner. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	bacb143b7e	Simplify tombstone and WAL Delete formats. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	f29fb62fba	Make TombstoneReader a Getter. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	3eb4119ab1	Make HeadBlock use WAL. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Fabian Reinartz	fb5c5535fc	Misc cleanup	9 years ago
Fabian Reinartz	4862b261d0	Abstract WAL into interface	9 years ago
Fabian Reinartz	535532ca02	Export refdSample ... The type was part of a exported method signatures and should therefore be exported as well.	9 years ago
Fabian Reinartz	778103b450	Add liecence file and headers	9 years ago
Fabian Reinartz	10c7c9acbe	Adjust import names to new repository organisation	9 years ago
Fabian Reinartz	ad5812d83a	Handle WAL corruption by truncating ... This adds handling for various corruption scenarios of the WAL. If corruption is encountered, we truncate the WAL after the last valid entry transparently and continue appending after the offset.	9 years ago
Fabian Reinartz	04bb006e2b	Handle WAL corruption by truncating ... This adds handling for various corruption scenarios of the WAL. If corruption is encountered, we truncate the WAL after the last valid entry transparently and continue appending after the offset.	9 years ago
Fabian Reinartz	d3edfb5540	Test multiple full write/restore cylcles in WAL	9 years ago
Fabian Reinartz	9c7a88223e	Add full encode/decode WAL cycle test	9 years ago
Fabian Reinartz	2c97428a79	Add basic WAL tests	9 years ago
Fabian Reinartz	9ddbd64d00	Move stats into meta.json file, cleanup, docs	9 years ago
Fabian Reinartz	2f02f86b62	Fix WAL tests	9 years ago
Fabian Reinartz	1943f8d1bb	Fix head block stats races	9 years ago
Fabian Reinartz	937cdb579c	Switch to sequential block names ... This changes block directory names from the int64 timestamp to sequential numbering.	9 years ago
Fabian Reinartz	7280533c42	Add basic shard metrics	9 years ago
Fabian Reinartz	8aba95048a	Rename to OpenHeadBlock	9 years ago
Fabian Reinartz	1dde3b6d31	Add WAL decoder+loading and benchmarks	9 years ago