92 Commits (4dd740e4cc2d6fb490a94deec899bb4ddb191eb4)

Author	SHA1	Message	Date
Krasi Georgiev	d05611c027	removed some unused code and moved mockSeriesSet in querier_test (#394) ... Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	7 years ago
Goutham Veeramachaneni	9c8ca47399	Fix filehandling for windows (#392) ... * Fix filehandling for windows Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Fix more windows filehandling issues Windows: Close files before deleting Checkpoints. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close writers in case of errors so they can be deleted Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close block so that it can be deleted. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close file to delete it Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close dir so that it can be deleted. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: close files so that they can be deleted. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Review feedback Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	7 years ago
beorn7	3bc6c670fa	Revert "Remove `prometheus_` prefix from metrics" ... This reverts commit 98fe30438c. After some discussion, it was concluded that we want the full `prometheus_tsdb_...` prefix hardcoded in the library. Signed-off-by: beorn7 <beorn@soundcloud.com>	7 years ago
Callum Styan	722f0ab920	break MigrateWAL into two functions, detection and migration (#371) ... Signed-off-by: Callum Styan <callumstyan@gmail.com>	7 years ago
beorn7	98fe30438c	Remove `prometheus_` prefix from metrics ... This can now be added by users of the library as needed with the new https://godoc.org/github.com/prometheus/client_golang/prometheus#WrapRegistererWithPrefix Signed-off-by: beorn7 <beorn@soundcloud.com>	7 years ago
Fabian Reinartz	74b3501161	Fix Rename call ... Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Fabian Reinartz	ee7ee059ef	Fix doc comments ... Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Fabian Reinartz	22fd3ef24e	Deal with zero-length segments ... Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Fabian Reinartz	92e1b20957	Fix close handling ... Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Fabian Reinartz	1a5573b4ce	Migrate write ahead log ... On startup, rewrite the old write ahead log into the new format once. Signed-off-by: Fabian Reinartz <freinartz@google.com>	8 years ago
Alexey Palazhchenko	9283c68e7d	Fix ineffective assignment. ... Signed-off-by: Alexey Palazhchenko <alexey.palazhchenko@gmail.com>	8 years ago
Mario Trangoni	b7173eb0e5	fix some comments typos (#315)	8 years ago
Mario Trangoni	c0e888e82b	fix megacheck issues: os.SEEK_SET is deprecated: Use io.SeekStart, io.SeekCurrent, and io.SeekEnd.	8 years ago
Tobias Schmidt	6027af95ca	Fix missing prefix of tsdb_wal_* metrics	8 years ago
Fabian Reinartz	a993f0ccc0	Fix typo	8 years ago
ranbochen	a27cf34a36	fix bugs on platform windows to pass all test case. (#192) ... * fix bugs on platform windows to pass all test case. * fix bugs on platform windows to pass all test case * clean up codes	8 years ago
ranbo chen	19340a382d	clean up codes	8 years ago
ranbo chen	b82b2d0c1b	fix bugs on platform windows to pass all test case.	8 years ago
Fabian Reinartz	8aedb7671e	wal: synchronize background operations ... This adds an actor channel and thereby serializes all background operations through the run() method. Fixes an existing race.	8 years ago
Fabian Reinartz	80055bb95b	Truncate segments on broken header	8 years ago
Fabian Reinartz	7efb830d70	wal: parallelize sample processing	8 years ago
Fabian Reinartz	d3682d701c	wal: decode and process in separate threads.	8 years ago
Simon Pasquier	3e17cd1621	Instrument WAL corruptions	8 years ago
Bas Harenslak	5e1c258a98	Instrument WAL fsync	8 years ago
Fabian Reinartz	bbe72dccb9	Remove dependency on etcd/pkg/fileutil	8 years ago
Goutham Veeramachaneni	c35d3a65bd	Add levels to all log lines. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	1e88ba06b4	Use boolean function instead of postings to drop WAL series ... There is not guarantee or requirement for WAL writers to only add series entries in increasing order of IDs. A postings list cannot look back and thus unordered WAL entries would skip over IDs to not truncate from the WAL. We replace it with a simple boolean check function that does not require order.	8 years ago
Fabian Reinartz	162a48e4f2	Create series with ID recorded in WAL when reading it back	8 years ago
Fabian Reinartz	7ada9cd805	Simplify series create logic in head	8 years ago
Fabian Reinartz	6892fc6dcb	Finish old WAL segment async, default to no fsync ... We were still fsyncing while holding the write lock when we cut a new segment. Given we cannot do anything but logging errors, we might just as well complete segments asynchronously. There's not realistic use case where one would fsync after every WAL entry, thus make the default of a flush interval of 0 to never fsync which is a much more likely use case.	8 years ago
Fabian Reinartz	1d5f85817d	Fix various races	8 years ago
Fabian Reinartz	c2916736be	Re-use slices on deocding the WAL. Fix tests.	8 years ago
Fabian Reinartz	0db4c227b7	Fix min/max time handling and concurrent crc32 usage	8 years ago
Fabian Reinartz	970bffec8d	Fix WAL errors and add tests for it	8 years ago
Fabian Reinartz	81222849bc	Filter WAL data in Head, misc fixes	8 years ago
Fabian Reinartz	33e9bdf403	WAL refactoring and truncation fixes and test	8 years ago
Fabian Reinartz	c36d574290	Replace single head lock with granular locks ... This adds various new locks to replace the single big lock on the head. All parts now must be COW as they may be held by clients after initial retrieval. Series by ID and hashes are now held in a stripe lock to reduce contention and total holding time during GC. This should reduce starvation of readers.	8 years ago
Fabian Reinartz	1ddedf2b30	Change series ID from uint32 to uint64	8 years ago
Goutham Veeramachaneni	1698c516ad	[WIP]: WAL implementation ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	893b6ec506	Add tests for GC and chunk truncation	8 years ago
Fabian Reinartz	5cf2662074	Refactor WAL into Head and misc improvements	8 years ago
Fabian Reinartz	3901b6e70b	Remove multiple heads ... This changes the structure to a single WAL backed by a single head block. Parts of the head block can be compacted. This relieves us from any head amangement and greatly simplifies any consistency and isolation concerns by just having a single head.	8 years ago
Alin Sinpalean	8f7934d025	Take the fdatasync() syscall out from under mutex lock to (mostly) avoid scrape and eval from blocking on disk I/O.	8 years ago
Matt Layher	78b15c3434	Add newCRC32 function to simplify hash initialization	8 years ago
Goutham Veeramachaneni	7438ed7035	Expose Intervals type for use by TombstoneReader. ... TombstoneReader is exposed but Intervals is not. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	44e9ae38b5	Incorporate PR feedback. ... * Expose Stone as it is used in an exported method. * Move from tombstoneReader to []Stone for the same reason as above. * Make WAL reading a little cleaner. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	bacb143b7e	Simplify tombstone and WAL Delete formats. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	f29fb62fba	Make TombstoneReader a Getter. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	9bf7aa9af1	Misc. fixes incorporating feedback. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago
Goutham Veeramachaneni	3eb4119ab1	Make HeadBlock use WAL. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	9 years ago