prometheus

Commit Graph

Author	SHA1	Message	Date
Ganesh Vernekar	7cf09b0395	Moving tsdb into its own subdirectory Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>	6 years ago
Chris Marchbanks	b40cc43958	Provide option to compress WAL records (#609 ) In running Prometheus instances, compressing the records was shown to reduce disk usage by half while incurring a negligible CPU cost. Signed-off-by: Chris Marchbanks <csmarchbanks@gmail.com>	6 years ago
beorn7	90a7612df3	Make objectives of Summaries explicit With the next release of client_golang, Summaries will not have objectives by default. As it turns out, for prometheus_tsdb_head_gc_duration_seconds and prometheus_tsdb_wal_truncate_duration_seconds, the objective-less default makes more sense then the current default. To make sure we do the right thing before and after the upcoming release of client_golang, I have set the objectives explicitly wherever that was not the case so far: - prometheus_tsdb_head_gc_duration_seconds and prometheus_tsdb_wal_truncate_duration_seconds now have no objectives explicitly. - prometheus_tsdb_wal_fsync_duration_seconds now explicitly uses the previous default objectives. Signed-off-by: beorn7 <beorn@grafana.com>	6 years ago
zhulongcheng	19d402d154	cleanup tmp files (#570 ) Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago
Alec	e7436e13f0	Merge encoding_helpers.go to tsdbutil (#526 ) remove duplicate encoding helper funcs and move to own package so they can be reused. Signed-off-by: naivewong <867245430@qq.com>	6 years ago
Krasi Georgiev	48c439d26d	fix statick check errors (#475 ) fix the tests for `check_license` and `staticcheck` the static check also found some actual bugs. Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	7 years ago
Krasi Georgiev	2e0571caba	remove unused WALFlushInterval option and NopWAL struct (#468 ) The WALFlushInterval is not used anywhere in the code base. The WAL is not an interface anymore to save some lookup time so can't use NopWAL in the tests. Instead can just pass nil as the code checks for that and it is essentially a noop. Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	7 years ago
JoeWrightss	c8c03ff85b	fix some typos (#466 ) Signed-off-by: JoeWrightss <zhoulin.xie@daocloud.io>	7 years ago
Krasi Georgiev	d05611c027	removed some unused code and moved mockSeriesSet in querier_test (#394 ) Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	7 years ago
Goutham Veeramachaneni	9c8ca47399	Fix filehandling for windows (#392 ) * Fix filehandling for windows Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Fix more windows filehandling issues Windows: Close files before deleting Checkpoints. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close writers in case of errors so they can be deleted Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close block so that it can be deleted. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close file to delete it Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: Close dir so that it can be deleted. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> Windows: close files so that they can be deleted. Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com> * Review feedback Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	7 years ago
beorn7	3bc6c670fa	Revert "Remove `prometheus_` prefix from metrics" This reverts commit `98fe30438c`. After some discussion, it was concluded that we want the full `prometheus_tsdb_...` prefix hardcoded in the library. Signed-off-by: beorn7 <beorn@soundcloud.com>	7 years ago
Callum Styan	722f0ab920	break MigrateWAL into two functions, detection and migration (#371 ) Signed-off-by: Callum Styan <callumstyan@gmail.com>	7 years ago
beorn7	98fe30438c	Remove `prometheus_` prefix from metrics This can now be added by users of the library as needed with the new https://godoc.org/github.com/prometheus/client_golang/prometheus#WrapRegistererWithPrefix Signed-off-by: beorn7 <beorn@soundcloud.com>	7 years ago
Fabian Reinartz	74b3501161	Fix Rename call Signed-off-by: Fabian Reinartz <freinartz@google.com>	7 years ago
Fabian Reinartz	ee7ee059ef	Fix doc comments Signed-off-by: Fabian Reinartz <freinartz@google.com>	7 years ago
Fabian Reinartz	22fd3ef24e	Deal with zero-length segments Signed-off-by: Fabian Reinartz <freinartz@google.com>	7 years ago
Fabian Reinartz	92e1b20957	Fix close handling Signed-off-by: Fabian Reinartz <freinartz@google.com>	7 years ago
Fabian Reinartz	1a5573b4ce	Migrate write ahead log On startup, rewrite the old write ahead log into the new format once. Signed-off-by: Fabian Reinartz <freinartz@google.com>	7 years ago
Alexey Palazhchenko	9283c68e7d	Fix ineffective assignment. Signed-off-by: Alexey Palazhchenko <alexey.palazhchenko@gmail.com>	7 years ago
Mario Trangoni	b7173eb0e5	fix some comments typos (#315 )	7 years ago
Mario Trangoni	c0e888e82b	fix megacheck issues: os.SEEK_SET is deprecated: Use io.SeekStart, io.SeekCurrent, and io.SeekEnd.	7 years ago
Tobias Schmidt	6027af95ca	Fix missing prefix of tsdb_wal_* metrics	8 years ago
Fabian Reinartz	a993f0ccc0	Fix typo	8 years ago
ranbochen	a27cf34a36	fix bugs on platform windows to pass all test case. (#192 ) * fix bugs on platform windows to pass all test case. * fix bugs on platform windows to pass all test case * clean up codes	8 years ago
ranbo chen	19340a382d	clean up codes	8 years ago
ranbo chen	b82b2d0c1b	fix bugs on platform windows to pass all test case.	8 years ago
Fabian Reinartz	8aedb7671e	wal: synchronize background operations This adds an actor channel and thereby serializes all background operations through the run() method. Fixes an existing race.	8 years ago
Fabian Reinartz	80055bb95b	Truncate segments on broken header	8 years ago
Fabian Reinartz	7efb830d70	wal: parallelize sample processing	8 years ago
Fabian Reinartz	d3682d701c	wal: decode and process in separate threads.	8 years ago
Simon Pasquier	3e17cd1621	Instrument WAL corruptions	8 years ago
Bas Harenslak	5e1c258a98	Instrument WAL fsync	8 years ago
Fabian Reinartz	bbe72dccb9	Remove dependency on etcd/pkg/fileutil	8 years ago
Goutham Veeramachaneni	c35d3a65bd	Add levels to all log lines. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	1e88ba06b4	Use boolean function instead of postings to drop WAL series There is not guarantee or requirement for WAL writers to only add series entries in increasing order of IDs. A postings list cannot look back and thus unordered WAL entries would skip over IDs to not truncate from the WAL. We replace it with a simple boolean check function that does not require order.	8 years ago
Fabian Reinartz	162a48e4f2	Create series with ID recorded in WAL when reading it back	8 years ago
Fabian Reinartz	7ada9cd805	Simplify series create logic in head	8 years ago
Fabian Reinartz	6892fc6dcb	Finish old WAL segment async, default to no fsync We were still fsyncing while holding the write lock when we cut a new segment. Given we cannot do anything but logging errors, we might just as well complete segments asynchronously. There's not realistic use case where one would fsync after every WAL entry, thus make the default of a flush interval of 0 to never fsync which is a much more likely use case.	8 years ago
Fabian Reinartz	1d5f85817d	Fix various races	8 years ago
Fabian Reinartz	c2916736be	Re-use slices on deocding the WAL. Fix tests.	8 years ago
Fabian Reinartz	0db4c227b7	Fix min/max time handling and concurrent crc32 usage	8 years ago
Fabian Reinartz	970bffec8d	Fix WAL errors and add tests for it	8 years ago
Fabian Reinartz	81222849bc	Filter WAL data in Head, misc fixes	8 years ago
Fabian Reinartz	33e9bdf403	WAL refactoring and truncation fixes and test	8 years ago
Fabian Reinartz	c36d574290	Replace single head lock with granular locks This adds various new locks to replace the single big lock on the head. All parts now must be COW as they may be held by clients after initial retrieval. Series by ID and hashes are now held in a stripe lock to reduce contention and total holding time during GC. This should reduce starvation of readers.	8 years ago
Fabian Reinartz	1ddedf2b30	Change series ID from uint32 to uint64	8 years ago
Goutham Veeramachaneni	1698c516ad	[WIP]: WAL implementation Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	893b6ec506	Add tests for GC and chunk truncation	8 years ago
Fabian Reinartz	5cf2662074	Refactor WAL into Head and misc improvements	8 years ago
Fabian Reinartz	3901b6e70b	Remove multiple heads This changes the structure to a single WAL backed by a single head block. Parts of the head block can be compacted. This relieves us from any head amangement and greatly simplifies any consistency and isolation concerns by just having a single head.	8 years ago

1 Commits (7cf09b0395125280eb3e2d44b603349aeecacec1)