9 Commits (89b8ae4b4981881aaf636d94de59d0f802c6656d)

Author	SHA1	Message	Date
Peter Štibraný	a2c2a90907	Lint: comments ... Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	7 years ago
Peter Štibraný	06007c0ad1	Renamed LZ4 -> Lz4 to make lint happy. ... Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	7 years ago
Peter Štibraný	fb143fec02	Undo small change. ... Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	7 years ago
Peter Štibraný	9979321c2a	Don't pool LZ4 readers that read big blocks. ... Such readers must have allocated twice as many bytes as the block size, and we don't want to pool them and keep that memory allocated. This can happen when reading chunks that were compressed with high buffer size. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	7 years ago
Peter Štibraný	b0a7cf8f9d	Change default LZ4 buffer size to 64k. ... Added more LZ4 buffer size options for testing. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com>	7 years ago
Cyril Tovena	7654c27c12	Adds configurable compression algorithms for chunks (#1411) ... * Adds L4Z encoding. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds encoding benchmarks Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds snappy encoding. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds chunk size test Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds snappy v2 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Improve benchmarks Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove chunkenc Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Update lz4 to latest master version. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Use temporary buffer in serialise method to avoid allocations when doing string -> byte conversion. It also makes code little more readable. We pool those buffers for reuse. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Added gzip -1 for comparison. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Initialize reader and buffered reader lazily. This helps with reader/buffered reader reuse. Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Don't keep entries, extracted generateData function (mostly to get more understandable profile) Signed-off-by: Peter Štibraný <peter.stibrany@grafana.com> * Improve test and benchmark to cover all encodings. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Adds support for a new chunk format with encoding info. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Ingesters now support encoding config. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add support for no compression. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Add docs Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Remove default Gzip for ByteChunk. Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Removes none, snappyv2 and gzip-1 Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * Move log test lines to testdata and add supported encoding stringer Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com> * got linted Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>	7 years ago
Cyril Tovena	1dfee23b65	replace gzip golang package by github.com/klauspost/compress (#831) ... * replace gzip golang package by github.com/klauspost/compress * cleanup import * revert grafana tag image	7 years ago
Cyril Tovena	cb7c8f6233	Use prometheus pool for line buffer. (#790) ... * Use prometheus pool for line buffer.	7 years ago
Cyril Tovena	3346ce1b40	Storage memory improvement (#713) ... * add benchmark for storage queries * improve iterator to load only on next * fix memory retained by lazy chunks * reverse backward lazy iterator	7 years ago