339 Commits (main)

Author	SHA1	Message	Date
Trevor Whitney	83e275775a	chore: bring comparison metrics and goldfish metrics more in line (#20706) ... Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2 days ago
Robert Fratto	c12b305b05	chore(memory): permit slicing memory.Bitmap (#20699) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	2 days ago
George Robinson	c169ce3ae9	feat: add flush manager to control data object flush lifecycle (#20680)	3 days ago
George Robinson	4d1c4032cc	chore: small doc fix, missing period end of help (#20681)	4 days ago
George Robinson	72aaea20a6	chore: no lazy struct embed (#20682)	4 days ago
Robert Fratto	98b7cb6063	chore(dataobj): Refactor and extract row range logic (#20661)	4 days ago
benclive	7567393229	chore: Fix flaky indexer test (#20676)	4 days ago
George Robinson	fcdd2adf2a	fix: service failure on stopping kafkav2 consumer (#20672)	5 days ago
benclive	a029934ef2	chore: resolve predicate columns in distributed metastore (#20504)	5 days ago
George Robinson	7aee83d6d2	chore: use temporary builder to sort data objects (#20664)	5 days ago
benclive	328f3d45b9	fix(dataobj): Mark events completed after successful commit (#20658)	5 days ago
George Robinson	18f2c5049e	chore: move metrics into observeRecordErr (#20625)	6 days ago
Joe Elliott	08e5c9d77c	perf: Prealloc slice in index builder when downloading objects (#20647) ... Signed-off-by: Joe Elliott <number101010@gmail.com>	6 days ago
Robert Fratto	9d9d8ce14d	chore(engine): introduce experimental expression engine (#20626)	6 days ago
benclive	322a02d35d	chore: Refactor to avoid sharing a download worker (#20640)	6 days ago
Sandeep Sukhani	7f1450d8c5	feat(dataobj-compactor): add a planner for compaction of data objects (#20527)	7 days ago
Robert Fratto	736ccdbf93	chore(dataobj): rename dataset.Reader to RowReader (#20629)	1 week ago
George Robinson	14d2285b76	fix: set consumption lag to zero after idle flush timeout (#20620)	1 week ago
benclive	294d574bc9	fix(dataobj): Avoid deadlock in index-builder when cancelling mid-build (#20621)	1 week ago
George Robinson	0d9df6b055	chore: clean up consumer metrics (#20619)	1 week ago
George Robinson	cb938d0a9d	feat: separate metastore events and offsets from flushes (#20605)	1 week ago
Robert Fratto	747d75aa78	chore: make memory, columnar APIs more idiomatic (#20622)	1 week ago
George Robinson	45a7f55d39	fix: revert "feat: reset the consumption lag gauge after 1 minute of idle period" (#20617)	1 week ago
George Robinson	f1d0cdf145	feat: reset the consumption lag gauge after 1 minute of idle period (#20616)	1 week ago
George Robinson	8b86d42507	chore: no need for defer func (#20615)	1 week ago
George Robinson	4b2f46fc37	chore: move builder initialization out of processor.go (#20594)	1 week ago
George Robinson	7010fa8a87	chore: clean up partition processor code (#20593)	1 week ago
benclive	9ccf55d0ff	perf(dataobj): Optimize estimate size calculation (#20595)	2 weeks ago
benclive	6f72400daa	fix(enginev2): Copy values when storing min/max stats (#20589)	2 weeks ago
Robert Fratto	08aaaa3754	chore(columnar): add scalars and builders (#20583)	2 weeks ago
Robert Fratto	3e3a293215	chore(columnar): switch to generic Number type (#20580)	2 weeks ago
Ivan Kalita	86f87e447c	chore(dataobj): use reader adapter (#20572) ... Continuation of #20525, I'm updating logs, pointers, streams readers to use reader adapter. Also adding binary support to arrowconv.	2 weeks ago
Robert Fratto	44cfaedf85	chore(dataobj): move columnar.Array translation up to basicReader (#20551)	2 weeks ago
benclive	82b93d0102	chore: Use columnar reader for IndexSectionReader (#20501)	2 weeks ago
Ivan Kalita	aab681617b	chore(dataobj): add reader_adapter (#20525) ... Add a temporary translation layer []dataset.Row -> columnar.RecordBatch -> arrow.RecordBatch. - reader_adapter.go is temporary that's why I put it into the old columnar package - I added builders to reader_adapter.go and not to pkg/columnar.... as I'm not sure if we really would need them anywhere except for this adapter. If so I'm happy to move them to pkg/columnar. - I only updated indexpointers reader for now but will add support for more readers in the next PRs	2 weeks ago
Robert Fratto	b3f0e8797f	chore(dataobj): move columnar.Array translation up to columnReader (#20531)	2 weeks ago
Robert Fratto	b557429014	chore(dataobj): Use columnar API in pageReader (#20509) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	3 weeks ago
George Robinson	a85a9a200c	chore: replace quartz with synctest (#20452)	3 weeks ago
George Robinson	d5f6026e30	fix: service failed to shutdown errors when context canceled (#20450)	3 weeks ago
yy	0574159216	chore: typos in comments (#20481)	3 weeks ago
George Robinson	0b0a98de44	chore: use services.BasicService in partition_processor.go (#20448)	3 weeks ago
Robert Fratto	e0370b13c9	chore(dataobj): reduce pageReader allocations (#20496)	3 weeks ago
Robert Fratto	d14bcc1c06	chore(columnar): add experimental columnar package for pkg/dataobj (#20478)	3 weeks ago
Ivan Kalita	7da73aaa7e	chore(dataobj): optimize bitmap decoder (#20467) ... - Use pkg/memory.Bitmap instead of []Value for pageReader presence bitmap - More efficient decoding for bitmapDecoder - only support 0/1 values (this encoding is used only for presence bitmap).	3 weeks ago
George Robinson	27df4ab481	feat: create separate flusher to support parallel flushes (#20446)	3 weeks ago
Robert Fratto	8fbe1df00a	chore(memory): move subpackages into memory package (#20469)	3 weeks ago
benclive	d974141db5	perf: Optimize delta decoder (#20451)	3 weeks ago
Robert Fratto	c89a0bb0b4	chore(dataobj): optimize plain value decoder (#20441) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	3 weeks ago
George Robinson	6a8b879d8f	feat: add support for cancelation to copy and sort (#20370)	4 weeks ago
Robert Fratto	8996bdcff3	chore(dataobj): add benchmarks for plain decoder (#20423)	4 weeks ago