353 Commits (080a9300a1daccac562ae05c0d3be45e09a6ca91)

Author	SHA1	Message	Date
Ashwanth	c24e1b27e8	chore: End index reader span on Close (#20854)	4 days ago
Robert Fratto	00c8211fbf	chore(engine): add concurrency to Pipeline.Open (#20839)	4 days ago
George Robinson	a6c83aa2e0	chore: remove deprecated metrics (#20844)	4 days ago
Robert Fratto	0437dabfb9	chore(metastore): fix metastore.indexSectionsReader Open semantics (#20835)	5 days ago
Ashwanth	73961f18a3	chore(xcap): leaner xcap API (#20771)	5 days ago
benclive	cd16b029db	chore: fix panic on read err in batchDecoratorReader (#20787)	1 week ago
Robert Fratto	2d63582b15	chore: finish adding Open semantics in engine, metastore (#20798)	1 week ago
Robert Fratto	d85fb0317f	chore(dataobj): Add Open semantics to section readers (#20790) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	1 week ago
Robert Fratto	4023aeda3b	chore(dataobj): encode final dataobj size in dataobj metadata (#20769)	1 week ago
George Robinson	93f4bdf796	feat: allow the initial offset to be set in the starting phase (#20770)	2 weeks ago
George Robinson	b5c7ea2dc2	chore: use StartAndAwait functions (#20755)	2 weeks ago
Robert Fratto	7e03400309	chore(dataobj): rename dataset.ReaderOptions to dataset.RowReaderOptions (#20756)	2 weeks ago
George Robinson	8bf62a5124	chore: implement idiomatic worker pattern in indexer.go (#20646)	2 weeks ago
George Robinson	2949f75444	fix: handle lost partitions in index builders (#20744)	2 weeks ago
Trevor Whitney	83e275775a	chore: bring comparison metrics and goldfish metrics more in line (#20706) ... Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2 weeks ago
Robert Fratto	c12b305b05	chore(memory): permit slicing memory.Bitmap (#20699) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	2 weeks ago
George Robinson	c169ce3ae9	feat: add flush manager to control data object flush lifecycle (#20680)	2 weeks ago
George Robinson	4d1c4032cc	chore: small doc fix, missing period end of help (#20681)	2 weeks ago
George Robinson	72aaea20a6	chore: no lazy struct embed (#20682)	3 weeks ago
Robert Fratto	98b7cb6063	chore(dataobj): Refactor and extract row range logic (#20661)	3 weeks ago
benclive	7567393229	chore: Fix flaky indexer test (#20676)	3 weeks ago
George Robinson	fcdd2adf2a	fix: service failure on stopping kafkav2 consumer (#20672)	3 weeks ago
benclive	a029934ef2	chore: resolve predicate columns in distributed metastore (#20504)	3 weeks ago
George Robinson	7aee83d6d2	chore: use temporary builder to sort data objects (#20664)	3 weeks ago
benclive	328f3d45b9	fix(dataobj): Mark events completed after successful commit (#20658)	3 weeks ago
George Robinson	18f2c5049e	chore: move metrics into observeRecordErr (#20625)	3 weeks ago
Joe Elliott	08e5c9d77c	perf: Prealloc slice in index builder when downloading objects (#20647) ... Signed-off-by: Joe Elliott <number101010@gmail.com>	3 weeks ago
Robert Fratto	9d9d8ce14d	chore(engine): introduce experimental expression engine (#20626)	3 weeks ago
benclive	322a02d35d	chore: Refactor to avoid sharing a download worker (#20640)	3 weeks ago
Sandeep Sukhani	7f1450d8c5	feat(dataobj-compactor): add a planner for compaction of data objects (#20527)	3 weeks ago
Robert Fratto	736ccdbf93	chore(dataobj): rename dataset.Reader to RowReader (#20629)	3 weeks ago
George Robinson	14d2285b76	fix: set consumption lag to zero after idle flush timeout (#20620)	3 weeks ago
benclive	294d574bc9	fix(dataobj): Avoid deadlock in index-builder when cancelling mid-build (#20621)	3 weeks ago
George Robinson	0d9df6b055	chore: clean up consumer metrics (#20619)	3 weeks ago
George Robinson	cb938d0a9d	feat: separate metastore events and offsets from flushes (#20605)	3 weeks ago
Robert Fratto	747d75aa78	chore: make memory, columnar APIs more idiomatic (#20622)	3 weeks ago
George Robinson	45a7f55d39	fix: revert "feat: reset the consumption lag gauge after 1 minute of idle period" (#20617)	3 weeks ago
George Robinson	f1d0cdf145	feat: reset the consumption lag gauge after 1 minute of idle period (#20616)	3 weeks ago
George Robinson	8b86d42507	chore: no need for defer func (#20615)	3 weeks ago
George Robinson	4b2f46fc37	chore: move builder initialization out of processor.go (#20594)	3 weeks ago
George Robinson	7010fa8a87	chore: clean up partition processor code (#20593)	3 weeks ago
benclive	9ccf55d0ff	perf(dataobj): Optimize estimate size calculation (#20595)	4 weeks ago
benclive	6f72400daa	fix(enginev2): Copy values when storing min/max stats (#20589)	4 weeks ago
Robert Fratto	08aaaa3754	chore(columnar): add scalars and builders (#20583)	4 weeks ago
Robert Fratto	3e3a293215	chore(columnar): switch to generic Number type (#20580)	4 weeks ago
Ivan Kalita	86f87e447c	chore(dataobj): use reader adapter (#20572) ... Continuation of #20525, I'm updating logs, pointers, streams readers to use reader adapter. Also adding binary support to arrowconv.	4 weeks ago
Robert Fratto	44cfaedf85	chore(dataobj): move columnar.Array translation up to basicReader (#20551)	4 weeks ago
benclive	82b93d0102	chore: Use columnar reader for IndexSectionReader (#20501)	4 weeks ago
Ivan Kalita	aab681617b	chore(dataobj): add reader_adapter (#20525) ... Add a temporary translation layer []dataset.Row -> columnar.RecordBatch -> arrow.RecordBatch. - reader_adapter.go is temporary that's why I put it into the old columnar package - I added builders to reader_adapter.go and not to pkg/columnar.... as I'm not sure if we really would need them anywhere except for this adapter. If so I'm happy to move them to pkg/columnar. - I only updated indexpointers reader for now but will add support for more readers in the next PRs	1 month ago
Robert Fratto	b3f0e8797f	chore(dataobj): move columnar.Array translation up to columnReader (#20531)	1 month ago