Commit Graph

364 Commits (main)

Author SHA1 Message Date
benclive 968dabadd5
chore: Increase batch sizes for pointers reads (#20983) 2 weeks ago
George Robinson 6cf495f646
chore: rename flushManager to flushCommitter to prepare for future changes (#21135) 2 weeks ago
George Robinson 8a68101b3b
feat: add builder pool to logsobj package (#21134) 2 weeks ago
Robert Fratto fdc807e6df
chore(dataobj): prefetch during open for rowReaderDownloader (#20942) 4 weeks ago
Robert Fratto b8920125c5
chore(dataobj): add configurable prefetching (#20946) 4 weeks ago
Robert Fratto b340795f25
chore(dataobj): add missing test for opening legacy object (#20943) 4 weeks ago
Bryan Boreham ced1d1b175
perf(dataset): use faster Uvarint implementation (#20824) 1 month ago
benclive f6bd6b7cb3
chore: Ignore errgroup context in decoder (#20880) 1 month ago
Robert Fratto f9bdab2fc8
chore(dataobj): restructure dataobjs to store metadata at the front of the file (#20865) 1 month ago
Dylan Guedes b9af4f5223
fix: Reset lag for index builder when partitions change (#20825) 1 month ago
Robert Fratto 44d6794af2
chore(metastore): fix panic in index sections reader (#20875) 1 month ago
Ashwanth c24e1b27e8
chore: End index reader span on Close (#20854) 1 month ago
Robert Fratto 00c8211fbf
chore(engine): add concurrency to Pipeline.Open (#20839) 1 month ago
George Robinson a6c83aa2e0
chore: remove deprecated metrics (#20844) 1 month ago
Robert Fratto 0437dabfb9
chore(metastore): fix metastore.indexSectionsReader Open semantics (#20835) 1 month ago
Ashwanth 73961f18a3
chore(xcap): leaner xcap API (#20771) 1 month ago
benclive cd16b029db
chore: fix panic on read err in batchDecoratorReader (#20787) 1 month ago
Robert Fratto 2d63582b15
chore: finish adding Open semantics in engine, metastore (#20798) 1 month ago
Robert Fratto d85fb0317f
chore(dataobj): Add Open semantics to section readers (#20790) 1 month ago
Robert Fratto 4023aeda3b
chore(dataobj): encode final dataobj size in dataobj metadata (#20769) 1 month ago
George Robinson 93f4bdf796
feat: allow the initial offset to be set in the starting phase (#20770) 1 month ago
George Robinson b5c7ea2dc2
chore: use StartAndAwait functions (#20755) 1 month ago
Robert Fratto 7e03400309
chore(dataobj): rename dataset.ReaderOptions to dataset.RowReaderOptions (#20756) 1 month ago
George Robinson 8bf62a5124
chore: implement idiomatic worker pattern in indexer.go (#20646) 1 month ago
George Robinson 2949f75444
fix: handle lost partitions in index builders (#20744) 1 month ago
Trevor Whitney 83e275775a
chore: bring comparison metrics and goldfish metrics more in line (#20706) 2 months ago
Robert Fratto c12b305b05
chore(memory): permit slicing memory.Bitmap (#20699) 2 months ago
George Robinson c169ce3ae9
feat: add flush manager to control data object flush lifecycle (#20680) 2 months ago
George Robinson 4d1c4032cc
chore: small doc fix, missing period end of help (#20681) 2 months ago
George Robinson 72aaea20a6
chore: no lazy struct embed (#20682) 2 months ago
Robert Fratto 98b7cb6063
chore(dataobj): Refactor and extract row range logic (#20661) 2 months ago
benclive 7567393229
chore: Fix flaky indexer test (#20676) 2 months ago
George Robinson fcdd2adf2a
fix: service failure on stopping kafkav2 consumer (#20672) 2 months ago
benclive a029934ef2
chore: resolve predicate columns in distributed metastore (#20504) 2 months ago
George Robinson 7aee83d6d2
chore: use temporary builder to sort data objects (#20664) 2 months ago
benclive 328f3d45b9
fix(dataobj): Mark events completed after successful commit (#20658) 2 months ago
George Robinson 18f2c5049e
chore: move metrics into observeRecordErr (#20625) 2 months ago
Joe Elliott 08e5c9d77c
perf: Prealloc slice in index builder when downloading objects (#20647) 2 months ago
Robert Fratto 9d9d8ce14d chore(engine): introduce experimental expression engine (#20626) 2 months ago
benclive 322a02d35d
chore: Refactor to avoid sharing a download worker (#20640) 2 months ago
Sandeep Sukhani 7f1450d8c5
feat(dataobj-compactor): add a planner for compaction of data objects (#20527) 2 months ago
Robert Fratto 736ccdbf93
chore(dataobj): rename dataset.Reader to RowReader (#20629) 2 months ago
George Robinson 14d2285b76
fix: set consumption lag to zero after idle flush timeout (#20620) 2 months ago
benclive 294d574bc9
fix(dataobj): Avoid deadlock in index-builder when cancelling mid-build (#20621) 2 months ago
George Robinson 0d9df6b055
chore: clean up consumer metrics (#20619) 2 months ago
George Robinson cb938d0a9d
feat: separate metastore events and offsets from flushes (#20605) 2 months ago
Robert Fratto 747d75aa78
chore: make memory, columnar APIs more idiomatic (#20622) 2 months ago
George Robinson 45a7f55d39
fix: revert "feat: reset the consumption lag gauge after 1 minute of idle period" (#20617) 2 months ago
George Robinson f1d0cdf145
feat: reset the consumption lag gauge after 1 minute of idle period (#20616) 2 months ago
George Robinson 8b86d42507
chore: no need for defer func (#20615) 2 months ago