Commit Graph

199 Commits (aa66baec978cd5c24702c19494784cf33bf8b513)

Author SHA1 Message Date
Robert Fratto ba4bd5dc95
chore: introduce efficient byte range reader in new engine (#19024) 5 months ago
George Robinson 3bab0ff5fe
fix: backoff cannot be canceled via ctx (#19041) 5 months ago
benclive 28fe97dcce
chore: fix metastore indexes being written with double prefixes (#19018) 5 months ago
George Robinson 1475762994
feat: print the tenant in the dump and stats sub-commands (#19033) 5 months ago
benclive 0b9b4c1ee5
chore: Support multi-tenancy in indexobj builder (#18880) 5 months ago
George Robinson d8b22bfef8
fix: deadlock when shutting down dataobj-consumers (#18932) 5 months ago
benclive d93a44141f
chore: Make metastore event synchronous (#18928) 5 months ago
George Robinson 20d93e3a8d
chore: rename lastFlush to lastFlushed and move some tests (#18918) 5 months ago
George Robinson 3ed2c4e127
chore: add safety check for estimated size (#18919) 5 months ago
George Robinson 058eaa7e0b
chore: improve flush unit tests with better separation (#18917) 5 months ago
George Robinson 31d5f1a738
fix: reset the last modified timestamp on flush (#18916) 5 months ago
Robert Fratto 71dc2d9bce
chore(dataobj): store section regions contiguously within the data object (#18901) 5 months ago
George Robinson 278374609d
chore: create a factory to create partition processors (#18897) 5 months ago
Robert Fratto 515ebea4f2
chore(dataobj): track total download time of page metadata/data (#18896) 5 months ago
George Robinson 4608048388
chore: remove unused sync.Pool (#18895) 5 months ago
George Robinson 05f6ad1eb0
feat: add tenant to section builders (#18864) 5 months ago
Robert Fratto 595715146f
chore(dataobj)!: introduce new centralized dataset encoding format (#18871) 5 months ago
benclive 19d90ef023
chore: Add sorting & tenant info to remaining section types (#18861) 5 months ago
Robert Fratto 642d826a00
chore(dataobj): make section tenancy a global construct (#18857) 5 months ago
George Robinson be7ff4b294
chore: add flushAndCommit to make it harder to forget to commit offsets in future (#18851) 5 months ago
Ashwanth 5203a0c9ad
chore(dataobj): add reader stats (#18694) 5 months ago
George Robinson 414538ae24
fix: mistake in error, should have said logs section (#18844) 5 months ago
George Robinson 36b2615156
feat: decode tenant when reading streams and logs sections (#18846) 5 months ago
George Robinson 0941b90614
fix: dataobj-consumers did not commit offsets on idle flush (#18834) 5 months ago
George Robinson 916246a2be
feat: add tenant to section metadata (#18843) 5 months ago
Ashwanth 88c8b44f2d
chore(dataobj): read non-projected predicate columns (#18797) 5 months ago
George Robinson 8895090643
fix: dataobj-consumers commit incorrect offset, which can cause data loss (#18833) 6 months ago
Robert Fratto 100e259a8d
chore(dataobj): introduce the concept of section info "extensions" (#18832) 6 months ago
benclive e57877e208
chore: Refactor metastore Updater (breaking change) (#18821) 6 months ago
Robert Fratto 61c40fca0c
chore(dataobj): remove support for deprecated fields (breaking change) (#18822) 6 months ago
Robert Fratto 2ca8e58b0e
chore(dataobj): add ability to buffer pending sections to disk (#18780) 6 months ago
George Robinson 53416a65ef
chore: use quartz.Clock to improve tests (#18810) 6 months ago
Robert Fratto 40057f5ce2
chore(dataobj): permit reading subset of section metadata (#18815) 6 months ago
George Robinson 69a70dda88
chore: use zero value for time in partition_processor.go (#18798) 6 months ago
George Robinson c47841024e
chore: move mocks into mock.go (#18799) 6 months ago
Periklis Tsirakidis 0ec355c349
chore(dataobj): Use storage prefix for metastore index lookups (#18555) 6 months ago
Robert Fratto 1c06a8fc11
chore(dataobj): fix compilation error following #18622 (#18738) 6 months ago
Robert Fratto d4b027ae0c
chore(dataobj): return Object on Builder.Flush (#18622) 6 months ago
Robert Fratto a5c722cbed
chore(dataobj): list pages across all columns in one request (#18678) 6 months ago
Ashwanth 3faec029bf
chore(metastore): include traceID in metastore logs (#18660) 6 months ago
benclive 613116e371
chore: Fix empty matchers returning all entries in Metastore Section lookup (#18642) 6 months ago
Robert Fratto 517b59f087
chore: update github.com/thanos-io/objstore fork (#18620) 6 months ago
Robert Fratto 9129d8cdd0
chore(engine): use columnar logs.Reader for DataObjScan (#18577) 6 months ago
Robert Fratto 061d1c1d22
chore(dataobj): make copy of pages from downloaded window (#18566) 6 months ago
Ashwanth da4e59f8c6
chore(dataobj): store sort order information in section metadata (#18499) 6 months ago
benclive 41d93f8a86
fix: Fix empty streamIDs in multi-section index objects (#18556) 6 months ago
Christian Haudum ce03b7943a
chore(dataobj): Improve default builder target sizes and settings help (#18543) 6 months ago
benclive f075da4f94
chore: Use correct TimeRange predicate for indexpointers (#18529) 6 months ago
Robert Fratto 009dd388f2
chore(dataobj/consumer): track latest delay to Kafka (#18528) 6 months ago
benclive 798f77892e
chore: Fix slicelabels merge conflict in calculator.go (#18517) 6 months ago