180 Commits (be7ff4b294b44ade4666a67ece559d9d9b0abeaf)

Author	SHA1	Message	Date
George Robinson	be7ff4b294	chore: add flushAndCommit to make it harder to forget to commit offsets in future (#18851)	5 months ago
Ashwanth	5203a0c9ad	chore(dataobj): add reader stats (#18694)	5 months ago
George Robinson	414538ae24	fix: mistake in error, should have said logs section (#18844)	5 months ago
George Robinson	36b2615156	feat: decode tenant when reading streams and logs sections (#18846)	5 months ago
George Robinson	0941b90614	fix: dataobj-consumers did not commit offsets on idle flush (#18834)	5 months ago
George Robinson	916246a2be	feat: add tenant to section metadata (#18843)	5 months ago
Ashwanth	88c8b44f2d	chore(dataobj): read non-projected predicate columns (#18797)	5 months ago
George Robinson	8895090643	fix: dataobj-consumers commit incorrect offset, which can cause data loss (#18833)	5 months ago
Robert Fratto	100e259a8d	chore(dataobj): introduce the concept of section info "extensions" (#18832)	5 months ago
benclive	e57877e208	chore: Refactor metastore Updater (breaking change) (#18821)	5 months ago
Robert Fratto	61c40fca0c	chore(dataobj): remove support for deprecated fields (breaking change) (#18822)	5 months ago
Robert Fratto	2ca8e58b0e	chore(dataobj): add ability to buffer pending sections to disk (#18780) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	5 months ago
George Robinson	53416a65ef	chore: use quartz.Clock to improve tests (#18810)	5 months ago
Robert Fratto	40057f5ce2	chore(dataobj): permit reading subset of section metadata (#18815) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	5 months ago
George Robinson	69a70dda88	chore: use zero value for time in partition_processor.go (#18798)	5 months ago
George Robinson	c47841024e	chore: move mocks into mock.go (#18799)	5 months ago
Periklis Tsirakidis	0ec355c349	chore(dataobj): Use storage prefix for metastore index lookups (#18555)	5 months ago
Robert Fratto	1c06a8fc11	chore(dataobj): fix compilation error following #18622 (#18738)	5 months ago
Robert Fratto	d4b027ae0c	chore(dataobj): return Object on Builder.Flush (#18622)	5 months ago
Robert Fratto	a5c722cbed	chore(dataobj): list pages across all columns in one request (#18678)	5 months ago
Ashwanth	3faec029bf	chore(metastore): include traceID in metastore logs (#18660)	5 months ago
benclive	613116e371	chore: Fix empty matchers returning all entries in Metastore Section lookup (#18642)	5 months ago
Robert Fratto	517b59f087	chore: update github.com/thanos-io/objstore fork (#18620)	5 months ago
Robert Fratto	9129d8cdd0	chore(engine): use columnar logs.Reader for DataObjScan (#18577)	5 months ago
Robert Fratto	061d1c1d22	chore(dataobj): make copy of pages from downloaded window (#18566)	5 months ago
Ashwanth	da4e59f8c6	chore(dataobj): store sort order information in section metadata (#18499)	5 months ago
benclive	41d93f8a86	fix: Fix empty streamIDs in multi-section index objects (#18556)	5 months ago
Christian Haudum	ce03b7943a	chore(dataobj): Improve default builder target sizes and settings help (#18543) ... Explain which settings are based on compressed and which are based on uncompressed size and why. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	5 months ago
benclive	f075da4f94	chore: Use correct TimeRange predicate for indexpointers (#18529)	5 months ago
Robert Fratto	009dd388f2	chore(dataobj/consumer): track latest delay to Kafka (#18528)	5 months ago
benclive	798f77892e	chore: Fix slicelabels merge conflict in calculator.go (#18517)	6 months ago
benclive	077e4196ef	chore: Add indexes to LogQL benchmarks (#18500)	6 months ago
Robert Fratto	86c57c8616	chore: consistently use new labels.Labels API (#18490)	6 months ago
benclive	517c317c97	chore: Integrate indexes with the new query engine (#18427)	6 months ago
benclive	d0a3cd86a7	chore: Remove lookback from stats in unsupported sections (#18489)	6 months ago
Periklis Tsirakidis	17d6853535	chore: Add support for indexpointers section (#18485)	6 months ago
Periklis Tsirakidis	bcf24e4cfb	chore(dataobj): Use indexpointer sections in metastore reads and writes (#18448)	6 months ago
Periklis Tsirakidis	6eedcaaded	chore(dataobj): Add new index pointers section type (#18441)	6 months ago
benclive	1f0edcd4ac	feat: Initial index-builder implementation (#18297)	6 months ago
Christian Haudum	d9f7d785ff	chore(engine): Sort entries in dataobj sections by timestamp descending (#18367) ... Sorting sections by `timestamp DESC` first and `streamID ASC` second allows for more efficient reading (by section) for BACKWARD log queries. - This change breaks FORWARD log queries. Which is ok for the time being. We will add support later again when columnar reading of the dataobj is introduced. - This change renders existing dataobj in storage incompatible. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	6 months ago
benclive	5429647b81	chore: Add pointers to dataobj-inspect UI (#18372)	6 months ago
benclive	f66781d426	fix: Row reader with no stream ID predicates (#18368)	6 months ago
Robert Fratto	26cb50e65a	chore(dataobj): Improve performance of dataset.Value API (#18339) ... Co-authored-by: Ashwanth <iamashwanth@gmail.com>	6 months ago
benclive	a238816751	perf: Use map for InPredicate when reading dataobj (#18325)	6 months ago
Robert Fratto	807f06baf3	chore(dataobj/uploader): expose logs for uploaded objects (#18338)	6 months ago
Robert Fratto	9c3d86be52	chore(dataobj): cut logs section based on uncompressed size (#18329)	6 months ago
Ashwanth	5c02493fe2	chore(dataobj): avoid reading a predicate column more than once (#18324)	6 months ago
Christian Haudum	2cbbbd1f46	chore: Fixup metric names for dataobj-consumer and histogram bucket (#18295) ... Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	6 months ago
Christian Haudum	b1fc685397	chore: Extend instrumentation of dataobject uploader (#18292) ... These changes provide better visibility into the dataobj uploader. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	6 months ago
Robert Fratto	30ccf5172c	chore(util/arrowtest): export arrowtest package (#18255)	6 months ago