115 Commits (shantanu/dataobj-compactor)

Author	SHA1	Message	Date
shantanualshi	49cb6e9838	fixup! Create single tombstone file for a delete request	3 days ago
shantanualshi	688677203e	Create single tombstone file for a delete request	3 days ago
shantanualshi	d2345582b6	Fix dataobj-deletion config and docs	6 days ago
shantanualshi	08ed91168f	Fix dataobj-deletion config	6 days ago
shantanualshi	c9eb36b7d6	Integrate a sweeper to perform actual dataobj deletions	6 days ago
shantanualshi	b89cd08b57	Fetch sections from metastore and create tombstones	6 days ago
shantanualshi	913c7f9e29	Wire up metastore in dataobj deletion manager	6 days ago
shantanualshi	db1e6e873a	Create separate goroutine for dataobj deletion	6 days ago
shantanualshi	1f2fdff4a5	Create retrieval and storage methods for data tombstones	6 days ago
shantanualshi	b079cc112e	Create proto for dataobj tombstone	6 days ago
Ashwanth	a2791ba98a	feat(deletes): support time range filtering for listing deletes (#20427)	2 weeks ago
renovate-sh-app[bot]	0aac50bffb	fix(deps): update module github.com/prometheus/prometheus to v0.308.0 (main) (#20131) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: Paul Rogers <paul.rogers@grafana.com>	2 months ago
Sandeep Sukhani	856c11dad2	feat: Add support for storing chunk deletion markers in object storage instead of local disk (#19689)	3 months ago
Sandeep Sukhani	9e0f50c362	feat(compactor-hs): add a metric to track the number of jobs left to conclude ongoing unit of work (#19506)	4 months ago
Sandeep Sukhani	a17c033238	chore: compactor worker chunk client congestion control (#19493)	4 months ago
Cyril Tovena	6e6e8a97d9	feat(deletion): return request ID in response header (#19444)	4 months ago
Trevor Whitney	3a1e5ad5f1	feat!: move the Loki UI to a Grafana Plugin (#19390) ... there is still a ui target, which serves the APIs needed for the plugin, which must be manually assigned to a pod	4 months ago
Sandeep Sukhani	cbcfbca443	fix: panic while applying storage updates when a whole chunk is deleted by line filters (#19262)	4 months ago
Sophie Waldman	98b411a649	chore(linter): Fix issues flagged by updated golangci-lint version (#19206)	5 months ago
Sandeep Sukhani	3618279603	chore: optimize chunk rewrite while filtering out deleted data (#19140)	5 months ago
Sandeep Sukhani	0b2d0b070e	chore: make index updates idempotent from horizontally scalable compactor (#19093)	5 months ago
Sandeep Sukhani	e9b1d89f70	chore: do not rely on GOMAXPROCS to configure the number of sub-workers to run in compactor worker (#18848)	6 months ago
Sandeep Sukhani	05bc4fd681	fix: use the custom objectExists function to work around bug in Thanos object client (#18820)	6 months ago
Sandeep Sukhani	3d634066ee	chore: Use protobuf for encoding artifacts built by horizontally scalable compactor while processing delete requests (#18802)	6 months ago
dannyc-grafana	ecdd613a0c	chore: Autofix to make nosec comments also readable by semgrep (#18664)	6 months ago
Sandeep Sukhani	9281ab3959	docs(compactor HS): add documentation for horizontally scalable compactor (#18654)	6 months ago
Sandeep Sukhani	d5a959e37b	chore: use boltdb for tracking series processing progress in delete requests manager (#18629)	6 months ago
Saikat	cdb190be96	fix: ensure to return delete requests only for the requested tanent (#18589)	6 months ago
Sandeep Sukhani	5bf3f74ab2	feat(compactor HS): tune compactor worker config and add experimental feature warning to the docs (#18539)	6 months ago
Sandeep Sukhani	8054076873	fix: do not try to merge the already consolidated delete requests while listing them (#18544)	6 months ago
Sandeep Sukhani	000f90d74b	feat(compactor HS): Fixes and changes for getting horizontally scalable compactor to work well (#18526)	7 months ago
Ashwanth	df03f186b1	chore: fix failing lint on main (#18511)	7 months ago
Robert Fratto	86c57c8616	chore: consistently use new labels.Labels API (#18490)	7 months ago
Sandeep Sukhani	255fce20d8	fix: Fix handling of duplicate delete requests (#18460)	7 months ago
Sandeep Sukhani	bd293206cd	feat(compactor HS): Wire things up and add some metrics (#18421)	7 months ago
Christian Haudum	d446d47cf8	chore(engine): Prefetch inputs of SortMerge operator (#18395) ... This PR changes how inputs of the SortMerge operator are consumed. The inputs are wrapped with a `prefetchWrapper` which consumes the next batch (`arrow.Record`) in the background while the current batch is processed by the parent node. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	7 months ago
Sandeep Sukhani	1ea8d48fc4	chore: expose tables manager interface from compactor (#18344)	7 months ago
Sandeep Sukhani	364660748d	feat(compactor HS): refactor interfaces and build a link between delete requests manager and compactor for HS of compactor (#18326) ... Signed-off-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com> Co-authored-by: Paul Rogers <129207811+paul1r@users.noreply.github.com>	7 months ago
Sandeep Sukhani	ba3c67076a	feat(compactor HS): add support for applying storage updates after finishing processing of deletion manifest (#18294)	7 months ago
Sandeep Sukhani	8007e22db5	feat(compactor HS): store index updates per processed segment in the manifest to the object storage (#18212)	7 months ago
Paul Rogers	589652112f	chore: lint fix for queue.go (#18181)	8 months ago
Sandeep Sukhani	d05c4bc500	feat(compactor HS): add support for worker for processing of jobs from the compactor's job queue (#18165)	8 months ago
Ashwanth	ba9b93ba42	chore(engine): add optimisations to pushdown and project groupby labels (#18101)	8 months ago
Sandeep Sukhani	385e3175cf	feat(compactor HS): use streaming RPCs for interacting with job queue over grpc (#18125)	8 months ago
renovate[bot]	8b265ede15	fix(deps): update module github.com/prometheus/common to v0.64.0 (main) (#16750) ... Signed-off-by: Paul Rogers <129207811+paul1r@users.noreply.github.com> Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com> Co-authored-by: Paul Rogers <paul.rogers@grafana.com> Co-authored-by: Paul Rogers <129207811+paul1r@users.noreply.github.com>	8 months ago
Sandeep Sukhani	58f4fca65a	feat(compactor HS): add a job runner for processing of deletion jobs (#18058)	8 months ago
Charles Korn	545fb1597c	refactor(stringlabels): Support stringlabels in `logql/log` package (#17838) ... This is another step towards supporting Prometheus' stringlabels implementation in Loki. It adds support in the `logql/log` package. Part of https://github.com/grafana/loki/issues/17122 The tests should now compile and pass with `-tags stringlabels`. --- Co-authored-by: Karsten Jeschkies <karsten.jeschkies@grafana.com>	8 months ago
George Robinson	5394a4cae1	fix: fix lint failure in retention.go (#17894)	8 months ago
Sandeep Sukhani	267f4dc0ec	feat(compactor HS): add job queue and deletion job builder (#17843)	8 months ago
Sandeep Sukhani	e8a94efcad	fix: set delete request batch to empty when we load to fail requests (#17810) ... Signed-off-by: Sandeep Sukhani <sandeep.d.sukhani@gmail.com>	9 months ago