18 Commits (e08721487c3fc8d537d448052ea2e41fa07ddefb)

Author	SHA1	Message	Date
benclive	f22e854dea	chore: Dispatch tasks more frequently (#20195)	4 weeks ago
Robert Fratto	2d54ddc6d9	chore(engine): adjustments to log task short circuiting (#20121)	1 month ago
Stas Spiridonov	5b88bcef3a	chore: Short circuiting for new scheduler (#20000)	1 month ago
Ashwanth	25c8827f56	chore(xcap): export captures as traces (#19880)	2 months ago
Ashwanth	11b1dcb2a3	chore(engine): introduce execution capture (#19821)	2 months ago
Robert Fratto	03f917a357	refactor(engine): update workflow to register all tasks/streams at once (#19859) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	2 months ago
Robert Fratto	0f0846adec	chore(engine): make stream/task debug logging configurable (#19842) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	2 months ago
renovate-sh-app[bot]	d76b3bf495	fix(deps): update module github.com/apache/arrow-go/v18 to v18.4.1 (main) (#19750) ... Signed-off-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: renovate-sh-app[bot] <219655108+renovate-sh-app[bot]@users.noreply.github.com> Co-authored-by: Paul Rogers <paul.rogers@grafana.com>	2 months ago
Stas Spiridonov	f2c874e6ab	chore: scheduler tasks are aware of their time range (#19709)	2 months ago
Christian Haudum	4b118fb729	chore: Admission lanes for workflow tasks (#19584) ... This PR introduces "admission lanes" for dispatching tasks to the runner (scheduler), that are controlled by token buckets, to avoid overflowing the runner with a large amount of tasks. Signed-off-by: Christian Haudum <christian.haudum@gmail.com>	2 months ago
Robert Fratto	016ee7d39e	chore(engine): serializable physical plans (#19672) ... This adds two new packages, `expressionpb` and `physicalpb`, which are serializable representations of `physical.Expression` and `physical.Plan`, respectively. These packages include utility functions to convert between the protobuf representations and the planner types. A translation layer is used due to the complexity of integrating protobuf throughout the engine, as well as difficulties with finding a clean pattern to construct node types. Once we're able to identify a clean and consistent pattern for interacting with the protobuf types throughout the codebase, the translation layer can be removed in favour of using the protobuf types directly. Co-authored-by: Sophie Waldman <sophie.waldman@grafana.com>	2 months ago
Robert Fratto	75e5193a97	chore(engine): expose new scheduler and worker (#19633) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	2 months ago
Trevor Whitney	8b39d4d077	refactor: implment parse as a projection (#19579) ... Signed-off-by: Trevor Whitney <trevorjwhitney@gmail.com> Co-authored-by: Christian Haudum <christian.haudum@gmail.com>	2 months ago
Robert Fratto	3c99535b0a	chore(engine): provide worker (#19588) ... The new worker package connects to an instance of a scheduler (#19570) for task assignment and execution. A worker spawns a fixed number of threads, each of which execute one task at a time. Signed-off-by: Robert Fratto <robertfratto@gmail.com>	2 months ago
Ashwanth	d34cfbd84a	chore: refactor and fixes for optimiser (#19581)	2 months ago
Robert Fratto	53487c7724	chore(engine): provide scheduler (#19570) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	2 months ago
Robert Fratto	053429db21	chore(engine): add information for task updates (#19561) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	3 months ago
Robert Fratto	6b96e4dea3	chore(engine): add workflow package (#19511) ... Signed-off-by: Robert Fratto <robertfratto@gmail.com>	3 months ago