Files
Yi ChenandGitHub 05e0a8b7e9 Add Spark Operator Roadmap (#2622)
* Add ROADMAP.md

Signed-off-by: Yi Chen <[email protected]>

* Add notebooks integration to raodmap

Signed-off-by: Yi Chen <[email protected]>

* Add Kubeflow SDK integration to roadmap

Signed-off-by: Yi Chen <[email protected]>

---------

Signed-off-by: Yi Chen <[email protected]>
2025-10-13 22:07:06 +00:00

1.0 KiB

Spark Operator ROADMAP

2025

  • A new CR to support Spark Connect (#2569)
  • Cert manger support (#1178)
  • Improve controller performance
  • Notebooks integration
  • Kubeflow SDK integration
  • Rest API for submitting jobs
  • Deprecation of webhook by moving all functionality into the pod template (#2502)
  • Watching namespaces based on labels
  • A web UI for visibility into currently running applications
  • Doc improvement

2024

  • Pod template support (#2101)
  • Spark Connect Support (#1801)
  • Support Yunikorn as a batch scheduler (#2107)
  • Improve test coverage to improve the confidence in releases, particularly with e2e tests