feat(docs): Kubeflow Trainer ROADMAP 2026 (#3242)

* feat(docs): Kubeflow Trainer ROADMAP 2026

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add Scalability feature

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add issue for Multi-Node NVLink

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update ROADMAP.md

Co-authored-by: Vassilis Vassiliadis <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>

* Update ROADMAP.md

Co-authored-by: Vassilis Vassiliadis <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>

* Add item for Runtime lifecycle management

Signed-off-by: andreyvelich <[email protected]>

* Add Observability items

Signed-off-by: andreyvelich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
Signed-off-by: andreyvelich <[email protected]>
Co-authored-by: Vassilis Vassiliadis <[email protected]>
Co-authored-by: Vassilis Vassiliadis <[email protected]>
This commit is contained in:
Andrey Velichkevich
2026-04-17 18:37:49 +00:00
committed by GitHub
co-authored by Vassilis Vassiliadis Vassilis Vassiliadis
parent 919c7fbdf1
commit 1a101e4f61
+39
View File
@@ -1,5 +1,44 @@
# Kubeflow Trainer ROADMAP # Kubeflow Trainer ROADMAP
## 2026
- Scheduling & Scalability
- Workload-Aware Scheduling for TrainJobs: https://github.com/kubeflow/trainer/issues/3015
- KAI Scheduler Integrations: https://github.com/kubeflow/trainer/issues/2628
- Support Multi-Node NVLink (MNNVL) for TrainJob: https://github.com/kubeflow/trainer/issues/3264
- First-Class Integration with [Kueue](https://kueue.sigs.k8s.io/docs/tasks/run/trainjobs/) for
multi-cluster job dispatching, topology-aware scheduling, and other features.
- Enhanced Scalability for Massively Distributed TrainJobs: https://github.com/kubeflow/trainer/issues/2318
- MPI and HPC on Kubernetes
- Flux Integration for MPI and HPC workloads: https://github.com/kubeflow/trainer/issues/2841
- IntelMPI Support: https://github.com/kubeflow/trainer/issues/1807
- PMIx Investigation with Flux or Slurm plugins
- Enhance MPI Orchestration: https://github.com/kubeflow/trainer/issues/2751
- Observability & Reliability
- TrainJob Progress Tracking & Metrics Exposure: https://github.com/kubeflow/trainer/issues/2779
- Transparent Checkpoint/Restore for GPU-Accelerated TrainJobs: https://github.com/kubeflow/trainer/issues/2245
- TTLs and ActiveDeadlineSeconds for TrainJobs: https://github.com/kubeflow/trainer/issues/2899
- Elastic TrainJobs: https://github.com/kubeflow/trainer/issues/2903
- Add controller-level Prometheus metrics and ServiceMonitor: https://github.com/kubeflow/trainer/issues/3429
- Default Grafana dashboard for Kubeflow Trainer: https://github.com/kubeflow/trainer/issues/3430
- Distributed Data Cache
- Tensor caching to accelerate GPU workloads: https://github.com/kubeflow/trainer/issues/3173
- Integration with OptimizationJob
- Explore RDMA with AI Schedulers and Data Cache
- LLM Fine-Tuning Enhancements
- Automatic configuration of GPU requests for TrainJobs: https://github.com/kubeflow/trainer/issues/3328
- Build Dynamic BuiltinTrainers and LLM Fine-Tuning Blueprints: https://github.com/kubeflow/trainer/issues/2839
- New Kubeflow Trainer Runtimes
- Distributed JAX: https://github.com/kubeflow/trainer/issues/2442
- Distributed XGBoost: https://github.com/kubeflow/trainer/issues/2598
- Tensor Parallelism with Megatron-LM: https://github.com/kubeflow/trainer/issues/3178
- Slurm Runtime Integration: https://github.com/kubeflow/trainer/issues/2249
- Implement registration mechanism in the Pipeline Framework to extend plugins and supported ML
frameworks in the Kubeflow Trainer: https://github.com/kubeflow/trainer/issues/2750
- Kubeflow Trainer UI and TrainJob History Server: https://github.com/kubeflow/trainer/issues/2648
- Integration with Kubeflow MCP Server: https://github.com/kubeflow/sdk/issues/238
- Enhance lifecycle management and mutability of Runtimes: https://github.com/kubeflow/trainer/pull/3428
## 2025 ## 2025
- Kubeflow Trainer v2 general availability: https://github.com/kubeflow/trainer/issues/2170 - Kubeflow Trainer v2 general availability: https://github.com/kubeflow/trainer/issues/2170