mirror of
https://github.com/hanzo-ml/trainer.git
synced 2026-09-24 00:31:34 +00:00
feat(docs): Kubeflow Trainer ROADMAP 2026 (#3242)
* feat(docs): Kubeflow Trainer ROADMAP 2026 Signed-off-by: Andrey Velichkevich <[email protected]> * Add Scalability feature Signed-off-by: Andrey Velichkevich <[email protected]> * Add issue for Multi-Node NVLink Signed-off-by: Andrey Velichkevich <[email protected]> * Update ROADMAP.md Co-authored-by: Vassilis Vassiliadis <[email protected]> Signed-off-by: Andrey Velichkevich <[email protected]> * Update ROADMAP.md Co-authored-by: Vassilis Vassiliadis <[email protected]> Signed-off-by: Andrey Velichkevich <[email protected]> * Add item for Runtime lifecycle management Signed-off-by: andreyvelich <[email protected]> * Add Observability items Signed-off-by: andreyvelich <[email protected]> --------- Signed-off-by: Andrey Velichkevich <[email protected]> Signed-off-by: andreyvelich <[email protected]> Co-authored-by: Vassilis Vassiliadis <[email protected]> Co-authored-by: Vassilis Vassiliadis <[email protected]>
This commit is contained in:
committed by
GitHub
co-authored by
Vassilis Vassiliadis
Vassilis Vassiliadis
parent
919c7fbdf1
commit
1a101e4f61
+39
@@ -1,5 +1,44 @@
|
|||||||
# Kubeflow Trainer ROADMAP
|
# Kubeflow Trainer ROADMAP
|
||||||
|
|
||||||
|
## 2026
|
||||||
|
|
||||||
|
- Scheduling & Scalability
|
||||||
|
- Workload-Aware Scheduling for TrainJobs: https://github.com/kubeflow/trainer/issues/3015
|
||||||
|
- KAI Scheduler Integrations: https://github.com/kubeflow/trainer/issues/2628
|
||||||
|
- Support Multi-Node NVLink (MNNVL) for TrainJob: https://github.com/kubeflow/trainer/issues/3264
|
||||||
|
- First-Class Integration with [Kueue](https://kueue.sigs.k8s.io/docs/tasks/run/trainjobs/) for
|
||||||
|
multi-cluster job dispatching, topology-aware scheduling, and other features.
|
||||||
|
- Enhanced Scalability for Massively Distributed TrainJobs: https://github.com/kubeflow/trainer/issues/2318
|
||||||
|
- MPI and HPC on Kubernetes
|
||||||
|
- Flux Integration for MPI and HPC workloads: https://github.com/kubeflow/trainer/issues/2841
|
||||||
|
- IntelMPI Support: https://github.com/kubeflow/trainer/issues/1807
|
||||||
|
- PMIx Investigation with Flux or Slurm plugins
|
||||||
|
- Enhance MPI Orchestration: https://github.com/kubeflow/trainer/issues/2751
|
||||||
|
- Observability & Reliability
|
||||||
|
- TrainJob Progress Tracking & Metrics Exposure: https://github.com/kubeflow/trainer/issues/2779
|
||||||
|
- Transparent Checkpoint/Restore for GPU-Accelerated TrainJobs: https://github.com/kubeflow/trainer/issues/2245
|
||||||
|
- TTLs and ActiveDeadlineSeconds for TrainJobs: https://github.com/kubeflow/trainer/issues/2899
|
||||||
|
- Elastic TrainJobs: https://github.com/kubeflow/trainer/issues/2903
|
||||||
|
- Add controller-level Prometheus metrics and ServiceMonitor: https://github.com/kubeflow/trainer/issues/3429
|
||||||
|
- Default Grafana dashboard for Kubeflow Trainer: https://github.com/kubeflow/trainer/issues/3430
|
||||||
|
- Distributed Data Cache
|
||||||
|
- Tensor caching to accelerate GPU workloads: https://github.com/kubeflow/trainer/issues/3173
|
||||||
|
- Integration with OptimizationJob
|
||||||
|
- Explore RDMA with AI Schedulers and Data Cache
|
||||||
|
- LLM Fine-Tuning Enhancements
|
||||||
|
- Automatic configuration of GPU requests for TrainJobs: https://github.com/kubeflow/trainer/issues/3328
|
||||||
|
- Build Dynamic BuiltinTrainers and LLM Fine-Tuning Blueprints: https://github.com/kubeflow/trainer/issues/2839
|
||||||
|
- New Kubeflow Trainer Runtimes
|
||||||
|
- Distributed JAX: https://github.com/kubeflow/trainer/issues/2442
|
||||||
|
- Distributed XGBoost: https://github.com/kubeflow/trainer/issues/2598
|
||||||
|
- Tensor Parallelism with Megatron-LM: https://github.com/kubeflow/trainer/issues/3178
|
||||||
|
- Slurm Runtime Integration: https://github.com/kubeflow/trainer/issues/2249
|
||||||
|
- Implement registration mechanism in the Pipeline Framework to extend plugins and supported ML
|
||||||
|
frameworks in the Kubeflow Trainer: https://github.com/kubeflow/trainer/issues/2750
|
||||||
|
- Kubeflow Trainer UI and TrainJob History Server: https://github.com/kubeflow/trainer/issues/2648
|
||||||
|
- Integration with Kubeflow MCP Server: https://github.com/kubeflow/sdk/issues/238
|
||||||
|
- Enhance lifecycle management and mutability of Runtimes: https://github.com/kubeflow/trainer/pull/3428
|
||||||
|
|
||||||
## 2025
|
## 2025
|
||||||
|
|
||||||
- Kubeflow Trainer v2 general availability: https://github.com/kubeflow/trainer/issues/2170
|
- Kubeflow Trainer v2 general availability: https://github.com/kubeflow/trainer/issues/2170
|
||||||
|
|||||||
Reference in New Issue
Block a user