Commit Graph
10 Commits
Author SHA1 Message Date
Andrey VelichkevichandGitHub fbacd9f577 fix(examples): Verify TrainJob Completion (#3331)
* fix(examples): Verify TrainJob Completion

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename client to TrainerClient()

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2026-03-16 14:40:31 +00:00
576e0896b7 feat(runtimes): add support for launcher resource allocation in MPI jobs (#2653)
* feat(runtime): add support for launcher resource allocation in MPI jobs

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add unit tests

Signed-off-by: Andrey Velichkevich <[email protected]>

* Set numProcPerNode for MPI plugin

Signed-off-by: Andrey Velichkevich <[email protected]>

* Move util func to runtime package

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix torchtune plugin

Signed-off-by: Andrey Velichkevich <[email protected]>

* Inline if for GPU check

Signed-off-by: Andrey Velichkevich <[email protected]>

* Assign container resources once

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add todo for test wrappers

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
2025-10-20 13:26:03 +00:00
Anya KramarandGitHub ea8b4b596a chore: Install released version of Kubeflow SDK (#2857)
Signed-off-by: kramaranya <[email protected]>
2025-09-29 09:23:31 +00:00
Brian GallagherandGitHub 90c2a34176 fix: update examples to reflect func_args now being unpacked (#2815)
* update examples to reflect func_args now being unpacked

Signed-off-by: Brian Gallagher <[email protected]>

* fix: lower case func arguments and add types

Signed-off-by: Brian Gallagher <[email protected]>

---------

Signed-off-by: Brian Gallagher <[email protected]>
2025-09-07 19:57:35 +00:00
Andrey VelichkevichandGitHub ba56396acb fix(examples): Update get_job_logs() API in examples (#2813)
* fix(examples): Update get_job_logs() API in examples

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix deepspeed

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-09-03 14:40:03 +00:00
Andrey VelichkevichandGitHub 19624ae63e feat(runtimes): Support Distributed MLX on CUDA (#2790)
* feat(runtimes): Support Distributed MLX on CUDA

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove arm build from MLX runtime

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update get_runtime_packages API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Force to change vars in examples

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove LD_LIBRARY_PATH updates

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add patch command to DeepSpeed example

Signed-off-by: Andrey Velichkevich <[email protected]>

* Cleanup apt packages

Signed-off-by: Andrey Velichkevich <[email protected]>

* Reduce MLX and DeepSpeed image size

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-08-21 12:17:06 +00:00
Anya KramarandGitHub c83e6db3c6 fix: update kubeflow sdk reference (#2780)
Signed-off-by: kramaranya <[email protected]>
2025-08-07 15:13:56 +00:00
Andrey VelichkevichandGitHub dba2af939a fix(examples): Update the argument for Runtime framework (#2766)
* fix(examples): Update the runtime framework parameter

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update TorchTune example

Signed-off-by: Andrey Velichkevich <[email protected]>

* Use wait_for_job_status API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix Notebook

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix client

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix job name

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-08-04 14:29:53 +00:00
Eoin FennessyandGitHub 7ffef77be3 Remove SDK (#2657)
* Remove SDK

Signed-off-by: Eoin Fennessy <[email protected]>

* Fix e2e test

Signed-off-by: Eoin Fennessy <[email protected]>

* Remove unnecessary `pip install ./sdk` for unit tests

Signed-off-by: Eoin Fennessy <[email protected]>

* Remove sdk from pre-commit config

Signed-off-by: Eoin Fennessy <[email protected]>

* Update docstring for `generate` target

Signed-off-by: Eoin Fennessy <[email protected]>

* Update CONTRIBUTING.md

Signed-off-by: Eoin Fennessy <[email protected]>

* Remove .gitignore for OpenAPI Generator CLI JAR

Signed-off-by: Eoin Fennessy <[email protected]>

* README.md: Add link to `kubeflow/sdk` + some minor edits

Signed-off-by: Eoin Fennessy <[email protected]>

* Add TODO to repurpose SDK release info if needed

Signed-off-by: Eoin Fennessy <[email protected]>

* Add SDK installation step to all notebooks

Signed-off-by: Eoin Fennessy <[email protected]>

* Comment out SDK installation command in all notebooks

Signed-off-by: Eoin Fennessy <[email protected]>

---------

Signed-off-by: Eoin Fennessy <[email protected]>
2025-06-09 13:41:48 +00:00
Andrey VelichkevichandGitHub 6d690f9d9a feat(runtimes): Support MLX Distributed Runtime with OpenMPI (#2565)
* feat(runtimes): Support MLX Distributed Runtime with OpenMPI

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove sshd config

Signed-off-by: Andrey Velichkevich <[email protected]>

* Modify make install for OpenMPI

Signed-off-by: Andrey Velichkevich <[email protected]>

* Use Debian for MLX Runtime

Signed-off-by: Andrey Velichkevich <[email protected]>

* Install Python package for mpiuser

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove generator

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix mpiuser permission

Signed-off-by: Andrey Velichkevich <[email protected]>

* Create .cache

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update MLX example

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-03-27 04:54:22 +00:00