Commit Graph
18 Commits
Author SHA1 Message Date
Antonin StefanuttiandGitHub 3801b090d6 Upgrade Kubernetes to v1.30.7 (#2332)
* Upgrade Kubernetes to v1.30.7

Signed-off-by: Antonin Stefanutti <[email protected]>

* Use typed event handlers and predicates in job controllers

Signed-off-by: Antonin Stefanutti <[email protected]>

* Re-organize pkg/common/util/reconciler.go

Signed-off-by: Antonin Stefanutti <[email protected]>

* Update installation instructions in README

Signed-off-by: Antonin Stefanutti <[email protected]>

---------

Signed-off-by: Antonin Stefanutti <[email protected]>
2024-11-27 15:05:54 +00:00
Michał SzadkowskiandGitHub 26c9112c07 [Feature] Support managed by external controller (#2203)
* Introduce ManagedBy field to RunPolicy that is used by each Kubeflow Job Spec

Signed-off-by: Michal Szadkowski <[email protected]>

* Update Kubeflow JOb manifests

Signed-off-by: Michal Szadkowski <[email protected]>

* Update Kubeflow Jobs Reconcile to use ManagedBy field to decide if skip the process

Signed-off-by: Michal Szadkowski <[email protected]>

* job controller test

Signed-off-by: Michal Szadkowski <[email protected]>

* spec validation webhook

Signed-off-by: Michal Szadkowski <[email protected]>

* add manageBy maxLenght const

Signed-off-by: Michal Szadkowski <[email protected]>

* generate new manifest

Signed-off-by: Michal Szadkowski <[email protected]>

* revert webhook formatting

Signed-off-by: Michal Szadkowski <[email protected]>

* Move allowed controllers constants in one place

Signed-off-by: Michal Szadkowski <[email protected]>

* Make validatation for allowed managedBy values

Signed-off-by: Michal Szadkowski <[email protected]>

* Update after controllers constants move

Signed-off-by: Michal Szadkowski <[email protected]>

* Update jobs controller tests

Signed-off-by: Michal Szadkowski <[email protected]>

* Update validateManagedBy webhook

Signed-off-by: Michal Szadkowski <[email protected]>

* Remove validation for the length of ManagedBy field

Signed-off-by: Michal Szadkowski <[email protected]>

* Update after code review

Signed-off-by: Michal Szadkowski <[email protected]>

* Update ManagedBy comment

Signed-off-by: Michal Szadkowski <[email protected]>

* E2E tests for managedBy

Signed-off-by: Michal Szadkowski <[email protected]>

* Update generated files and manifests

Signed-off-by: Michal Szadkowski <[email protected]>

* Rework after code review

Signed-off-by: Michal Szadkowski <[email protected]>

* Revert kustomization change

Signed-off-by: Michal Szadkowski <[email protected]>

* Update job_test and logging

Signed-off-by: Michal Szadkowski <[email protected]>

* Provide immutability check for ManagedBy

Signed-off-by: Michal Szadkowski <[email protected]>

* Avoid making copy of runPolicy

Signed-off-by: Michal Szadkowski <[email protected]>

* Split RunPolicy validators to Update and Create

Signed-off-by: Michal Szadkowski <[email protected]>

* Fix the naming and call validate always

Signed-off-by: Michal Szadkowski <[email protected]>

* Update tests

Signed-off-by: Michal Szadkowski <[email protected]>

---------

Signed-off-by: Michal Szadkowski <[email protected]>
2024-09-18 18:09:27 +00:00
Sandipan PandaandGitHub 08fb25f8a0 Add JAX API (#2163)
Support JAXJob

Signed-off-by: Sandipan Panda <[email protected]>
2024-08-02 03:58:07 +00:00
Tariq HasanandGitHub a2812b5fb4 Remove support for MXJob (#2150)
Signed-off-by: tariq-hasan <[email protected]>
2024-07-28 10:37:56 +00:00
Juan Diego ColmenaresandGitHub 6a303235cd Fix: upgrade version of crd-ref-docs, which caused panic with go v1.22 (#2043)
* Fix: upgrade version of crd-ref-docs, which caused panic with go v1.22

Signed-off-by: Juan Diego Colmenares Fernandez <[email protected]>

* added generated api doc

Signed-off-by: Juan Diego Colmenares Fernandez <[email protected]>

---------

Signed-off-by: Juan Diego Colmenares Fernandez <[email protected]>
2024-04-06 18:36:26 +00:00
Yuki IwaiandGitHub de6d52bf3a Implement suspend semantics (#1859)
Signed-off-by: Yuki Iwai <[email protected]>
2023-07-20 20:25:24 +00:00
Chitsing KUIandGitHub a81242a4cb Set correct ENV for PytorchJob to support torchrun (#1840)
* fix pytorch WORLD_SIZE env inconsistent

* add correct env node_rank, nnodes for torch

* restore elastic nnproc

* use string for nproc_per_node

* add defaults in api

* add validation for two nproc_per_node, use auto for defaulter

* add ut for defaults and validation

* fix ut

* add doc for nproc_per_node
2023-07-12 17:11:07 +00:00
Yuki IwaiandGitHub 3bcb246e6e Replace dummy client with fake client (#1818)
Signed-off-by: Yuki Iwai <[email protected]>
2023-05-31 14:10:05 +00:00
c320716a1a Merge kubeflow/common to training-operator (#1813)
* Support for k8s v1.25 in CI

* Support for k8s v1.25 in CI

* Change k8s api to v1.25

* Upgrade golangci-lint version

* Add changelog

* Update CHANGELOG.md

* Update Changelog

* Merge common repo

* Avoid to depend on local env when installing the code-generators (#1810)

Signed-off-by: Yuki Iwai <[email protected]>

* Make scheduler-plugins the default gang scheduler. (#1747)

Signed-off-by: Syulin7 <[email protected]>

* Fix tests

* Fix merge conflicts

* Fix CI issues

* Fix CI issues

* Fix review comments

* Add contributors in Readme file

* Fix review comments

* Fix review comments

---------

Signed-off-by: Yuki Iwai <[email protected]>
Signed-off-by: Syulin7 <[email protected]>
Co-authored-by: Yuki Iwai <[email protected]>
Co-authored-by: yu lin <[email protected]>
2023-05-31 11:04:04 +00:00
Johnu GeorgeandGitHub 8c07ee0f54 HPA support for PyTorch Elastic (#1701)
* Support for k8s v1.25 in CI

* Support for k8s v1.25 in CI

* Change k8s api to v1.25

* Upgrade golangci-lint version

* Fixes for HPA in pytorchjob

* Common changes
2022-12-21 15:49:13 +00:00
Joeshi KuiandGitHub 483380337a [PaddlePaddle] support paddlejob (#1675)
* support paddlejob

* fix ci

* fix tools diff for ci

* fix ci test

* rm todo

* add e2e test

* fix e2e test

* fix e2e ci

* add paddlejob to kustomize

* set registry to docker.io

* rebase

* add rbac for paddlejob

* add unitest cover container port

* fix rebase

* update Copyright
2022-11-07 20:18:37 +00:00
Yuki IwaiandGitHub 0166d87791 Add clientset for MPIJob, PytorchJob, MXJob, and XGBoostJob (#1610) 2022-06-14 04:20:31 +00:00
Johnu GeorgeandGitHub c38406eb13 Add all generation tools to Makefile (#1609)
* Adding latest image tag

* Update manifests with latest image tag

* Adding generation tools to make generate

* Fix tests
2022-06-10 11:26:19 +00:00
Ce GaoandGitHub 8082044198 feat(pytorch): Support elastic training (#1453)
* chore: Update codegen and vendor

Signed-off-by: Ce Gao <[email protected]>

* fix: Update git config

Signed-off-by: Ce Gao <[email protected]>

* fix: Codegen

Signed-off-by: Ce Gao <[email protected]>

* feat: Add elastic examples

Signed-off-by: Ce Gao <[email protected]>

* chore: Update go mod

Signed-off-by: Ce Gao <[email protected]>

* chore: Update manifest

Signed-off-by: Ce Gao <[email protected]>

* feat: Implement elstic policy

Signed-off-by: Ce Gao <[email protected]>

* chore: Update vendor

Signed-off-by: Ce Gao <[email protected]>

* chore: Update swagger

Signed-off-by: Ce Gao <[email protected]>

* fix: Address comments

Signed-off-by: Ce Gao <[email protected]>
2021-11-26 06:35:12 +00:00
Wang ZhangandGitHub 96d67554b3 add mpi doc (#1477) 2021-11-22 04:46:36 +00:00
Andrey VelichkevichandGitHub a6aec1b7b9 Update links and files with the new URL (#1434)
* Update links and corresponding files for training-operator repository
Use Go 1.17

* Generate SDK

* Remove Travis

* Modify developer guide

* Fix go mod

* Fix legacy docs

* Generate SDK

* Remove travis

* Update ignore files
2021-10-09 13:50:44 -07:00
DeliangFanandGitHub 12ba9f3f79 add api-doc for all frameworks (#1370)
related-issue: #1341
2021-08-17 00:53:42 -07:00
Ce GaoandGitHub 49b3d7db8c feat: Add API Documentation WIP (#1249)
Signed-off-by: cegao <[email protected]>
2021-02-24 11:54:40 -08:00