|
9802f954ab
|
feat: KEP-2437 - PodGroup Creation for Volcano Scheduler (#2729)
* feat: api for volcano scheduling plugin
Signed-off-by: Xinmin Du <[email protected]>
* feat: init volcano-plugin
Signed-off-by: Xinmin Du <[email protected]>
* feat: init test file
Signed-off-by: Xinmin Du <[email protected]>
* feat: register volcano plugin
Signed-off-by: Xinmin Du <[email protected]>
* feat: deal with minTaskMember, minMember, NetworkTopo
Signed-off-by: Xinmin Du <[email protected]>
* fix: calculate of minResource
Signed-off-by: Xinmin Du <[email protected]>
* test: build PodGroup test
Signed-off-by: Xinmin Du <[email protected]>
* refactor: separate to 2 prs（build&handler）
Signed-off-by: Xinmin Du <[email protected]>
* test: add test for new&reconcile_builder
Signed-off-by: Xinmin Du <[email protected]>
* fix: typo
Signed-off-by: Xinmin Du <[email protected]>
* fix: trainer/v2 import
Signed-off-by: Xinmin Du <[email protected]>
* fix: networktopo type
Signed-off-by: Xinmin Du <[email protected]>
* fix: OpenAPI validation errors
Signed-off-by: Xinmin Du <[email protected]>
* fix: remove minTaskMembers
Signed-off-by: Xinmin Du <[email protected]>
* test: test coverage 100%
Signed-off-by: Xinmin Du <[email protected]>
* feat: update apis
Signed-off-by: Xinmin Du <[email protected]>
* feat: replace testify
Signed-off-by: Xinmin Du <[email protected]>
* fix: registry Volcano CRDs to the scheme
Signed-off-by: Xinmin Du <[email protected]>
* fix: add volcano to scheme
Signed-off-by: Xinmin Du <[email protected]>
* fix: fix networktopo schema
Signed-off-by: Xinmin Du <[email protected]>
* fix: add networktopo spec in trainer
Signed-off-by: Xinmin Du <[email protected]>
* fix: unit test
Signed-off-by: Xinmin Du <[email protected]>
* feat: import networkTopo directly
Signed-off-by: Xinmin Du <[email protected]>
* fix: make generate
Signed-off-by: Xinmin Du <[email protected]>
* fix: make generate
Signed-off-by: Xinmin Du <[email protected]>
* fix: golangci-lint
Signed-off-by: Xinmin Du <[email protected]>
* fix: golangci-lint
Signed-off-by: Xinmin Du <[email protected]>
* feat: add volcano installation in integration test
Signed-off-by: Xinmin Du <[email protected]>
* fix: filter volcano api
Signed-off-by: Xinmin Du <[email protected]>
* fix: get volcano.podgroup with local version
Signed-off-by: Xinmin Du <[email protected]>
* fix: init test env with volcano podgroup installed
Signed-off-by: Xinmin Du <[email protected]>
* fix: check plugin in enforcePodgroupPolicy
Signed-off-by: Xinmin Du <[email protected]>
* fix: group-name label in unit test
Signed-off-by: Xinmin Du <[email protected]>
* fix: ReconcilerBuilders
Signed-off-by: Xinmin Du <[email protected]>
* feat: add PodGroupHandler
Signed-off-by: Xinmin Du <[email protected]>
* feat: unit test for handlers
Signed-off-by: Xinmin Du <[email protected]>
* fix: group name annotation
Signed-off-by: Xinmin Du <[email protected]>
* Update hack/swagger/main.go
Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
* fix: no need to delete RBAC
Signed-off-by: Xinmin Du <[email protected]>
* Update pkg/runtime/framework/plugins/volcano/indexer.go
Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
* fix: nil checking for trainjob
Signed-off-by: Xinmin Du <[email protected]>
* Update pkg/runtime/framework/plugins/volcano/volcano.go
Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
* fix: make generate
Signed-off-by: Xinmin Du <[email protected]>
* fix: index conflict
Signed-off-by: Xinmin Du <[email protected]>
* Update pkg/runtime/framework/plugins/coscheduling/coscheduling.go
Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
* fix: update volcano to v1.12.2
Signed-off-by: Xinmin Du <[email protected]>
* feat: re-use indexer
Signed-off-by: Xinmin Du <[email protected]>
* feat: add validate
Signed-off-by: Xinmin Du <[email protected]>
* fix: no scheduler when coscheduling is nil
Signed-off-by: Xinmin Du <[email protected]>
* fix: put group-name in annotations
Signed-off-by: Xinmin Du <[email protected]>
* feat: validate if priorityClass installed
Signed-off-by: Xinmin Du <[email protected]>
* feat: propagate annotations to pod
Signed-off-by: Xinmin Du <[email protected]>
* feat: integration test for volcano
Signed-off-by: Xinmin Du <[email protected]>
* fix: golangci-lint check
Signed-off-by: Xinmin Du <[email protected]>
* feat: use shared indexer
Signed-off-by: Xinmin Du <[email protected]>
* feat: remove indexer to runtime/
Signed-off-by: Xinmin Du <[email protected]>
* Update hack/swagger/main.go
Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
* Update hack/swagger/main.go
Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
* fix: append owner reference & missing import
Signed-off-by: Xinmin Du <[email protected]>
* fix: rewrite volcano UT
Signed-off-by: Xinmin Du <[email protected]>
* feat: add copyright
Signed-off-by: Xinmin Du <[email protected]>
* fix: sync RBAC to Helm charts
Signed-off-by: Xinmin Du <[email protected]>
* fix: refactor UTs
Signed-off-by: Xinmin Du <[email protected]>
* fix: test validation separately
Signed-off-by: Xinmin Du <[email protected]>
* Update hack/swagger/main.go
Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
* fix: refactor TestVolcano
Signed-off-by: Xinmin Du <[email protected]>
* fix: refactor TestValidate
Signed-off-by: Xinmin Du <[email protected]>
* Update pkg/runtime/framework/plugins/volcano/volcano_test.go
Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
---------
Signed-off-by: Xinmin Du <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
Co-authored-by: Shao Wang <[email protected]>
Co-authored-by: Yuki Iwai <[email protected]>
|
2025-10-06 05:51:10 +00:00 |
|
|
Antonin StefanuttiandGitHub
|
afb208d86e
|
chore(operator): Upgrade JobSet to v0.10.1 (#2875)
Signed-off-by: Antonin Stefanutti <[email protected]>
|
2025-10-03 10:08:08 +00:00 |
|
|
Andrey VelichkevichandGitHub
|
ca158302e7
|
chore(operator): Bump JobSet to v0.9.0 version (#2821)
* chore(operator): Bump JobSet to v0.9.0 version
Signed-off-by: Andrey Velichkevich <[email protected]>
* Fix Go tests
Signed-off-by: Andrey Velichkevich <[email protected]>
---------
Signed-off-by: Andrey Velichkevich <[email protected]>
|
2025-09-09 06:55:36 +00:00 |
|
|
|
39e4b08a03
|
feat: support imagePullSecrets in TrainJob pod spec overrides (#2806)
Signed-off-by: Tsubasa Nagasawa <[email protected]>
Co-authored-by: Antonin Stefanutti <[email protected]>
|
2025-09-08 12:43:36 +00:00 |
|
|
Antonin StefanuttiandGitHub
|
b0bde2f602
|
chore(operator): Upgrade Kubernetes to v1.34 (#2804)
Signed-off-by: Antonin Stefanutti <[email protected]>
|
2025-08-28 17:02:21 +00:00 |
|
|
Tsubasa NagasawaandGitHub
|
187a5de400
|
feat: support affinity in TrainJob pod spec overrides (#2796)
Signed-off-by: Tsubasa Nagasawa <[email protected]>
|
2025-08-28 15:52:22 +00:00 |
|
|
Anya KramarandGitHub
|
023ca6ce32
|
chore: Remove tool.hatch.build.targets.wheel from pyproject (#2803)
Signed-off-by: kramaranya <[email protected]>
|
2025-08-28 15:36:22 +00:00 |
|
|
Anya KramarandGitHub
|
3f14859563
|
fix(api): update license path for kubeflow_trainer_api (#2778)
Signed-off-by: kramaranya <[email protected]>
|
2025-08-07 00:33:55 +00:00 |
|
|
Andrey VelichkevichandGitHub
|
5e4d9cc3fb
|
fix(api): Fix license path for Kubeflow Trainer Python API (#2771)
Signed-off-by: Andrey Velichkevich <[email protected]>
|
2025-08-04 14:44:53 +00:00 |
|
|
|
e2ede1f1f6
|
Upgrade Kubernetes to v1.33 (#2756)
Signed-off-by: Antonin Stefanutti <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
|
2025-07-28 15:18:49 +00:00 |
|
|
Antonin StefanuttiandGitHub
|
8dc6334ccb
|
feat: Add schedulingGates to PodSpecOverrides (#2700)
* feat: Add schedulingGates to PodSpecOverrides
Signed-off-by: Antonin Stefanutti <[email protected]>
* Change desired job to target job in PodSpecOverrides comments
Signed-off-by: Antonin Stefanutti <[email protected]>
---------
Signed-off-by: Antonin Stefanutti <[email protected]>
|
2025-07-03 11:03:20 +00:00 |
|
|
|
434d953004
|
feat(controller): Implement PodSpecOverride API (#2614)
* feat(controller): Implement PodSpecOverride API
Signed-off-by: Andrey Velichkevich <[email protected]>
* Update API comments
Signed-off-by: Andrey Velichkevich <[email protected]>
* Fix InitContainers override
Signed-off-by: Andrey Velichkevich <[email protected]>
* Fix generate
Signed-off-by: Andrey Velichkevich <[email protected]>
* Update pkg/apis/trainer/v1alpha1/trainjob_types.go
Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>
* Change API to targetJob and add validation
Signed-off-by: Andrey Velichkevich <[email protected]>
* Add unit test for the JobSet builder
Signed-off-by: Andrey Velichkevich <[email protected]>
* Add integration tests
Signed-off-by: Andrey Velichkevich <[email protected]>
* Update pkg/apis/trainer/v1alpha1/trainjob_types.go
Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>
* Update pkg/apis/trainer/v1alpha1/trainjob_types.go
Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>
* Update pkg/apis/trainer/v1alpha1/trainjob_types.go
Co-authored-by: Antonin Stefanutti <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>
* Merge PodSpecOverrides before the build phase
Signed-off-by: Antonin Stefanutti <[email protected]>
* Fix make generate
Signed-off-by: Antonin Stefanutti <[email protected]>
* Fix PodSpec SMT patch unmarshalling into JobSet template
Signed-off-by: Antonin Stefanutti <[email protected]>
* Add UT for volumes PodSpecOverrides
Signed-off-by: Antonin Stefanutti <[email protected]>
* Add UT for tolerations PodSpecOverrides
Signed-off-by: Antonin Stefanutti <[email protected]>
* Add UT for node selector PodSpecOverrides
Signed-off-by: Antonin Stefanutti <[email protected]>
* Revert back to using TargetJobs []PodSpecOverrideTargetJob
Signed-off-by: Antonin Stefanutti <[email protected]>
* Run make fmt
Signed-off-by: Antonin Stefanutti <[email protected]>
* Add target jobs unicity validation for PodSpecOverrides
Signed-off-by: Antonin Stefanutti <[email protected]>
* Update with code review from @tenzen-y
Signed-off-by: Antonin Stefanutti <[email protected]>
---------
Signed-off-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Antonin Stefanutti <[email protected]>
Co-authored-by: Shao Wang <[email protected]>
Co-authored-by: Antonin Stefanutti <[email protected]>
Co-authored-by: Antonin Stefanutti <[email protected]>
|
2025-06-06 17:04:18 +00:00 |
|
|
Anya KramarandGitHub
|
4c25accaa0
|
Move generated Python models into kubeflow_trainer_api package (#2632)
Signed-off-by: kramaranya <[email protected]>
|
2025-05-07 18:14:39 +00:00 |
|