Commit Graph
40 Commits
Author SHA1 Message Date
9802f954ab feat: KEP-2437 - PodGroup Creation for Volcano Scheduler (#2729)
* feat: api for volcano scheduling plugin

Signed-off-by: Xinmin Du <[email protected]>

* feat: init volcano-plugin

Signed-off-by: Xinmin Du <[email protected]>

* feat: init test file

Signed-off-by: Xinmin Du <[email protected]>

* feat: register volcano plugin

Signed-off-by: Xinmin Du <[email protected]>

* feat: deal with minTaskMember, minMember, NetworkTopo

Signed-off-by: Xinmin Du <[email protected]>

* fix: calculate of minResource

Signed-off-by: Xinmin Du <[email protected]>

* test: build PodGroup test

Signed-off-by: Xinmin Du <[email protected]>

* refactor: separate to 2 prs(build&handler)

Signed-off-by: Xinmin Du <[email protected]>

* test: add test for new&reconcile_builder

Signed-off-by: Xinmin Du <[email protected]>

* fix: typo

Signed-off-by: Xinmin Du <[email protected]>

* fix: trainer/v2 import

Signed-off-by: Xinmin Du <[email protected]>

* fix: networktopo type

Signed-off-by: Xinmin Du <[email protected]>

* fix: OpenAPI validation errors

Signed-off-by: Xinmin Du <[email protected]>

* fix: remove minTaskMembers

Signed-off-by: Xinmin Du <[email protected]>

* test: test coverage 100%

Signed-off-by: Xinmin Du <[email protected]>

* feat: update apis

Signed-off-by: Xinmin Du <[email protected]>

* feat: replace testify

Signed-off-by: Xinmin Du <[email protected]>

* fix: registry Volcano CRDs to the scheme

Signed-off-by: Xinmin Du <[email protected]>

* fix: add volcano to scheme

Signed-off-by: Xinmin Du <[email protected]>

* fix: fix networktopo schema

Signed-off-by: Xinmin Du <[email protected]>

* fix: add networktopo spec in trainer

Signed-off-by: Xinmin Du <[email protected]>

* fix: unit test

Signed-off-by: Xinmin Du <[email protected]>

* feat: import networkTopo directly

Signed-off-by: Xinmin Du <[email protected]>

* fix: make generate

Signed-off-by: Xinmin Du <[email protected]>

* fix: make generate

Signed-off-by: Xinmin Du <[email protected]>

* fix: golangci-lint

Signed-off-by: Xinmin Du <[email protected]>

* fix: golangci-lint

Signed-off-by: Xinmin Du <[email protected]>

* feat: add volcano installation in integration test

Signed-off-by: Xinmin Du <[email protected]>

* fix: filter volcano api

Signed-off-by: Xinmin Du <[email protected]>

* fix: get volcano.podgroup  with local version

Signed-off-by: Xinmin Du <[email protected]>

* fix: init test env with volcano podgroup installed

Signed-off-by: Xinmin Du <[email protected]>

* fix: check plugin in enforcePodgroupPolicy

Signed-off-by: Xinmin Du <[email protected]>

* fix: group-name label in unit test

Signed-off-by: Xinmin Du <[email protected]>

* fix: ReconcilerBuilders

Signed-off-by: Xinmin Du <[email protected]>

* feat: add PodGroupHandler

Signed-off-by: Xinmin Du <[email protected]>

* feat: unit test for handlers

Signed-off-by: Xinmin Du <[email protected]>

* fix: group name annotation

Signed-off-by: Xinmin Du <[email protected]>

* Update hack/swagger/main.go

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: no need to delete RBAC

Signed-off-by: Xinmin Du <[email protected]>

* Update pkg/runtime/framework/plugins/volcano/indexer.go

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: nil checking for trainjob

Signed-off-by: Xinmin Du <[email protected]>

* Update pkg/runtime/framework/plugins/volcano/volcano.go

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: make generate

Signed-off-by: Xinmin Du <[email protected]>

* fix: index conflict

Signed-off-by: Xinmin Du <[email protected]>

* Update pkg/runtime/framework/plugins/coscheduling/coscheduling.go

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: update volcano to v1.12.2

Signed-off-by: Xinmin Du <[email protected]>

* feat: re-use indexer

Signed-off-by: Xinmin Du <[email protected]>

* feat: add validate

Signed-off-by: Xinmin Du <[email protected]>

* fix: no scheduler when coscheduling is nil

Signed-off-by: Xinmin Du <[email protected]>

* fix: put group-name in annotations

Signed-off-by: Xinmin Du <[email protected]>

* feat: validate if priorityClass installed

Signed-off-by: Xinmin Du <[email protected]>

* feat: propagate annotations to pod

Signed-off-by: Xinmin Du <[email protected]>

* feat: integration test for volcano

Signed-off-by: Xinmin Du <[email protected]>

* fix: golangci-lint check

Signed-off-by: Xinmin Du <[email protected]>

* feat: use shared indexer

Signed-off-by: Xinmin Du <[email protected]>

* feat: remove indexer to runtime/

Signed-off-by: Xinmin Du <[email protected]>

* Update hack/swagger/main.go

Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update hack/swagger/main.go

Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: append owner reference & missing import

Signed-off-by: Xinmin Du <[email protected]>

* fix: rewrite volcano UT

Signed-off-by: Xinmin Du <[email protected]>

* feat: add copyright

Signed-off-by: Xinmin Du <[email protected]>

* fix: sync RBAC to Helm charts

Signed-off-by: Xinmin Du <[email protected]>

* fix: refactor UTs

Signed-off-by: Xinmin Du <[email protected]>

* fix: test validation separately

Signed-off-by: Xinmin Du <[email protected]>

* Update hack/swagger/main.go

Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: refactor TestVolcano

Signed-off-by: Xinmin Du <[email protected]>

* fix: refactor TestValidate

Signed-off-by: Xinmin Du <[email protected]>

* Update pkg/runtime/framework/plugins/volcano/volcano_test.go

Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

---------

Signed-off-by: Xinmin Du <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
Co-authored-by: Shao Wang <[email protected]>
Co-authored-by: Yuki Iwai <[email protected]>
2025-10-06 05:51:10 +00:00
Andrey VelichkevichandGitHub 8655798f02 fix(module): Change Go module name to v2 (#2707)
* fix(module): Change Go module name to v2

Signed-off-by: Andrey Velichkevich <[email protected]>

* Bump x/net to v0.38.0

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-07-03 17:46:20 +00:00
Andrey VelichkevichandGitHub 59d2d31a7f feat(sdk): Migrate to OpenAPI V3 (#2490)
* feat(sdk): Migrate to OpenAPI V3

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update SDK to support OpenAPI V3

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove metadata check

Signed-off-by: Andrey Velichkevich <[email protected]>

* Assign nil for empty default value

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-03-10 13:45:02 +00:00
71317e6bd0 chore(test): Add E2E tests for Kubeflow Trainer (#2470)
* Add e2e tests for Kubeflow Trainer

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add timeout for papermill

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add output as part of make command

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add k8s version to setup cluster

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix Kind k8s version

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix 1.29 version

Signed-off-by: Andrey Velichkevich <[email protected]>

* Create script to run Notebook

Signed-off-by: Andrey Velichkevich <[email protected]>

* Download dataset when local_rank=0

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update test/e2e/e2e_test.go

Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>

* Refactor Go e2e tests

Signed-off-by: Andrey Velichkevich <[email protected]>

* Bump k8s to 1.29.14

Signed-off-by: Andrey Velichkevich <[email protected]>

* Install Kind from go mod

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix path for Kind package

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix Go e2e

Signed-off-by: Andrey Velichkevich <[email protected]>

* Reduce number of CPUs
Export Notebook as artifact

Signed-off-by: Andrey Velichkevich <[email protected]>

* Print logs due to flaky test

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix artifact path

Signed-off-by: Andrey Velichkevich <[email protected]>

* docker pull image

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix path

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add k8s version to output name

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove install Kind cmd

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
Co-authored-by: Yuki Iwai <[email protected]>
2025-03-05 04:04:07 +00:00
Antonin StefanuttiandGitHub 2431959510 Fix missing external types in apply configurations (#2429)
Signed-off-by: Antonin Stefanutti <[email protected]>
2025-02-10 08:35:07 +00:00
Andrey VelichkevichandGitHub 1ff1d8ad28 Update the naming conventions for Kubeflow Trainer (#2415)
* Update the naming conventions for Kubeflow Trainer

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix webhooks

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix paths for webhooks

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update go test cmd

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename kubeflowv1 to trainer pkg

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-02-06 13:48:30 +00:00
Shao WangandGitHub 7777f61acb KEP-2170: Change API Group Name to trainer.kubeflow.org (#2413)
* fix(apis): change the group of API to trainer.kubeflow.org.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(manifests): update crds in manifests using make manifests.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: change the apia dir name to trainer.kubeflow.org and update reference.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: execute make generate.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: remove remaining kubeflow.org dirs.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): remove outdated docs & update models reference.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: rename apis dir to ttrainer.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: execute make generate.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): remove outdated docs & update models reference.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): update model reference in code.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update api grou p in KEP-2170.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
2025-02-05 13:34:37 +00:00
Andrey VelichkevichandGitHub 812c308cc2 Remove the Training Operator V1 Source Code (#2389)
* Remove Training Operator V1 files

Signed-off-by: Andrey Velichkevich <[email protected]>

* Refactor README and Makefile

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove v1 GitHub workflows

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove finish action from Go

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename Kubeflow Training to Kubeflow Trainer

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename comment

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add steps for free-up space

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update Python tests

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove integration workflow

Signed-off-by: Andrey Velichkevich <[email protected]>

* Install SDK in Python integration tests

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove generate file

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add Kubeflow Trainer logo

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add tech diagram

Signed-off-by: Andrey Velichkevich <[email protected]>

* Exclude images from pre-commit

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix git diff in CI

Signed-off-by: Andrey Velichkevich <[email protected]>

* Run go mod tidy

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update diagram

Signed-off-by: Andrey Velichkevich <[email protected]>

* Cleanup examples

Signed-off-by: Andrey Velichkevich <[email protected]>

* Always install Go bins

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update diagram

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update hack
Remove manifests for JobSet
Rename to tools.go

Signed-off-by: Andrey Velichkevich <[email protected]>

* Create tools.go

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-02-04 15:25:38 +00:00
Andrey VelichkevichandGitHub e051fe09da KEP-2170: [SDK] Initial implementation of the Kubeflow Training V2 Python SDK (#2324)
* Init commit

Signed-off-by: Andrey Velichkevich <[email protected]>

* Implement SDK APIs

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update __init__ file

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add model and dataset configs

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove print

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add status to TrainJob

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix sed for Linux

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix PHASE_POST_TRAINING const

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add device labels for the runtimes

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add Components to the TrainJob type

Signed-off-by: Andrey Velichkevich <[email protected]>

* Get container devices util

Signed-off-by: Andrey Velichkevich <[email protected]>

* Use SDK assets in initializer

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add the runtime_ref to the list_jobs() API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Check if runtime label presents

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add Trainer arg as part of train API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename lora to peft config

Signed-off-by: Andrey Velichkevich <[email protected]>

* Using global prop to remove SDK tests

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix type for lora_dropout

Signed-off-by: Andrey Velichkevich <[email protected]>

* Import the JobSet models
Use kube-openapi generator to remove unnecessary models from apimachinery

Signed-off-by: Andrey Velichkevich <[email protected]>

* Parse runtime as object

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove old gen_openapi

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename GPU_DEVICE_LABEL to NVIDIA_GPU_DEVICE_LABEL

Signed-off-by: Andrey Velichkevich <[email protected]>

* Run codegen

Signed-off-by: Andrey Velichkevich <[email protected]>

* Install git on initializer images

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename device to accelerator for Runtime class

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2024-12-13 16:59:06 +00:00
Antonin StefanuttiandGitHub 3801b090d6 Upgrade Kubernetes to v1.30.7 (#2332)
* Upgrade Kubernetes to v1.30.7

Signed-off-by: Antonin Stefanutti <[email protected]>

* Use typed event handlers and predicates in job controllers

Signed-off-by: Antonin Stefanutti <[email protected]>

* Re-organize pkg/common/util/reconciler.go

Signed-off-by: Antonin Stefanutti <[email protected]>

* Update installation instructions in README

Signed-off-by: Antonin Stefanutti <[email protected]>

---------

Signed-off-by: Antonin Stefanutti <[email protected]>
2024-11-27 15:05:54 +00:00
Andrey VelichkevichandGitHub 799b7e4606 KEP-2170: Generate Python SDK for Kubeflow Training V2 (#2310)
* Generate SDK models for the Training V2 APIs

Signed-off-by: Andrey Velichkevich <[email protected]>

* Create pyproject.toml config

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove comments

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix pre-commit

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2024-10-27 17:58:08 +00:00
VarshaandGitHub 54a6b0b5aa KEP-2170: Generate clientset, openapi spec for the V2 APIs (#2273)
Generate clientset, informers, listers and open api spec
for v2alpha1 APIs.

Signed-off-by: Varsha Prasad Narsing <[email protected]>
2024-10-10 19:50:10 +00:00
Andreas FritzlerandGitHub 6f40f317e0 Bump k8s.io/* deps to 1.28 (#1920)
* Bump k8s.io/* deps to 1.28

- Bump k8s.io/* deps to 1.28
- Fix metrics bind address assignment in manager setup
- Rename metrics-port flag to webhook-server-port as it was wrongly used

* Revert envtest 1.27 and use generate-groups.sh

- Revert envtest to 1.27
- Use generate-groups.sh instead of kube_codegen.sh

* Revert monitoring port flag
2023-09-29 15:24:42 +00:00
c320716a1a Merge kubeflow/common to training-operator (#1813)
* Support for k8s v1.25 in CI

* Support for k8s v1.25 in CI

* Change k8s api to v1.25

* Upgrade golangci-lint version

* Add changelog

* Update CHANGELOG.md

* Update Changelog

* Merge common repo

* Avoid to depend on local env when installing the code-generators (#1810)

Signed-off-by: Yuki Iwai <[email protected]>

* Make scheduler-plugins the default gang scheduler. (#1747)

Signed-off-by: Syulin7 <[email protected]>

* Fix tests

* Fix merge conflicts

* Fix CI issues

* Fix CI issues

* Fix review comments

* Add contributors in Readme file

* Fix review comments

* Fix review comments

---------

Signed-off-by: Yuki Iwai <[email protected]>
Signed-off-by: Syulin7 <[email protected]>
Co-authored-by: Yuki Iwai <[email protected]>
Co-authored-by: yu lin <[email protected]>
2023-05-31 11:04:04 +00:00
Yuki IwaiandGitHub 2029138be2 Avoid to depend on local env when installing the code-generators (#1810)
Signed-off-by: Yuki Iwai <[email protected]>
2023-05-22 14:47:39 +00:00
Junlin ZhouandGitHub 3492598c06 Find defaulter-gen in $(go env GOPATH) instead of ${GOPATH} (#1784) 2023-03-21 15:10:42 +00:00
Yuki IwaiandGitHub 0166d87791 Add clientset for MPIJob, PytorchJob, MXJob, and XGBoostJob (#1610) 2022-06-14 04:20:31 +00:00
Johnu GeorgeandGitHub f7140508cd Update k8s dependencies to v0.24.1 (#1604)
* Adding latest image tag

* Update manifests with latest image tag

* Update k8s dependencies to v0.24.1

* Update manifests

* Update k8s matrix for integration tests

* Update k8s matrix for unit tests

* Fix k8s versions

* Fix version

* Add scripts in separate file

* Fix Makefile

* Cleanup Makefile

* Addressing review comments
2022-06-06 01:25:28 +00:00
Peng GaoandGitHub b8fb1f3d81 Add mpi in update-codegen.sh (#1600)
Signed-off-by: Peng Gao <[email protected]>
2022-05-30 01:36:38 +00:00
Andrey VelichkevichandGitHub a6aec1b7b9 Update links and files with the new URL (#1434)
* Update links and corresponding files for training-operator repository
Use Go 1.17

* Generate SDK

* Remove Travis

* Modify developer guide

* Fix go mod

* Fix legacy docs

* Generate SDK

* Remove travis

* Update ignore files
2021-10-09 13:50:44 -07:00
Jiaxin ShanandGitHub d7a46413f2 Update scripts to generate sdk for all frameworks (#1389)
* Slim OpenAPI definitions by removing unrelated api

openapi-gen input-dirs includes a few k8s.io/api and k8s.io/apimachinery packages which makes openapi_generated.go very large. Swagger files created by them are large as well.
This change help remove unnecessary references.

Signed-off-by: Jiaxin Shan <[email protected]>

* Update OpenAPI generation scripts

1. Update gen-sdk.sh and main.go to support all frameworks
2. Generate swagger.json for all frameworks

Signed-off-by: Jiaxin Shan <[email protected]>

* Merge swagger files into one

The swagger.json can not be merged smartly. I manually update info.description, info.title in hack/python-sdk/swagger.json

Signed-off-by: Jiaxin Shan <[email protected]>
2021-09-28 12:26:47 -07:00
Jiaxin Shan 5d3dc38128 Unify code structure of training job api (#1300)
* Add docs, register in job apis

- Clean up register.go and use reference in groupversion_info.go (generated by kubebuilder) instead
- Add doc.go and register.go for framework missing them
- Remove global tag “+k8s:deepcopy-gen=package,register” and this should be taken care of by controller-gen.

Signed-off-by: Jiaxin Shan <[email protected]>

* Generate defaults and openapi for all frameworks

1. Update codegen scripts to generate defaulters and openapi spec for all frameworks
2. Create defaults.go for framework which miss it.

Signed-off-by: Jiaxin Shan <[email protected]>

* Add Kind in constants.go

Signed-off-by: Jiaxin Shan <[email protected]>

* Update update-codegen to generate openapi-gen

Signed-off-by: Jiaxin Shan <[email protected]>

* Run goimports to format the files

* Add Plural and Singular to apis constants.go

Signed-off-by: Jiaxin Shan <[email protected]>
2021-08-05 12:23:43 -07:00
Jiaxin Shan 6da4250132 Generate tfjob 1.19.x compatible clientset (#1290)
* Resolve GroupVersion redeclared issue

`go build` will fail since same group version is redeclared in groupversion_info.go

Signed-off-by: Jiaxin Shan <[email protected]>

* Generate tfjob 1.19.x compatible clientset

1. Update dependencies to 1.19.x compatible
2. Update update-codegen.sh to use pkg from go modules pkg
3. Generate clientsets which supports context

Signed-off-by: Jiaxin Shan <[email protected]>
2021-08-05 12:23:43 -07:00
Jack LinandGitHub 36feaf2b23 Migrate controller implementation to kubeflow/common fashion (#1171)
Signed-off-by: ChanYiLin <[email protected]>
2020-08-17 22:37:30 -07:00
Chu XiangyangandGitHub ad2a865be8 Use go mod (#1144)
* Update k8s to 1.16

Update kubeflow/commmon

* godep ensure

Also update some files with correct version

* Update kube-batch and apiextensions-apiserver

* Add vendor.go to include code-generator

* go mod init

* Update travis.yml to use go mod

* Remove Gopkg.toml and lock file

* go mod tidy && go mod vendor

* Add bash to run scripts

* update codegen

* Run go mod vendor after go get goveralls

* re-generate after install openapi-gen
2020-05-21 19:10:37 -07:00
Ce GaoandKubernetes Prow Robot 24060c6406 feat: Use kubeflow/common (#1088)
* chore: Vendor update

Signed-off-by: Ce Gao <[email protected]>

* feat: Use common

Signed-off-by: Ce Gao <[email protected]>
2019-11-10 23:15:41 -08:00
Johnu GeorgeandKubernetes Prow Robot ceb550e59f Delete v1beta2 api (#1075)
* delete v1beta2 api version

* minor fix

* codegen update

* codegen update
2019-08-31 02:07:47 -07:00
Richard LiuandKubernetes Prow Robot 129a1d517e Delete v1beta1 (#1004)
* Delete v1beta1

* Delete v1beta1

* Fix dashboard build
2019-05-22 20:58:24 -07:00
Richard LiuandKubernetes Prow Robot 4b54fceb30 TF job v1 (#993)
* TF job v1

* Fix package name

* Fix lint

* Merge change #995 into v1

* Fix OpenAPI generation

* Add openapi generated files
2019-05-10 10:45:59 -07:00
Richard LiuandKubernetes Prow Robot efeb02636c Add v1beta2 APIs and controller logic (#937)
* Add v1beta2 APIs and controller logic

* Fix build

* Add v1beta2 tests; fix linter
2019-02-06 23:21:55 -08:00
Richard LiuandKubernetes Prow Robot e9593f3b90 Delete v1alpha2 API (#933)
* Delete v1alpha2

* Fix import
2019-02-06 10:49:48 -08:00
Richard Liu 74b52a5ee1 Delete v1alpha1 2018-11-08 12:01:38 -08:00
Richard Liuandk8s-ci-robot 44d7c2d4e7 TF operator v1beta1 APIs (#859)
* TF operator v1beta1 types

* v1beta1 apis

* Openapi generated files

* Linter

* Add client files

* openapi

* Fix register

* linter

* Bypass new files for goveralls

* Go fmt files

* fix goimports
2018-10-31 15:38:12 -07:00
Jeff Chenandk8s-ci-robot 01daad03ac Generate api information in OpenAPI model and register types to scheme (#733)
* Add a function to register api group and add type to scheme

Signed-off-by: JetMuffin <[email protected]>

* apply goimports -w to install.go

Signed-off-by: JetMuffin <[email protected]>

* generate api information inf openapi model.

Signed-off-by: JetMuffin <[email protected]>
2018-07-17 06:22:39 -07:00
Ce Gaoandk8s-ci-robot 04f0ff04c9 api: OpenAPI support (#577)
* hack: Add openapi-gen

Signed-off-by: Ce Gao <[email protected]>

* api: Generate openapi model

Signed-off-by: Ce Gao <[email protected]>

* linter_config: Add

Signed-off-by: Ce Gao <[email protected]>

* openapi: Add k8s.io

Signed-off-by: Ce Gao <[email protected]>

* .travis: Ignore openapi

Signed-off-by: Ce Gao <[email protected]>

* dep: Update

Signed-off-by: Ce Gao <[email protected]>
2018-05-30 23:59:56 -07:00
Ce Gaoandk8s-ci-robot 19390fb1e7 vendor: Use dep instead of glide and prune it (#557)
* vendor: Update

Signed-off-by: Ce Gao <[email protected]>

* pkg: Regenerate

Signed-off-by: Ce Gao <[email protected]>

* update-codegen: Update

Signed-off-by: Ce Gao <[email protected]>

* vendor: Replace glide

Signed-off-by: Ce Gao <[email protected]>
2018-04-25 22:51:02 -07:00
Ce Gaoandk8s-ci-robot 4d2d34aeec v1alpha2: Add API and codegen (#523)
* types.go: Add APIs

Signed-off-by: Ce Gao <[email protected]>

* apis: Related code

Signed-off-by: Ce Gao <[email protected]>

* update-codegen.sh: Update

Signed-off-by: Ce Gao <[email protected]>

* codegen: Update

Signed-off-by: Ce Gao <[email protected]>

* linter: Update

Signed-off-by: Ce Gao <[email protected]>

* types.go: Fix typo

Signed-off-by: Ce Gao <[email protected]>

* test: Remove Pformat

Signed-off-by: Ce Gao <[email protected]>
2018-04-10 06:15:10 -07:00
XsWackandJeremy Lewi e618e56da1 add boilerplate header for go file (#431)
* add boilerplate Copyright for generated file

* update update-codegen.sh
2018-03-01 21:09:11 -08:00
Ce GaoandJeremy Lewi 413098aaad *: Replace the repo name (#386)
We have migrated the repo and we should replace the repo name with the new one.

* Related to #350
Signed-off-by: Ce Gao [email protected]
2018-02-12 10:22:05 -08:00
XsWackandJeremy Lewi d9342736db Refactor the TfJob to use K8s libraries (#215)
fix #206

1.refactor the spec package to the kubernetes standard API, all detention of our CRD is in pkg pkg/apis/tensorflow and also the validation、 set Default for the CRD and some help func.

2.for use K8s code gen, wo import the project https://github.com/kubernetes/code-generator, and some shell script in the folder hack. You can see how to use it in https://blog.openshift.com/kubernetes-deep-dive-code-generation-customresources/

3.All the file in pkg/client are all auto generated and we should not modify it manually.

4.I do not plan to change the logical to use the sharedInformer and clientset. This PR is big enough, I think I can do it in a follow PR.

5.SharedInformer is a helpful tool with cache that we can use it to list and watch our resources. More details you can see http://borismattijssen.github.io/articles/kubernetes-informers-controllers-reflectors-stores
2017-12-29 08:50:42 -08:00