* [SDK] Add resources for create Job API
* Fix unbound var
* Assign values in get pod template
* Add torchrun issue
* Test to create PyTorchJob from Image
* Fix e2e to create from image
* Fix condition
* Modify check test conditions
* Add test to create PyTorchJob from func
* Use unique Job name for each test
* Fix job name in test
* Describe PyTorchJob when test fails
* Skip test for gang scheduling
* [SDK] Use logging to print Job logs
* Update func description
* Add info to configure logging in debug mode
* Update sdk/python/kubeflow/training/api/training_client.py
Co-authored-by: Alex <[email protected]>
* Return logs if follow is True
---------
Co-authored-by: Alex <[email protected]>
* adding constant for init container name
* adding master pod template spec and chief replica spec
* renaming vars and adding master spec
* github workflow fixes
* removing constants file changes from this pr
* code review changes
* adding new folder for creating storage init container images
* changing variable name
* adding validation for model uri
* adding peft_config field
* updating python version
* adding bug fix in gen-sdk.sh and unit test for create_job function in training client
* code reformatted using black
* move unittest to a different folder
* code review comments changes
* adding pytest github action
* removing 3rd party github pytest action
* Add Flake and Black Lint
* Change SDK APIs
* Update E2E tests
* Fix a few function parameters
* Fix black format
* Fix a few comments
* Fix conftest location
* Fix Job kind in tests
* Fix client creation in test
* Fix namespace arg in get_job_conditions
* Update SDK examples with the latest changes
* Rename SDK examples
* Fix black action
* Update checkout action version
Co-authored-by: Yuki Iwai <[email protected]>
* Use Black 23.9.1 version
* Fix GitHub Action for Black
* Add unit test to create PyTorchJob from func
* Rename timeout to wait_timeout
* Validate that Job is not set with other input parameters
* Update black in developer guide
* Remove pip_index_url validation
* Use locals to verify input
* Print Job info when E2E fails
* Remove duplicated delete
---------
Co-authored-by: Yuki Iwai <[email protected]>
* fix pytorch WORLD_SIZE env inconsistent
* add correct env node_rank, nnodes for torch
* restore elastic nnproc
* use string for nproc_per_node
* add defaults in api
* add validation for two nproc_per_node, use auto for defaulter
* add ut for defaults and validation
* fix ut
* add doc for nproc_per_node
* Support for k8s v1.25 in CI
* Support for k8s v1.25 in CI
* Change k8s api to v1.25
* Upgrade golangci-lint version
* Add changelog
* Update CHANGELOG.md
* Update Changelog
* Merge common repo
* Avoid to depend on local env when installing the code-generators (#1810)
Signed-off-by: Yuki Iwai <[email protected]>
* Make scheduler-plugins the default gang scheduler. (#1747)
Signed-off-by: Syulin7 <[email protected]>
* Fix tests
* Fix merge conflicts
* Fix CI issues
* Fix CI issues
* Fix review comments
* Add contributors in Readme file
* Fix review comments
* Fix review comments
---------
Signed-off-by: Yuki Iwai <[email protected]>
Signed-off-by: Syulin7 <[email protected]>
Co-authored-by: Yuki Iwai <[email protected]>
Co-authored-by: yu lin <[email protected]>
* docker file to create conformance tests container
* add resources to containers created by test jobs
* use setup.py to install dependencies
* update resources to fix the test in CI
* update resource limits
* update resource limits
* build and publish conformance test image in CI
* fix conformance file path
* fix python lint error
* fix python lint error
* use python 3.10
* update mpijob e2e test to use fixtures
* update mxjob e2e test to use fixtures
* update paddlejob e2e test to use fixtures
* update pytorchjob e2e test to use fixtures
* update xgboostjob e2e test to use fixtures
* update tfjob e2e test to use fixtures
* remove training_client fixture
* move conftest to test root dir
* delete only autogenerated test files
* add default namespace option in integration-tests github action
* Remove legacy ksonnet tests
* [SDK] Create Unify Training Client
* Modify E2E tests
* Rename Training to Operator version
* Add missing exception
* Add API server timeout parameter
* Add delete options
* Fix import for V1JobCondition
* Fix container name in e2e tests
* Fix mxnet container
* Import all Kubernetes models
* Update SDK Examples
* Verify other SDK APIs in e2e tests
* Add replica types to const
* Use logging in e2e tests
* Fix logging for status
* Use const for job types
* Support for k8s v1.25 in CI
* Support for k8s v1.25 in CI
* Change k8s api to v1.25
* Upgrade golangci-lint version
* Remove deprecated job labels
* Updating dependencies
* Fix Sdk
* Support for k8s v1.25 in CI
* Support for k8s v1.25 in CI
* Change k8s api to v1.25
* Upgrade golangci-lint version
* Fixes for HPA in pytorchjob
* Common changes
