hanzo-ml/katib
1
0
Fork 0
mirror of https://github.com/hanzo-ml/katib.git synced 2026-09-24 00:31:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,381 Commits 1 Branch 0 Tags
master
Commit Graph
95 Commits
Author SHA1 Message Date
Andrey VelichkevichandGitHub 389b4de95b Bump Katib Python SDK to 0.19.0 version (#2585) 
* Bump Katib Python SDK to 0.19.0 version

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update version in gen-api

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix release script

Signed-off-by: Andrey Velichkevich <[email protected]>

* Run gen-api directly

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-10-30 23:52:38 +00:00
Wassim Ben SalemGitHubAndrey Velichkevich
 		d9e3fb6928 feat(sdk): Support multiple pip index URLs. (#2566) 
* feat: add extra index urls to the katib tune

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove test with None index

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
 2025-10-30 22:03:35 +00:00
Aditya RautGitHubAndrey Velichkevich
 		cd572d8692 Add get_job_logs() API to Katib Python SDK (#2580) 
* add :GETJob API

Signed-off-by: adity1raut <[email protected]>

* olve The Confict

Signed-off-by: adity1raut <[email protected]>

* Update After The REview

Signed-off-by: adity1raut <[email protected]>

* Update After Review

Signed-off-by: adity1raut <[email protected]>

* Update Code After review

Signed-off-by: adity1raut <[email protected]>

* Fixed After Review

Signed-off-by: adity1raut <[email protected]>

* Update

Signed-off-by: adity1raut <[email protected]>

* Update Files After a Review

Signed-off-by: adity1raut <[email protected]>

* Update After Review

Signed-off-by: adity1raut <[email protected]>

* Update The File After all Review and Comment

Signed-off-by: adity1raut <[email protected]>

* Update And Add a Unit Test

Signed-off-by: adity1raut <[email protected]>

* Fix lint

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: adity1raut <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
 2025-10-29 16:29:10 +00:00
Wassim Ben SalemandGitHub 66da2bce74 feat: Add trial_timeout parameter to Katib tune API (#2568) 
- Add optional trial_active_deadline_seconds parameter to tune() function
- Support timeout for both Job and PyTorchJob trial types
- Set active_deadline_seconds on Job spec for Job-based trials
- Set active_deadline_seconds on RunPolicy for PyTorchJob-based trials
- Add comprehensive documentation and usage examples
- Add test cases for both Job and PyTorchJob timeout scenarios
- Maintain backward compatibility with existing code

This feature prevents individual trials from running indefinitely
and consuming cluster resources by allowing users to specify
per-trial timeouts in seconds.

Signed-off-by: wassimbensalem <[email protected]>
 2025-10-16 07:24:51 +00:00
Zackeus BengtssonandGitHub 2adf3a92c2 [SDK] fix issue with serialization of LoraConfig (#2567) 
Signed-off-by: Zackeus Bengtsson <[email protected]>
 2025-09-11 13:37:39 +00:00
Hezhi (Helen) XieandGitHub 2031c75535 [GSoC] Add e2e test for tune api with LLM hyperparameter optimization (#2420) 
* add e2e test for tune api

Signed-off-by: helenxie-bit <[email protected]>

* upgrade training-operator sdk

Signed-off-by: helenxie-bit <[email protected]>

* specify the version of training operator sdk

Signed-off-by: helenxie-bit <[email protected]>

* fix num_labels error and update the version of training operator controller

Signed-off-by: helenxie-bit <[email protected]>

* check the version of training operator

Signed-off-by: helenxie-bit <[email protected]>

* debug

Signed-off-by: helenxie-bit <[email protected]>

* check import path of HuggingFaceModelParams

Signed-off-by: helenxie-bit <[email protected]>

* update the version of training operator sdk

Signed-off-by: helenxie-bit <[email protected]>

* update the name of experiment

Signed-off-by: helenxie-bit <[email protected]>

* add step of checking pod

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of pod

Signed-off-by: helenxie-bit <[email protected]>

* add check

Signed-off-by: helenxie-bit <[email protected]>

* check reason for imagepullbackoff

Signed-off-by: helenxie-bit <[email protected]>

* revert timeout limit

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* extend timeout limit

Signed-off-by: helenxie-bit <[email protected]>

* update training operator sdk version

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of pod

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* update the function of getting logs

Signed-off-by: helenxie-bit <[email protected]>

* add the step of describing pod

Signed-off-by: helenxie-bit <[email protected]>

* check disk space

Signed-off-by: helenxie-bit <[email protected]>

* change work directory

Signed-off-by: helenxie-bit <[email protected]>

* change work directory

Signed-off-by: helenxie-bit <[email protected]>

* increase timeout limit

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of controller and events

Signed-off-by: helenxie-bit <[email protected]>

* change work directory

Signed-off-by: helenxie-bit <[email protected]>

* change work directory

Signed-off-by: helenxie-bit <[email protected]>

* change work directory

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of kubelet

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of kubelet

Signed-off-by: helenxie-bit <[email protected]>

* increase cpu

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of training operator

Signed-off-by: helenxie-bit <[email protected]>

* check the use of resources

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of container 'pytorch' and 'storage_initializer'

Signed-off-by: helenxie-bit <[email protected]>

* fix error of checking use of resources

Signed-off-by: helenxie-bit <[email protected]>

* add other checks to find the error reason

Signed-off-by: helenxie-bit <[email protected]>

* set 'storage_config'

Signed-off-by: helenxie-bit <[email protected]>

* reduce the number of tests

Signed-off-by: helenxie-bit <[email protected]>

* Check container runtime logs

Signed-off-by: helenxie-bit <[email protected]>

* set the driver of minikube as docker

Signed-off-by: helenxie-bit <[email protected]>

* set the driver of minikube to none

Signed-off-by: helenxie-bit <[email protected]>

* check logs of pod

Signed-off-by: helenxie-bit <[email protected]>

* check memory usage

Signed-off-by: helenxie-bit <[email protected]>

* increase 'termination_grace_period_seconds' in podspec

Signed-off-by: helenxie-bit <[email protected]>

* fix annotations error

Signed-off-by: helenxie-bit <[email protected]>

* restart docker

Signed-off-by: helenxie-bit <[email protected]>

* delete restarting docker

Signed-off-by: helenxie-bit <[email protected]>

* use original docker data directory

Signed-off-by: helenxie-bit <[email protected]>

* update installation of Katib SDK with extra requires

Signed-off-by: helenxie-bit <[email protected]>

* test trainer image built with cpu

Signed-off-by: helenxie-bit <[email protected]>

* add action of free up disk space (including move docker data directory)

Signed-off-by: helenxie-bit <[email protected]>

* delete unnecessary checks and update the part of fetching pod description and logs

Signed-off-by: helenxie-bit <[email protected]>

* delete fetching pod logs

Signed-off-by: helenxie-bit <[email protected]>

* add blank line at the end of free-up-disk-space yaml file

Signed-off-by: helenxie-bit <[email protected]>

* update experiment name

Signed-off-by: helenxie-bit <[email protected]>

* update test function name to be consistent with experiment name

Signed-off-by: helenxie-bit <[email protected]>

* move import statements inside the function

Signed-off-by: helenxie-bit <[email protected]>

* apply pprint for the logging output

Signed-off-by: helenxie-bit <[email protected]>

* update experiment names

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix the sequence of arguments in 'trial_template'

Signed-off-by: helenxie-bit <[email protected]>

* test example in user guide

Signed-off-by: helenxie-bit <[email protected]>

* fix access token error

Signed-off-by: helenxie-bit <[email protected]>

* fix the error of setup

Signed-off-by: helenxie-bit <[email protected]>

* fix the error of setup

Signed-off-by: helenxie-bit <[email protected]>

* reverse back

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

---------

Signed-off-by: helenxie-bit <[email protected]>
 2025-06-26 14:13:16 +00:00
Ayush GuptaandGitHub 1c19d3a6eb Fix Istio sidecar injection by moving from annotations to labels (#2527) 
* Fix Istio sidecar injection by moving from annotations to labels

Signed-off-by: madmecodes <[email protected]>

* Update Istio sidecar injection from annotations to labels across the codebase
Replace annotations with labels for Istio sidecar injection according to Istio recommendations. Update conformance tests, examples, constants, composers, and utilities to use the new label-based approach consistently.

Signed-off-by: madmecodes <[email protected]>

* fix: Update SuggestionLabels function and composer implementation for Istio label injection

Signed-off-by: madmecodes <[email protected]>

* Fix linting issues in mpi-job-horovod.py

Signed-off-by: madmecodes <[email protected]>

* update: function moved from annotations to labels

Signed-off-by: madmecodes <[email protected]>

---------

Signed-off-by: madmecodes <[email protected]>
 2025-05-09 17:52:41 +00:00
Mahdi KhashanandGitHub 19db2d47d4 [feature] move manifest image references to ghcr (#2529) 
* move to ghcr

Signed-off-by: mahdikhashan <[email protected]>

* move images to ghcr

Signed-off-by: mahdikhashan <[email protected]>

* manifests

Signed-off-by: mahdikhashan <[email protected]>

* change registry in all path

Signed-off-by: mahdikhashan <[email protected]>

* update script

Signed-off-by: mahdikhashan <[email protected]>

* fix

Signed-off-by: mahdikhashan <[email protected]>

* fix

Signed-off-by: mahdikhashan <[email protected]>

* slight fix

Signed-off-by: mahdikhashan <[email protected]>

---------

Signed-off-by: mahdikhashan <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>
 2025-03-24 17:11:50 +00:00
Andrey VelichkevichandGitHub 203bbf93a0 Bump Katib Python SDK to 0.18.0rc0 version (#2514) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-02-13 18:05:36 +00:00
Andrey VelichkevichandGitHub 96f3ed1b5f [SDK] Support PyTorchJob as a Trial Worker (#2512) 
* [SDK] Support PyTorchJob as Trial Worker

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix pod spec for Job

Signed-off-by: Andrey Velichkevich <[email protected]>

* Set default restart_policy to Never

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix primary_container_name for PyTorchJob

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add unit tests for PyTorchJob as Trial

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add e2e test for PyTorchJob as Trial

Signed-off-by: Andrey Velichkevich <[email protected]>

* Bump kubeflow-training SDK

Signed-off-by: Andrey Velichkevich <[email protected]>

* Deploy Training Operator with server side apply

Signed-off-by: Andrey Velichkevich <[email protected]>

* Decrease CPUs for E2E

Signed-off-by: Andrey Velichkevich <[email protected]>

* Install Training Operator for tune workflow

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix comments

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-02-13 11:10:36 +00:00
Mahdi KhashanandGitHub bcdbce7e0f [SDK] improve PVC creation name error (#2496) 
* improve pvc name error message by failing early and clear message with correct name example

Signed-off-by: mahdikhashan <[email protected]>

* fix lint

Signed-off-by: mahdikhashan <[email protected]>

* fix lint

Signed-off-by: mahdikhashan <[email protected]>

* raise value error for wrong name format by reconciliation

Signed-off-by: mahdikhashan <[email protected]>

* revert created utils

Signed-off-by: mahdikhashan <[email protected]>

* improve test case name

Signed-off-by: mahdikhashan <[email protected]>

* improve value error message

Signed-off-by: mahdikhashan <[email protected]>

* improve code flow

Signed-off-by: mahdikhashan <[email protected]>

---------

Signed-off-by: mahdikhashan <[email protected]>
 2025-01-28 00:32:50 +00:00
Hezhi (Helen) XieandGitHub abf8c6c85f [GSoC] Add unit tests for tune API (#2423) 
* add unit tests for tune api

Signed-off-by: helenxie-bit <[email protected]>

* update

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* update unit tests and fix api errors

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* test

Signed-off-by: helenxie-bit <[email protected]>

* test

Signed-off-by: helenxie-bit <[email protected]>

* update unit tests

Signed-off-by: helenxie-bit <[email protected]>

* undo changes to Makefile

Signed-off-by: helenxie-bit <[email protected]>

* delete debug code

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* update unit test

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* update the version of training operator

Signed-off-by: helenxie-bit <[email protected]>

* adjust 'list_namespaced_persistent_volume_claim' to be called with keyword argument

Signed-off-by: helenxie-bit <[email protected]>

* create constant for namespace when check pvc creation error

Signed-off-by: helenxie-bit <[email protected]>

* add type check for 'trainer_parameters'

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* update test names

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* add verification for key Experiment information & add 'kubeflow-training[huggingface' into dependencies

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* add verification for objective metric name

Signed-off-by: helenxie-bit <[email protected]>

* delete unnecessary changes

Signed-off-by: helenxie-bit <[email protected]>

* unify objective function

Signed-off-by: helenxie-bit <[email protected]>

* unify objective function

Signed-off-by: helenxie-bit <[email protected]>

---------

Signed-off-by: helenxie-bit <[email protected]>
 2025-01-24 20:38:21 +00:00
Hezhi (Helen) XieandGitHub 49a2a2749a [SDK] Update tune API (#2497) 
* fix tune api error

Signed-off-by: helenxie-bit <[email protected]>

* delete check for

Signed-off-by: helenxie-bit <[email protected]>

---------

Signed-off-by: helenxie-bit <[email protected]>
 2025-01-22 15:19:27 +00:00
Shao WangandGitHub 807fdc7033 Upgrade grpcio version to v1.64.1 (#2483) 
Signed-off-by: Electronic-Waste <[email protected]>
 2025-01-14 20:35:42 +00:00
Shao WangandGitHub d0847fa6eb fix: remove remaining MXNet dependency. (#2456) 
Signed-off-by: Electronic-Waste <[email protected]>
 2024-12-02 13:23:57 +00:00
Andrey VelichkevichandGitHub 970ab57501 Promote @Electronic-Waste and @helenxie-bit as Katib reviewers (#2439) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-10-11 19:07:12 +00:00
Hezhi (Helen) XieandGitHub 382ef5f0ca [SDK] Fix types error (#2424) 
Signed-off-by: helenxie-bit <[email protected]>
 2024-09-05 16:09:15 +00:00
Hezhi (Helen) XieandGitHub 05b6be71bb [GSoC] Update tune API for LLM hyperparameters optimization (#2393) 
* update tune api for llm hyperparameters optimization

Signed-off-by: helenxie-bit <[email protected]>

* resolve conflict

Signed-off-by: helenxie-bit <[email protected]>

* fix the problem of dependency

Signed-off-by: helenxie-bit <[email protected]>

* fix the format of import statement

Signed-off-by: helenxie-bit <[email protected]>

* adjust the blank lines

Signed-off-by: helenxie-bit <[email protected]>

* delete the trainer to reuse it in Training Operator

Signed-off-by: helenxie-bit <[email protected]>

* update constants

Signed-off-by: helenxie-bit <[email protected]>

* update metrics format

Signed-off-by: helenxie-bit <[email protected]>

* update the type of  and

Signed-off-by: helenxie-bit <[email protected]>

* update the message of 'ImportError'

Signed-off-by: helenxie-bit <[email protected]>

* add TODO of PVC creation

Signed-off-by: helenxie-bit <[email protected]>

* update the name of pvc

Signed-off-by: helenxie-bit <[email protected]>

* reuse constants from Training Operator

Signed-off-by: helenxie-bit <[email protected]>

* keep 'parameters' and update validation

Signed-off-by: helenxie-bit <[email protected]>

* update for test

Signed-off-by: helenxie-bit <[email protected]>

* reuse 'get_container_spec' and 'get_pod_template_spec' from Training Operator

Signed-off-by: helenxie-bit <[email protected]>

* format with black

Signed-off-by: helenxie-bit <[email protected]>

* fix Lint error

Signed-off-by: helenxie-bit <[email protected]>

* fix Lint errors

Signed-off-by: helenxie-bit <[email protected]>

* delete types

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* update format

Signed-off-by: helenxie-bit <[email protected]>

* update format

Signed-off-by: helenxie-bit <[email protected]>

* fix e2e test error

Signed-off-by: helenxie-bit <[email protected]>

* add TODO

Signed-off-by: helenxie-bit <[email protected]>

* format with max line length

Signed-off-by: helenxie-bit <[email protected]>

* format docstring

Signed-off-by: helenxie-bit <[email protected]>

* update format

Signed-off-by: helenxie-bit <[email protected]>

* add helper functions

Signed-off-by: helenxie-bit <[email protected]>

* update format

Signed-off-by: helenxie-bit <[email protected]>

* update format

Signed-off-by: helenxie-bit <[email protected]>

* run test again

Signed-off-by: helenxie-bit <[email protected]>

* run test again

Signed-off-by: helenxie-bit <[email protected]>

* run test again

Signed-off-by: helenxie-bit <[email protected]>

* fix dict substitution in training_parameters

Signed-off-by: helenxie-bit <[email protected]>

* fix typo

Signed-off-by: helenxie-bit <[email protected]>

* resolve conflicts and add check for case of no parameters

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix flake8 error

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* update isort file to black and fix typo

Signed-off-by: helenxie-bit <[email protected]>

* modify the set of metrics format

Signed-off-by: helenxie-bit <[email protected]>

* update tune API

Signed-off-by: helenxie-bit <[email protected]>

* add types.TrainerResources class

Signed-off-by: helenxie-bit <[email protected]>

* fix flake8 error

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* resolve conflict

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* delete properties of 'TrainerResources'

Signed-off-by: helenxie-bit <[email protected]>

* fix format error

Signed-off-by: helenxie-bit <[email protected]>

* update types

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* add import of 'TrainerResources' in '__init__.py' of katib

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* revert changes and rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* check pvc and pv status of katib deployments

Signed-off-by: helenxie-bit <[email protected]>

* check pvc and pv status of katib deployments

Signed-off-by: helenxie-bit <[email protected]>

* recommit changes

Signed-off-by: helenxie-bit <[email protected]>

* update minikube version when setup

Signed-off-by: helenxie-bit <[email protected]>

* delete the code that disables formatting for the tune function

Signed-off-by: helenxie-bit <[email protected]>

* update according to andrey's feedback

Signed-off-by: helenxie-bit <[email protected]>

* add helper function in utils

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* move metrics_collector_spec back & update helper functions & add return type for helper functions

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* fix some typos

Signed-off-by: helenxie-bit <[email protected]>

* simplify the definition of 'TrainerResources'

Signed-off-by: helenxie-bit <[email protected]>

---------

Signed-off-by: helenxie-bit <[email protected]>
 2024-09-03 11:35:14 +00:00
Shao WangandGitHub 62c20c8893 [SDK] fix grpc related bugs in Python SDK (#2398) 
* fix: fix bugs in report_metrics.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: fix bugs in tune.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: fix bugs in get_trial_metrics.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: update .gitignore and setup.py.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: update Makefile.

Signed-off-by: Electronic-Waste <[email protected]>

* feat: add report_metrics_test.py.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: fix lint error.

Signed-off-by: Electronic-Waste <[email protected]>

* feat: add UTs for get_trial_metrics.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: update post_gen.py.

Signed-off-by: Electronic-Waste <[email protected]>

* refactor: rebase to master.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): use single katib_client.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): add TODO for import rewrite.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): fix lint error with black.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): fix lint error with isort.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): reformat import in katib_client_test.py.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
 2024-08-23 11:12:58 +00:00
Ignas BaranauskasandGitHub af0f32db70 Changes isort profile to black, to be fully compatible and adds 'pkg' dir for black and flake8 (#2413) 
* Chnage the isort profile to black, and add pkg dir for black and flake8

Signed-off-by: Ignas Baranauskas <[email protected]>

* Fix the formating

Signed-off-by: Ignas Baranauskas <[email protected]>

* Fix flake8 lint issues

Signed-off-by: Ignas Baranauskas <[email protected]>

---------

Signed-off-by: Ignas Baranauskas <[email protected]>
 2024-08-22 15:33:57 +00:00
Ignas BaranauskasandGitHub bcb199ddc3 Enhance pre-commit hooks with flake8 and black (#2407) 
* Add black formater and flake8 linter to pre-commit

Also add's the flake8 config file

Signed-off-by: Ignas Baranauskas <[email protected]>

* Fixes black formating

Signed-off-by: Ignas Baranauskas <[email protected]>

* Fixes flake8 linting errors

Signed-off-by: Ignas Baranauskas <[email protected]>

---------

Signed-off-by: Ignas Baranauskas <[email protected]>
 2024-08-16 10:13:28 +00:00
Shao WangandGitHub 59960a184e [SDK] test: Add e2e test for tune function. (#2399) 
* fix(sdk): fix error field metrics_collector in tune function.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): Add e2e tests for tune function.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): add missing field parameters.

Signed-off-by: Electronic-Waste <[email protected]>

* refactor(test/sdk): add run-e2e-tune-api.py.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): delete tune testing code in run-e2e-experiment.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): add blank lines.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): add verbose and temporarily delete e2e-experiment test.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): add namespace_labels.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): add time.sleep(5).

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): add error output.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): build random image for tune.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): delete extra debug log.

Signed-off-by: Electronic-Waste <[email protected]>

* refactor(test/sdk): create separate workflow for tune.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): change api to API.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): change the permission of scripts.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): delete exit code & comment image pulling.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): delete image pulling phase.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): refactor workflow file to use template.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): mark experiments and trial-images as not required.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): pass tune-api param to setup-minikube.sh.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): fix err in template-e2e-test.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): add debug logs.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): reorder params and delete logs.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
 2024-08-06 17:50:39 +00:00
Shashank MittalandGitHub 484f7bf253 [GSoC] Added DistributionType to Experiment API (#2377) 
Signed-off-by: Shashank Mittal <[email protected]>

modified feasibleSpace

Removed Categorical from Distribution
 2024-07-31 04:37:05 +00:00
Shashank MittalandGitHub f07a82f9e7 added Distribution field to feasibleSpace in api.proto (#2397) 
Signed-off-by: Shashank Mittal <[email protected]>
 2024-07-26 02:40:55 +00:00
Shao WangandGitHub 1e06458e1f [GSoC] Add New Parameter in tune (#2369) 
* chore: add metrics_collector_config in tune function.

Signed-off-by: Electronic-Waste <[email protected]>

* rebase: rebase feat/new-param-tune to master.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: add metrics collector kind list in comment.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: always pass Trial name to the training container.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: delete passing env variable logics in katib_client.py

Signed-off-by: Electronic-Waste <[email protected]>

* fix: passing env variable KATIB_TRIAL_NAME in the webhook of pod.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: pass env variable KATIB_TRIAL_NAME only to the primary container.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: add report_metrics in post_gen.py.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: change nil error to allErrs(deleted by accident).

Signed-off-by: Electronic-Waste <[email protected]>

* fix: fix lint error in inject_webhook.go.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: wrap env variables passing logics into mutatePodEnv.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: add unit tests for mutatePodEnv.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: delete protocmp.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
 2024-07-18 17:51:57 +00:00
AlexandGitHub 53f3c09d1c Begin enabling pre-commit hooks (#2242) 
* Begin enabling pre-commit hooks

Signed-off-by: droctothorpe <[email protected]>

* Address PR feedback

Signed-off-by: droctothorpe <[email protected]>

---------

Signed-off-by: droctothorpe <[email protected]>
 2024-07-18 17:04:58 +00:00
Andrey VelichkevichandGitHub f81a4254e0 Bump Katib Python SDK to 0.17.0 version (#2379) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-07-15 15:14:55 +00:00
Shao WangandGitHub 22aa00999f [GSoC] New Interface report_metrics in Python SDK (#2371) 
* chore: add report_metrics.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: modify the code according to the first review.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: add validation for metrics value & rename katib_report_metrics.py to report_metrics.py.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: update import path in __init__.py.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: delete blank line.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: update RuntimeError doc string & correct spelling error & add new line.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: delete blank in the last line.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
 2024-07-05 23:41:48 +00:00
Andrey VelichkevichandGitHub 1587e1b5c9 Bump Katib Python SDK to 0.17.0rc1 version (#2365) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-06-20 18:51:00 +00:00
Tariq HasanandGitHub 552d01e8d2 Add unit test for create_experiment in the katib_client module (#2325) 
* added logger for katib_client module

Signed-off-by: tariq-hasan <[email protected]>

* added API_VERSION as a constant

Signed-off-by: tariq-hasan <[email protected]>

* updated the KatibClient constructor to match the TrainingClient constructor

Signed-off-by: tariq-hasan <[email protected]>

* added test for create_experiment in katib_client

Signed-off-by: tariq-hasan <[email protected]>

---------

Signed-off-by: tariq-hasan <[email protected]>
 2024-06-20 15:34:00 +00:00
Andrey VelichkevichandGitHub 5748c7e855 [SDK] Fix empty list for env variables and numpy version (#2360) 
* [SDK] Fix empty list for env variables

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix numpy version in tests

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-06-18 06:57:58 +00:00
Yuki IwaiandGitHub 589162bf53 Upgrade the protobuf version to >=4.21.12,<5 (#2358) 
Signed-off-by: Yuki Iwai <[email protected]>
 2024-06-17 10:51:57 +00:00
Andrey VelichkevichandGitHub 1483a0757f [SDK] Explain Python version support cycle (#2354) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-06-13 08:25:08 +00:00
Yuki IwaiandGitHub d44750aa44 Drop Python 3.7 and Support Python 3.11 in the SDK (#2337) 
Signed-off-by: Yuki Iwai <[email protected]>
 2024-05-29 13:39:15 +00:00
Andrey VelichkevichandGitHub 8eac337e98 Bump Katib Python SDK to 0.17.0rc0 Version (#2318) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-04-30 14:06:50 +00:00
Yuki IwaiandGitHub 91236421fd Drop Kubernetes v1.26, and support Kubernetes v1.29 (#2308) 
Signed-off-by: Yuki Iwai <[email protected]>
 2024-04-15 10:55:51 +00:00
Andrey VelichkevichandGitHub fd6cc4c982 [SDK] Fix env per Trial parameter in tune API (#2304) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-04-11 07:09:47 +00:00
Bharath K BalajiandGitHub 4ebeb8afb3 Python SDK - Generate Name functionality for creating experiments. (#2272) 
* added dco

Signed-off-by: Bharath Krishna <[email protected]>

* updated condition

Signed-off-by: Bharath Krishna <[email protected]>

* added exception to catch missing name and generateName

Signed-off-by: Bharath Krishna <[email protected]>

* updated experiment_name in create_experiment

Signed-off-by: Bharath Krishna <[email protected]>

* py sdk create_exp - added type validation

Signed-off-by: Bharath Krishna <[email protected]>

* added dco

Signed-off-by: Bharath Krishna <[email protected]>

* updated condition

Signed-off-by: Bharath Krishna <[email protected]>

* added exception to catch missing name and generateName

Signed-off-by: Bharath Krishna <[email protected]>

* updated experiment_name in create_experiment

Signed-off-by: Bharath Krishna <[email protected]>

* py sdk create_exp - added type validation

Signed-off-by: Bharath Krishna <[email protected]>

---------

Signed-off-by: Bharath Krishna <[email protected]>
 2024-04-02 14:18:22 +00:00
Yuki IwaiandGitHub c901d9e8f4 Upgrade PyTorch version to v2.2.1 (#2279) 
Signed-off-by: Yuki Iwai <[email protected]>
 2024-03-12 00:07:10 +00:00
Shi PengchengandGitHub 2041db6645 [SDK] Add env & env_from in client tune (#2235) 
* add env & env_from spec

* unify env and env_from specs
 2023-11-17 09:33:08 +00:00
Andrey VelichkevichandGitHub 6cb03639be Bump Katib Python SDK to 0.16.0 version (#2238) 2023-11-03 03:06:52 +00:00
Shi PengchengandGitHub 40d4c72a73 [SDK] Add 'algorithm_settings' in client tune (#2227) 2023-10-05 10:22:15 +00:00
AlexGitHubandreafehrmanharrisonfritz
 		74b73ef354 [SDK] Raise more human-readable name conflict exception (#2199) 
Co-authored-by: andreafehrman <[email protected]>
Co-authored-by: harrisonfritz <[email protected]>
 2023-09-07 22:21:33 +00:00
Andrey VelichkevichandGitHub cde1580f53 Bump Katib Python SDK to 0.16.0rc1 version (#2217) 2023-08-16 16:07:03 +00:00
Yuki IwaiandGitHub 6875c76a7d Upgrade Tensorflow version to v2.13.0 (#2201) 
Signed-off-by: Yuki Iwai <[email protected]>
 2023-08-15 23:09:03 +00:00
Andrey VelichkevichandGitHub cb1426f9b4 Bump Katib Python SDK to 0.16.0rc0 version (#2205) 2023-08-15 15:18:03 +00:00
AlexGitHubshipengcheng1230Andrey Velichkevich
 		1b19f7705c [SDK] Enable resource specification for trial containers (#2192) 
Co-authored-by: shipengcheng1230 <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
 2023-08-05 10:46:54 +00:00
AlexGitHubandreafehrmanryanrussonAndrey Velichkevich
 		bd285fe96f [SDK] Add namespace parameter to KatibClient (#2183) 
* [SDK] Add namespace parameter to KatibClient

Co-authored-by: andreafehrman <[email protected]>
Co-authored-by: ryanrusson <[email protected]>

* Update sdk/python/v1beta1/kubeflow/katib/api/katib_client.py

Co-authored-by: Andrey Velichkevich <[email protected]>

---------

Co-authored-by: andreafehrman <[email protected]>
Co-authored-by: ryanrusson <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
 2023-08-01 15:18:08 +00:00
Andrey VelichkevichandGitHub 00faa70d8e SDK: Import all Kubernetes Models (#2148) 2023-04-20 16:56:40 +00:00
Yuki IwaiandGitHub 1ece48ac68 Relax dependencies restriction for the gRPC libraries (#2140) 
Signed-off-by: Yuki Iwai <[email protected]>
 2023-04-03 16:48:01 +00:00