37 Commits
Author SHA1 Message Date
Andrey VelichkevichandGitHub 389b4de95b Bump Katib Python SDK to 0.19.0 version (#2585)
* Bump Katib Python SDK to 0.19.0 version

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update version in gen-api

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix release script

Signed-off-by: Andrey Velichkevich <[email protected]>

* Run gen-api directly

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-10-30 23:52:38 +00:00
Andrey VelichkevichandGitHub 203bbf93a0 Bump Katib Python SDK to 0.18.0rc0 version (#2514)
Signed-off-by: Andrey Velichkevich <[email protected]>
2025-02-13 18:05:36 +00:00
Andrey VelichkevichandGitHub 96f3ed1b5f [SDK] Support PyTorchJob as a Trial Worker (#2512)
* [SDK] Support PyTorchJob as Trial Worker

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix pod spec for Job

Signed-off-by: Andrey Velichkevich <[email protected]>

* Set default restart_policy to Never

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix primary_container_name for PyTorchJob

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add unit tests for PyTorchJob as Trial

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add e2e test for PyTorchJob as Trial

Signed-off-by: Andrey Velichkevich <[email protected]>

* Bump kubeflow-training SDK

Signed-off-by: Andrey Velichkevich <[email protected]>

* Deploy Training Operator with server side apply

Signed-off-by: Andrey Velichkevich <[email protected]>

* Decrease CPUs for E2E

Signed-off-by: Andrey Velichkevich <[email protected]>

* Install Training Operator for tune workflow

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix comments

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-02-13 11:10:36 +00:00
Hezhi (Helen) XieandGitHub 49a2a2749a [SDK] Update tune API (#2497)
* fix tune api error

Signed-off-by: helenxie-bit <[email protected]>

* delete check for

Signed-off-by: helenxie-bit <[email protected]>

---------

Signed-off-by: helenxie-bit <[email protected]>
2025-01-22 15:19:27 +00:00
Shao WangandGitHub 807fdc7033 Upgrade grpcio version to v1.64.1 (#2483)
Signed-off-by: Electronic-Waste <[email protected]>
2025-01-14 20:35:42 +00:00
Hezhi (Helen) XieandGitHub 05b6be71bb [GSoC] Update tune API for LLM hyperparameters optimization (#2393)
* update tune api for llm hyperparameters optimization

Signed-off-by: helenxie-bit <[email protected]>

* resolve conflict

Signed-off-by: helenxie-bit <[email protected]>

* fix the problem of dependency

Signed-off-by: helenxie-bit <[email protected]>

* fix the format of import statement

Signed-off-by: helenxie-bit <[email protected]>

* adjust the blank lines

Signed-off-by: helenxie-bit <[email protected]>

* delete the trainer to reuse it in Training Operator

Signed-off-by: helenxie-bit <[email protected]>

* update constants

Signed-off-by: helenxie-bit <[email protected]>

* update metrics format

Signed-off-by: helenxie-bit <[email protected]>

* update the type of  and

Signed-off-by: helenxie-bit <[email protected]>

* update the message of 'ImportError'

Signed-off-by: helenxie-bit <[email protected]>

* add TODO of PVC creation

Signed-off-by: helenxie-bit <[email protected]>

* update the name of pvc

Signed-off-by: helenxie-bit <[email protected]>

* reuse constants from Training Operator

Signed-off-by: helenxie-bit <[email protected]>

* keep 'parameters' and update validation

Signed-off-by: helenxie-bit <[email protected]>

* update for test

Signed-off-by: helenxie-bit <[email protected]>

* reuse 'get_container_spec' and 'get_pod_template_spec' from Training Operator

Signed-off-by: helenxie-bit <[email protected]>

* format with black

Signed-off-by: helenxie-bit <[email protected]>

* fix Lint error

Signed-off-by: helenxie-bit <[email protected]>

* fix Lint errors

Signed-off-by: helenxie-bit <[email protected]>

* delete types

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* update format

Signed-off-by: helenxie-bit <[email protected]>

* update format

Signed-off-by: helenxie-bit <[email protected]>

* fix e2e test error

Signed-off-by: helenxie-bit <[email protected]>

* add TODO

Signed-off-by: helenxie-bit <[email protected]>

* format with max line length

Signed-off-by: helenxie-bit <[email protected]>

* format docstring

Signed-off-by: helenxie-bit <[email protected]>

* update format

Signed-off-by: helenxie-bit <[email protected]>

* add helper functions

Signed-off-by: helenxie-bit <[email protected]>

* update format

Signed-off-by: helenxie-bit <[email protected]>

* update format

Signed-off-by: helenxie-bit <[email protected]>

* run test again

Signed-off-by: helenxie-bit <[email protected]>

* run test again

Signed-off-by: helenxie-bit <[email protected]>

* run test again

Signed-off-by: helenxie-bit <[email protected]>

* fix dict substitution in training_parameters

Signed-off-by: helenxie-bit <[email protected]>

* fix typo

Signed-off-by: helenxie-bit <[email protected]>

* resolve conflicts and add check for case of no parameters

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix flake8 error

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* update isort file to black and fix typo

Signed-off-by: helenxie-bit <[email protected]>

* modify the set of metrics format

Signed-off-by: helenxie-bit <[email protected]>

* update tune API

Signed-off-by: helenxie-bit <[email protected]>

* add types.TrainerResources class

Signed-off-by: helenxie-bit <[email protected]>

* fix flake8 error

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* resolve conflict

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* delete properties of 'TrainerResources'

Signed-off-by: helenxie-bit <[email protected]>

* fix format error

Signed-off-by: helenxie-bit <[email protected]>

* update types

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* add import of 'TrainerResources' in '__init__.py' of katib

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* revert changes and rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* check pvc and pv status of katib deployments

Signed-off-by: helenxie-bit <[email protected]>

* check pvc and pv status of katib deployments

Signed-off-by: helenxie-bit <[email protected]>

* recommit changes

Signed-off-by: helenxie-bit <[email protected]>

* update minikube version when setup

Signed-off-by: helenxie-bit <[email protected]>

* delete the code that disables formatting for the tune function

Signed-off-by: helenxie-bit <[email protected]>

* update according to andrey's feedback

Signed-off-by: helenxie-bit <[email protected]>

* add helper function in utils

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* move metrics_collector_spec back & update helper functions & add return type for helper functions

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* fix some typos

Signed-off-by: helenxie-bit <[email protected]>

* simplify the definition of 'TrainerResources'

Signed-off-by: helenxie-bit <[email protected]>

---------

Signed-off-by: helenxie-bit <[email protected]>
2024-09-03 11:35:14 +00:00
Shao WangandGitHub 62c20c8893 [SDK] fix grpc related bugs in Python SDK (#2398)
* fix: fix bugs in report_metrics.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: fix bugs in tune.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: fix bugs in get_trial_metrics.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: update .gitignore and setup.py.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: update Makefile.

Signed-off-by: Electronic-Waste <[email protected]>

* feat: add report_metrics_test.py.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: fix lint error.

Signed-off-by: Electronic-Waste <[email protected]>

* feat: add UTs for get_trial_metrics.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: update post_gen.py.

Signed-off-by: Electronic-Waste <[email protected]>

* refactor: rebase to master.

Signed-off-by: Electronic-Waste <[email protected]>

* test(sdk): use single katib_client.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): add TODO for import rewrite.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): fix lint error with black.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): fix lint error with isort.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): reformat import in katib_client_test.py.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
2024-08-23 11:12:58 +00:00
AlexandGitHub 53f3c09d1c Begin enabling pre-commit hooks (#2242)
* Begin enabling pre-commit hooks

Signed-off-by: droctothorpe <[email protected]>

* Address PR feedback

Signed-off-by: droctothorpe <[email protected]>

---------

Signed-off-by: droctothorpe <[email protected]>
2024-07-18 17:04:58 +00:00
Andrey VelichkevichandGitHub f81a4254e0 Bump Katib Python SDK to 0.17.0 version (#2379)
Signed-off-by: Andrey Velichkevich <[email protected]>
2024-07-15 15:14:55 +00:00
Andrey VelichkevichandGitHub 1587e1b5c9 Bump Katib Python SDK to 0.17.0rc1 version (#2365)
Signed-off-by: Andrey Velichkevich <[email protected]>
2024-06-20 18:51:00 +00:00
Yuki IwaiandGitHub 589162bf53 Upgrade the protobuf version to >=4.21.12,<5 (#2358)
Signed-off-by: Yuki Iwai <[email protected]>
2024-06-17 10:51:57 +00:00
Yuki IwaiandGitHub d44750aa44 Drop Python 3.7 and Support Python 3.11 in the SDK (#2337)
Signed-off-by: Yuki Iwai <[email protected]>
2024-05-29 13:39:15 +00:00
Andrey VelichkevichandGitHub 8eac337e98 Bump Katib Python SDK to 0.17.0rc0 Version (#2318)
Signed-off-by: Andrey Velichkevich <[email protected]>
2024-04-30 14:06:50 +00:00
Yuki IwaiandGitHub 91236421fd Drop Kubernetes v1.26, and support Kubernetes v1.29 (#2308)
Signed-off-by: Yuki Iwai <[email protected]>
2024-04-15 10:55:51 +00:00
Andrey VelichkevichandGitHub 6cb03639be Bump Katib Python SDK to 0.16.0 version (#2238) 2023-11-03 03:06:52 +00:00
Andrey VelichkevichandGitHub cde1580f53 Bump Katib Python SDK to 0.16.0rc1 version (#2217) 2023-08-16 16:07:03 +00:00
Andrey VelichkevichandGitHub cb1426f9b4 Bump Katib Python SDK to 0.16.0rc0 version (#2205) 2023-08-15 15:18:03 +00:00
Yuki IwaiandGitHub 1ece48ac68 Relax dependencies restriction for the gRPC libraries (#2140)
Signed-off-by: Yuki Iwai <[email protected]>
2023-04-03 16:48:01 +00:00
Andrey VelichkevichandGitHub f6149c0312 Bump Katib Python SDK to 0.15.0 version (#2130) 2023-03-22 18:09:44 +00:00
Andrey VelichkevichandGitHub 0b651d0075 Bump Katib Python SDK to 0.15.0rc1 version (#2121) 2023-02-15 19:50:36 +00:00
Andrey VelichkevichandGitHub cfe5b1c2ea Bump Katib Python SDK to 0.15.0rc0 version (#2105) 2023-01-28 00:10:02 +00:00
Andrey VelichkevichandGitHub 268e68e9ab [SDK] Use Katib SDK for E2E Tests (#2075)
* [SDK] Use Katib SDK for E2E tests

* Fix pvc deletion

* Add list_suggestions API

* Remove wait from edit Experiment function

* Add shell to GitHub action

* Add protobuf package to Katib SDK

* Add Experiment Timeout to 40 min

* Modify SDK Examples

* Fix example text

* Change to custom_api

* Enable verbose logging for Katib E2E

* Use expected condition arg

* Add timeout and delete options

* Modify logging to debug

* Use read API to check resource status
2023-01-16 16:40:59 +00:00
Andrey VelichkevichandGitHub 62d6a41c7b [SDK] Get Trial Metrics from Katib DB (#2050)
* [SDK] Get Trial Metrics from Katib DB

* Always Copy gRPC API File
2022-12-09 03:56:11 +00:00
b96916f6fc Create Tune API in the Katib SDK (#1951)
* Create Tune API in the Katib SDK

* Add Final to consts
Modify packages_to_install doc
Create validate objective function

* Add GPU TF Image
Change k8s version package

* Create search module

* Fix link in README

Co-authored-by: Yuki Iwai <[email protected]>

* Fix licence date

Co-authored-by: Yuki Iwai <[email protected]>
2022-10-04 21:19:22 +00:00
Johnu GeorgeandGitHub 46ba7a9d28 Update Katib SDK version (#1931) 2022-08-19 09:30:53 +00:00
Johnu GeorgeandGitHub 4ee9abe83e Update sdk version to 0.13.0 version (#1832) 2022-03-07 10:57:54 +00:00
Andrey VelichkevichandGitHub dc573a779b Bump Katib Python SDK to 0.13.0rc1 version (#1814) 2022-02-15 19:21:41 +00:00
Yuki IwaiandGitHub c5f572640e Update supported Python version for kubeflow-katib SDK (#1797)
* update supported Python version for kubeflow-katib SDK

* stop supporting Python2
2022-01-26 16:24:44 +00:00
Andrey VelichkevichandGitHub d7b67b6dd8 Bump Katib Python SDK to 0.13.0rc0 version (#1793) 2022-01-25 14:59:19 +00:00
Andrey VelichkevichandGitHub 4359fef8e4 Bump Katib Python SDK to 0.12.0 version (#1694) 2021-10-06 00:36:08 -07:00
Andrey VelichkevichandGitHub 3b0bca68aa Bump Katib Python SDK to 0.12.0rc1 version (#1660) 2021-09-16 09:45:55 -07:00
Andrey VelichkevichandGitHub 24254f524e Bump Katib Python SDK to 0.12.0rc0 version (#1640) 2021-08-26 10:43:05 -07:00
Andrey VelichkevichandGitHub 558e1c5aeb Add script to update boilerplate (#1491)
* Update boilerplate for clients

* Modify not format boilerplate

* Modify boilerplate script for go files

* Update boilerplate manually for go files

* Modify script

* Generate boilerplate for Go files

* Add script for Python files

* Generate boilerplate for the Py files

* Include shell

* Generate boilerplate for shell scripts

* Add to makefile

* Fix comments

* Change comments
2021-03-19 23:48:17 -07:00
Andrey VelichkevichandGitHub 2e226de7e5 Remove v1alpha3 version (#1396)
* Remove v1alpha3 files

* Modify SDK

* Change dict() to object
2020-11-30 06:48:50 -08:00
Andrey VelichkevichandGitHub c53edbcb05 Update Python SDK version to 0.10.0 (#1378)
* Update SDK version to 0.10.0

* Fix

* Add sdk to prow
2020-11-06 05:16:51 -08:00
Andrey VelichkevichandGitHub 2992c5706f Upload python SDK version (#1335)
* Upload 0.0.4 SDK version

* Fix doc links

* Fix links in README

* Modify tables

* Fix link

* Remove

* Modify client and gen script

* Update version to 0.0.5

* Run CI

* Add Katib client to init
2020-09-15 02:42:07 -07:00
Xu XiaoandGitHub 6c07d26b78 [python sdk] add v1beta1 models (#1252)
* [python sdk] add v1beta1 models

* upgrade version of python SDK to 0.0.3

* remove v1Alpha3 python sdk

* add some python models manually: v1Time and V1UnstructuredUnstructured

* bring back v1alpha3

* create separate python sdk for v1alpha3 and v1beta1

* move on

* release pkg on pypi.org

* remove dist files

* refine
2020-08-18 03:11:32 -07:00