Files
katib/test
Hezhi (Helen) XieandGitHub 2031c75535 [GSoC] Add e2e test for tune api with LLM hyperparameter optimization (#2420)
* add e2e test for tune api

Signed-off-by: helenxie-bit <[email protected]>

* upgrade training-operator sdk

Signed-off-by: helenxie-bit <[email protected]>

* specify the version of training operator sdk

Signed-off-by: helenxie-bit <[email protected]>

* fix num_labels error and update the version of training operator controller

Signed-off-by: helenxie-bit <[email protected]>

* check the version of training operator

Signed-off-by: helenxie-bit <[email protected]>

* debug

Signed-off-by: helenxie-bit <[email protected]>

* check import path of HuggingFaceModelParams

Signed-off-by: helenxie-bit <[email protected]>

* update the version of training operator sdk

Signed-off-by: helenxie-bit <[email protected]>

* update the name of experiment

Signed-off-by: helenxie-bit <[email protected]>

* add step of checking pod

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of pod

Signed-off-by: helenxie-bit <[email protected]>

* add check

Signed-off-by: helenxie-bit <[email protected]>

* check reason for imagepullbackoff

Signed-off-by: helenxie-bit <[email protected]>

* revert timeout limit

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* extend timeout limit

Signed-off-by: helenxie-bit <[email protected]>

* update training operator sdk version

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of pod

Signed-off-by: helenxie-bit <[email protected]>

* rerun tests

Signed-off-by: helenxie-bit <[email protected]>

* update the function of getting logs

Signed-off-by: helenxie-bit <[email protected]>

* add the step of describing pod

Signed-off-by: helenxie-bit <[email protected]>

* check disk space

Signed-off-by: helenxie-bit <[email protected]>

* change work directory

Signed-off-by: helenxie-bit <[email protected]>

* change work directory

Signed-off-by: helenxie-bit <[email protected]>

* increase timeout limit

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of controller and events

Signed-off-by: helenxie-bit <[email protected]>

* change work directory

Signed-off-by: helenxie-bit <[email protected]>

* change work directory

Signed-off-by: helenxie-bit <[email protected]>

* change work directory

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of kubelet

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of kubelet

Signed-off-by: helenxie-bit <[email protected]>

* increase cpu

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of training operator

Signed-off-by: helenxie-bit <[email protected]>

* check the use of resources

Signed-off-by: helenxie-bit <[email protected]>

* check the logs of container 'pytorch' and 'storage_initializer'

Signed-off-by: helenxie-bit <[email protected]>

* fix error of checking use of resources

Signed-off-by: helenxie-bit <[email protected]>

* add other checks to find the error reason

Signed-off-by: helenxie-bit <[email protected]>

* set 'storage_config'

Signed-off-by: helenxie-bit <[email protected]>

* reduce the number of tests

Signed-off-by: helenxie-bit <[email protected]>

* Check container runtime logs

Signed-off-by: helenxie-bit <[email protected]>

* set the driver of minikube as docker

Signed-off-by: helenxie-bit <[email protected]>

* set the driver of minikube to none

Signed-off-by: helenxie-bit <[email protected]>

* check logs of pod

Signed-off-by: helenxie-bit <[email protected]>

* check memory usage

Signed-off-by: helenxie-bit <[email protected]>

* increase 'termination_grace_period_seconds' in podspec

Signed-off-by: helenxie-bit <[email protected]>

* fix annotations error

Signed-off-by: helenxie-bit <[email protected]>

* restart docker

Signed-off-by: helenxie-bit <[email protected]>

* delete restarting docker

Signed-off-by: helenxie-bit <[email protected]>

* use original docker data directory

Signed-off-by: helenxie-bit <[email protected]>

* update installation of Katib SDK with extra requires

Signed-off-by: helenxie-bit <[email protected]>

* test trainer image built with cpu

Signed-off-by: helenxie-bit <[email protected]>

* add action of free up disk space (including move docker data directory)

Signed-off-by: helenxie-bit <[email protected]>

* delete unnecessary checks and update the part of fetching pod description and logs

Signed-off-by: helenxie-bit <[email protected]>

* delete fetching pod logs

Signed-off-by: helenxie-bit <[email protected]>

* add blank line at the end of free-up-disk-space yaml file

Signed-off-by: helenxie-bit <[email protected]>

* update experiment name

Signed-off-by: helenxie-bit <[email protected]>

* update test function name to be consistent with experiment name

Signed-off-by: helenxie-bit <[email protected]>

* move import statements inside the function

Signed-off-by: helenxie-bit <[email protected]>

* apply pprint for the logging output

Signed-off-by: helenxie-bit <[email protected]>

* update experiment names

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix the sequence of arguments in 'trial_template'

Signed-off-by: helenxie-bit <[email protected]>

* test example in user guide

Signed-off-by: helenxie-bit <[email protected]>

* fix access token error

Signed-off-by: helenxie-bit <[email protected]>

* fix the error of setup

Signed-off-by: helenxie-bit <[email protected]>

* fix the error of setup

Signed-off-by: helenxie-bit <[email protected]>

* reverse back

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

* fix format

Signed-off-by: helenxie-bit <[email protected]>

---------

Signed-off-by: helenxie-bit <[email protected]>
2025-06-26 14:13:16 +00:00
..