* Consolidate the katib-cert-generator to the katib-controller
Signed-off-by: Yuki Iwai <[email protected]>
* Use deployed secret instead of creating a new secret when the cert-generator saves certs on secret
Signed-off-by: Yuki Iwai <[email protected]>
* Rename secretName with webhookSecretName in the .init.certGenerator
Signed-off-by: Yuki Iwai <[email protected]>
* Fix manifests
Signed-off-by: Yuki Iwai <[email protected]>
* Remove unneeded comments
Signed-off-by: Yuki Iwai <[email protected]>
* Restore unintentionally deleted log
Signed-off-by: Yuki Iwai <[email protected]>
* Rename package cert-generator with certgenerator
Signed-off-by: Yuki Iwai <[email protected]>
* Add test cases to check if the enable is set to true when the webhookServiceName or webhookSecretName is set
Signed-off-by: Yuki Iwai <[email protected]>
* Update the developer guide
Signed-off-by: Yuki Iwai <[email protected]>
* Swap livness probe and readiness probe
Signed-off-by: Yuki Iwai <[email protected]>
* Introduce SSA to the cert-generator
Signed-off-by: Yuki Iwai <[email protected]>
* Use the same member names between CertGenerator and KatibConfig
Signed-off-by: Yuki Iwai <[email protected]>
* Disable leader election on the cert-generator
Signed-off-by: Yuki Iwai <[email protected]>
* Drop unneeded fields from SSA patches
Signed-off-by: Yuki Iwai <[email protected]>
---------
Signed-off-by: Yuki Iwai <[email protected]>
* implement postgres for katib db
* fix yaml lint
* apply go mod tidy
* Update manifests/v1beta1/components/postgres/postgres.yaml
Co-authored-by: Yuki Iwai <[email protected]>
* refactoring by reviews
- split openconnection to common packages
- add unit test for postgres db
* change to install only mysql by default
* remove useless import
* add postgres kustomization and e2e test for it
* change mysql installation files to be variable
* fix shell scripts
* fix lint
* fix image name
* set default value on github action workflow
* make postgres deployment to use pvc
* temporarily comments
* uncomment invalid experiments
* test with for loop
* sleep until controller created well
* add some comments
* Update pkg/db/v1beta1/postgres/postgres.go
Co-authored-by: Yuki Iwai <[email protected]>
* Update pkg/db/v1beta1/postgres/postgres_test.go
Co-authored-by: Yuki Iwai <[email protected]>
* refactor by reviews
Co-authored-by: Yuki Iwai <[email protected]>
* docs: update new algorithm service details
* feat: trial augmentation strategy
* feat: pbt suggestion service
* feat: PbtTemplate and associated test image
* feat: introduce annotation field to trial specifications
* feat: trial assignment changes to support annotations from suggestion
- Add new Annotation types to suggestion_types.go
- Add Annotation object and update Trial parser in trial.py
* feat: update pbt suggestion to use new Annotation api
- Suggestion uses exact match to track spawned trials
- Trials that get transmitted, but not created (or added to experiment) are added back to the respawn pool (population_size consistency)
* chore: gofmt and black run across PBT changes
* feedback: remove tf summary export, change default print unit, reduce range to be percentage compatible.
* feedback: move PBT template to example.
* feedback: changes to inject_webhook and utils.
- Rename mutateVolume to mutateMetricsCollectorVolume
- Add addContainerVolumeMount
- Add getPrimaryContainerIndex
* feedback: change suggestion mutation mount variable name and add to consts
* feedback: Add trial_names to GetSuggestionsReply and change suggestion path to <experiment>/<trial>
* feedback: removed unnecessary checks and moved to async pbt implementation
* feedback: update trial name override location and change annotations override to labels.
* feedback: add pbt to github workflow
* feedback: move labels to ParameterAssignments in GetSuggestionsReply and cleanup pbt.yaml.
* feedback: remove operator changes
* feedback: GHA updates
* feedback: new formatting changes
* feedback: add suggestion-pbt to gh-actions build-load.sh.
* fix: missing pbt->simple-pbt name changes, add simple-pbt to update-images.sh update yaml function (causing failing gha).
* feedback: add pointer to website from main readme for pbt
* migrate test-infra to GitHub Actions
* change python base image to python:3.9-slim
* move from minikube to kind
* separate darts container images by device type
* run e2e test with multi kubernetes version
* disble to deploy katib-ui by default
* change kind kubernetes cluster version
* fix update-images.sh
* fix shellcheck
* fix script to setup katib
* split enas, darts and tf-mnist-with-summaries with trial images
* specicy experiments in pytorch-mnist-e2e-test
* reduce storage size for mysql
* fix trial image name for enas and darts
* fix trial image name for file-metrics-collector-with-json-format
* change kubernetes versions
* do not run e2e test on push master branch
* remove backoffLimit field in examples
* bump Python to 3.9
* modify script to build container image
* fix example for enas
* update scripts to modify image name in ci
* review: change docker build command
* review: use new tf-mnist-with-example in Ci for tfjob
* review: refactor tf-mnist-with-summaries
* review: remove Dockerfile.ppc64le for new-ui
* review: update docs related tf-mnist-with-summaries
* TFEventMetricsCollector supports TF>=2.0 and stop supporting TF <=1.x
* review: add help command to scripts/v1beta1/build.sh
Co-authored-by: Andrey Velichkevich <[email protected]>
* fix unit test for tfevent-metricscollector
* review: generate tf event files on CI
* add test command to Makefile
* update publish-trial-images
* update update-images.sh
* reduce batch size
Co-authored-by: Andrey Velichkevich <[email protected]>
* Implement Optuna service and cmd
* Update pkg/suggestion/v1beta1/optuna/service.py
Co-authored-by: Andrey Velichkevich <[email protected]>
* Update pkg/suggestion/v1beta1/optuna/service.py
Co-authored-by: Andrey Velichkevich <[email protected]>
* Update pkg/suggestion/v1beta1/optuna/service.py
Co-authored-by: Andrey Velichkevich <[email protected]>
* Update pkg/suggestion/v1beta1/optuna/service.py
Co-authored-by: Andrey Velichkevich <[email protected]>
* Merge the blocks of self.lock in OptunaService
* Remove Cython installation
* Update Python version for the Optuna suggestion service
* Add the example yaml of multivarite-tpe
* Fix the logic of handling unknown trials
* Use name and value instead of the string representation of assignment
* Turn on constant liar by default
Co-authored-by: Andrey Velichkevich <[email protected]>
* Change default image for Katib UI
* Change title for UI
* Fix image name
* Use katib-ui image for the new UI
* Remove build from CI workflow
* Add cache to Kaniko
* Add cache repo
* Add other cache repo
* Remove cache
* fix kustomize manifests for kubeflow
* fix standalone and external-db manifests
* remove old namespace file
* remove PV from kubeflow manifest
* fix katib-external-db reference outside of root
* fix katib-with-kubeflow-cert-manager
* Move image tags to katib-config.yaml and remove patches
* use common namespace kustomization
* Make kubeflow-cert use kubeflow as a base
* Remove katib-cert-generator job from kubeflow-cert-generator manifests
* Move pv-patch to patches folder
* Create katib-cert-manager and make kubeflowuse this as base
* Fix release and CI scripts for new layout
* Remove unnecessary cert-generator images from kustomization.yaml
* Remove unnecessary SA, CR and CRB from katib-cert-manager
* Remove commonLabel from katib-with-kubeflow
* Separate cert-generator from webhook kustomization
* Update boilerplate for clients
* Modify not format boilerplate
* Modify boilerplate script for go files
* Update boilerplate manually for go files
* Modify script
* Generate boilerplate for Go files
* Add script for Python files
* Generate boilerplate for the Py files
* Include shell
* Generate boilerplate for shell scripts
* Add to makefile
* Fix comments
* Change comments
* Refactor kustomize manifests
* Remove file
* Modify README
* Disable actions
* Update Trial images tag to v1beta1-c1f27e0
* Fix few comments
* Remove test print
* Remove image pull policy
* Remove TODOs
* Exclude PV from Kubeflow install
Add image versions to katib-external-db install
* Rename Katib IBM install
* Create patch file for Katib config
* Fix path for MC
* Fix var name
* Change tag in patch file
* Change download mnist for mxnet example
* Change MNIST to FashionMNIST
* Remove comment from actions
* Fix image for MXNET mnist
Rename example folder for PyTorch mnist
* Add build process for Katib Trial template in the CI
Fix problems with current image build
* Change release registry to kubeflowkatib
* Few changes
* Simplify sed for mnist
* Add script to change trial images
* Modify script
* Add if for macos
* Enable PyTorch examples
* Remove test print
* Update all dependencies to the latest versions
Add cert generator for the webhooks
Add manifests for the webhooks
* Modify Dockerfile for manager
* Remove comments
* Update Dockerfiles for Go images
* Add signerName: kubernetes.io/kube-apiserver-client to csr
Update roles for controller RBAC
Changes after review
* Fix not installed CRD error
* Update scripts
* Revert operator changes
* Describe controller pod in test
* Add log line to test
* Move kubectl version
* Change csr version to v1beta1
* Remove log
* Change signerName to kubernetes.io/kubelet-serving
* Modify common name
Co-authored-by: Yuki Iwai <[email protected]>
* Add env variable to init container
Co-authored-by: Yuki Iwai <[email protected]>
* Get namespace from env
Co-authored-by: Yuki Iwai <[email protected]>
* Remove quotes
* Remove spaces
* Run cert generator script from the Job
* Modify new ui Dockerfile
* Disable Actions on PR
* Modify setup Katib script
* Fix PODNUM
* Remove imagePullPolicy from PyTorch and TFJob examples
* Disable Pytorch examples in e2e
* Add sleep to e2e test
* Activate Actions
* Disable actions
Co-authored-by: Yuki Iwai <[email protected]>
