hanzo-ml/trainer
1
0
Fork 0
mirror of https://github.com/hanzo-ml/trainer.git synced 2026-09-24 00:31:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,101 Commits 2 Branches 1 Tag
dc299c59cd6ed6bdda8ea0587e7bbf6f9cc67406
Commit Graph
22 Commits
Author SHA1 Message Date
Andrey VelichkevichandGitHub 93977ad4f3 Bump Training Python SDK to 1.8.1 version (#2257) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-09-10 13:00:20 +00:00
Andrey VelichkevichandGitHub 0615ea1fca Bump Training Python SDK to 1.8.0 version (#2172) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-07-18 21:46:58 +00:00
Andrey VelichkevichandGitHub 5b9d22af13 [SDK] Sync Transformers version for train API (#2146) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-06-14 14:27:10 +00:00
Christophe BrownGitHubChristophe Brown
 		af29559386 changed package name to flake8 to fix pytests pip install (#2109) 
Signed-off-by: Christophe Brown <[email protected]>
Co-authored-by: Christophe Brown <[email protected]>
 2024-05-10 14:31:45 +00:00
Yuki IwaiandGitHub f310db59a8 Support Python 3.11 and Drop Python 3.7 (#2105) 
Signed-off-by: Yuki Iwai <[email protected]>
 2024-05-09 20:58:45 +00:00
Yuki IwaiandGitHub 3d741b0995 SDK: Upgrade the minimum required Kubernetes version to v1.27.2 (#2066) 
Signed-off-by: Yuki Iwai <[email protected]>
 2024-04-15 12:59:51 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		b24d26c474 Bump black from 21.12b0 to 24.3.0 in /sdk/python (#2033) 
Bumps [black](https://github.com/psf/black) from 21.12b0 to 24.3.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/commits/24.3.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-03-25 14:01:18 +00:00
Andrey VelichkevichandGitHub 8634427e4d Modify LLM Trainer to support BERT and Tiny LLaMA (#2031) 
* Modify LLM Trainer to support BERT and Tiny LLaMA

Signed-off-by: Andrey Velichkevich <[email protected]>

* Access PVC access modes to storage config

Signed-off-by: Andrey Velichkevich <[email protected]>

* Format Python files

Signed-off-by: Andrey Velichkevich <[email protected]>

* Distribute datasets

Fix access modes in storage config

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update example to fine tune BERT with Train API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove dataset download twice

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2024-03-15 19:28:30 +00:00
Gary MiguelandGitHub d365c12b0e Fix URL in python SDK setup.py (#2011) 
Signed-off-by: Gary Miguel <[email protected]>
 2024-03-01 23:29:05 +00:00
Andrey VelichkevichandGitHub 8d8cb96ada [SDK] Get Kubernetes Events for Job (#1975) 
* [SDK] Get Kubernetes Events for Job

* Move class at the top

* Add object kind to event message

* Add example for events
 2024-01-11 16:30:12 +00:00
deepanker13andGitHub 6a34d14f04 [SDK] Train API (#1962) 
* adding constant for init container name

* github workflow fixes

* removing constants file changes from this pr

* code review changes

* initial skeleton of train api

* train api updated

* fixes

* code review changes

* code review changes

* code review changes

* code review changes

* fixing python library requirements

* adding hugging face dataset download class

* code review changes

* fixing github workflow

* code review comments

* import fixes

* integration test fix for python3.7

* torch version fix for python3.7

* removing unused variable

* fixing library versions for python3.7

* removing alpine distribution

* removing torch ad dependency

* removing literal usage as python 3.7 doesn't support it

* adding types.py

* ci fix

* storage init container changes, fixing imports

* adding extra requires in setup.py, fixinf ci

* adding commit to retrigger go test

* renaming folder to storage initalizer

* bug fix

* removing extra gpu check as discussed with johnu

* retriggering ci
 2024-01-10 17:06:08 +00:00
Johnu GeorgeandGitHub 051a68a3b0 Merge v1.7 branch changes to Main (#1940) 
* Update latest training operator images in v1.7 branch (#1881)

* Removing dead code

* Update monitoring guide

* Update latest training operator image

* Update sdk to v1.7.0rc0 (#1882)

* Removing dead code

* Update monitoring guide

* Update latest training operator image

* Update SDK version to v1.7.0rc0

* Update sdk to v1.7.0 (#1939)
 2023-11-01 12:31:57 +00:00
Andrey VelichkevichGitHubYuki Iwai
 		af15b0d553 [SDK] Consolidate Naming for CRUD APIs (#1907) 
* Add Flake and Black Lint

* Change SDK APIs

* Update E2E tests

* Fix a few function parameters

* Fix black format

* Fix a few comments

* Fix conftest location

* Fix Job kind in tests

* Fix client creation in test

* Fix namespace arg in get_job_conditions

* Update SDK examples with the latest changes

* Rename SDK examples

* Fix black action

* Update checkout action version

Co-authored-by: Yuki Iwai <[email protected]>

* Use Black 23.9.1 version

* Fix GitHub Action for Black

* Add unit test to create PyTorchJob from func

* Rename timeout to wait_timeout

* Validate that Job is not set with other input parameters

* Update black in developer guide

* Remove pip_index_url validation

* Use locals to verify input

* Print Job info when E2E fails

* Remove duplicated delete

---------

Co-authored-by: Yuki Iwai <[email protected]>
 2023-09-22 14:27:33 +00:00
Andrey VelichkevichandGitHub a58a0b0b89 Create TFJob and PyTorchJob from Function APIs in the Training SDK (#1659) 
* Create TFJob and PyTorchJob from Function APIs in the Training SDK

* Install SDK in tests

* Use Kubeflow Group Const

* Use Final for constants
Add Client info in example

* Modify packages_to_install doc

* Add Tensorflow GPU Image
 2022-09-16 18:02:25 +00:00
Johnu GeorgeandGitHub 28f2e4f7ae Update SDK version to 1.5.0 (#1624) 
* Adding latest image tag

* Update manifests with latest image tag

* Upgrading sdk to 1.5.0
 2022-06-28 16:23:34 +00:00
Alex LembiyeuskiandGitHub f7fad2b95b Release Python SDK 1.4.0 (#1541) 
* Bump python package and api versions

* Prevent path extension fix from being overriden by code gen

* ./hack/python-sdk/gen-sdk.sh
 2022-03-07 09:42:53 +00:00
Andrey VelichkevichandGitHub a6aec1b7b9 Update links and files with the new URL (#1434) 
* Update links and corresponding files for training-operator repository
Use Go 1.17

* Generate SDK

* Remove Travis

* Modify developer guide

* Fix go mod

* Fix legacy docs

* Generate SDK

* Remove travis

* Update ignore files
 2021-10-09 13:50:44 -07:00
Alex LembiyeuskiandGitHub 3daf40fe6a Add Python SDK for Kubeflow Training Operator (#1420) 
* Add Python SDK for Kubeflow Training Operator

* Update example notebooks

* Update SDK generation tooling and docs

* Re-generate SDK

* Allow to specify container name in 'get_logs' methods

* Generalize job labels

* Check if attribute exists

* Address code review comments
 2021-10-03 15:46:49 -07:00
Jin Chi HeandGitHub 9fccc218e0 Debug sdk test failure (#1143) 2020-03-13 03:14:39 -07:00
Jin Chi HeandKubernetes Prow Robot 0bc41e8fe9 SDK support getting the TFJob training logs (#1130) 2020-01-14 00:07:08 -08:00
Jin Chi HeandKubernetes Prow Robot cfba7579a4 add API to wait for TFJob done (#1116) 2019-12-17 21:35:56 -08:00
Jin Chi HeandKubernetes Prow Robot c69649a30b generate TFJob Python SDK (#1103) 2019-12-09 00:05:10 -08:00