hanzo-ml/trainer
1
0
Fork 0
mirror of https://github.com/hanzo-ml/trainer.git synced 2026-09-24 00:31:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,730 Commits 2 Branches 1 Tag
316064e6985885094de71463172fcafa81a93ed5
Commit Graph
123 Commits
Author SHA1 Message Date
Krishna GuptaGitHubHanzo Dev
 		4554a7693c feat(ci): automate release process (#3536) 
* feat(release): Add workflows for automated release process and version checks

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Implement automated release process with changelog generation

Signed-off-by: milinddethe15 <[email protected]>

fix lint

Signed-off-by: milinddethe15 <[email protected]>

enhance tag validation and branch creation

Signed-off-by: milinddethe15 <[email protected]>

fix: Add 'area/release' to ignored labels in PR title check

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Enhance release workflows with manual trigger and image build steps

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Add PyPI API token for publishing packages

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Update concurrency settings in publish-helm-charts workflow and upgrade git-cliff-action version

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Update git-cliff-action args to include --unreleased option

Signed-off-by: milinddethe15 <[email protected]>

refactor: reorganize release workflow to generate changelog before GitHub release

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Update GitHub release action to remove changelog prepending and simplify release name

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Refactor GitHub release job to integrate changelog generation and simplify workflow

Signed-off-by: milinddethe15 <[email protected]>

feat(release): create_branch_and_tag job to create_branch and streamline tagging process

Signed-off-by: milinddethe15 <[email protected]>

rebase commit

Signed-off-by: krishna-kg732 <[email protected]>

fix: update release branch naming to use major.minor version format

Signed-off-by: milinddethe15 <[email protected]>

fix endline

Signed-off-by: milinddethe15 <[email protected]>

feat(release): update README with upstream tag fetching instructions

Signed-off-by: milinddethe15 <[email protected]>

Release v2.2.2

Signed-off-by: krishna-kg732 <[email protected]>

Revert "Release v2.2.2"

chore: configure TestPyPI publishing for fork testing

feat: split changelog by release line

Signed-off-by: Krishna Gupta <[email protected]>

chore:removed the monoloith CHANGELOG.md

Signed-off-by: Krishna Gupta <[email protected]>

chore: capitalize Changelog file name

Signed-off-by: krishna-kg732 <[email protected]>

chore: revert fork testing config

Signed-off-by: krishna-kg732 <[email protected]>

chore:latest minor release support updated

Signed-off-by: Krishna Gupta <[email protected]>

chore:resolve changelog casing conflict and restore correct file

Signed-off-by: Krishna Gupta <[email protected]>

chore: resolve git casing conflict

Signed-off-by: Krishna Gupta <[email protected]>

feat: split changelog by release line

Signed-off-by: Krishna Gupta <[email protected]>

chore: capitalize Changelog file name

Signed-off-by: krishna-kg732 <[email protected]>

chore:latest minor release support updated

Signed-off-by: Krishna Gupta <[email protected]>

chore: remove duplicate lowercase changelog file

Signed-off-by: krishna-kg732 <[email protected]>

* Chore:remove the Test release changeLog update

Signed-off-by: krishna-kg732 <[email protected]>

* Potential fix for pull request finding (fix by copilot)

Signed-off-by: Krishna Gupta <[email protected]>

* chore:address review comments

Signed-off-by: Krishna Gupta <[email protected]>

* chore:run pip-compile

Signed-off-by: Krishna Gupta <[email protected]>

* chore: address review

Signed-off-by: Krishna Gupta <[email protected]>

* fix(release): wait for artifact publishing before GitHub release

Signed-off-by: Krishna Gupta <[email protected]>

* refactor(release): delete release.sh, inline make release, and move asset updates to release workflow

Signed-off-by: Krishna Gupta <[email protected]>

* chore(ci): align release workflow and cliff.toml with SDK conventions

Signed-off-by: Krishna Gupta <[email protected]>

* chore: sync requirements lockfiles

Signed-off-by: Krishna Gupta <[email protected]>

* chore: added a new create_tag job and rebased to pass ci

Signed-off-by: Krishna Gupta <[email protected]>

* chore: regenerate lockfiles with Python 3.12 to fix CI

Signed-off-by: Krishna Gupta <[email protected]>

* chore: retrigger CI

Signed-off-by: Krishna Gupta <[email protected]>

* chore : address PR review

Signed-off-by: Krishna Gupta <[email protected]>

---------

Signed-off-by: krishna-kg732 <[email protected]>
Signed-off-by: Krishna Gupta <[email protected]>
Co-authored-by: milinddethe15 <[email protected]>

Co-authored-by: Hanzo Dev <[email protected]>
 2026-06-11 19:59:37 +01:00
Tariq HasanandGitHub 9183dfd24f chore(scripts): add copyright boilerplate verification (#3359) 
* chore(scripts): add copyright boilerplate verification system

Signed-off-by: tariq-hasan <[email protected]>

* chore(ci): add boilerplate verification to CI pipeline

Signed-off-by: tariq-hasan <[email protected]>

* chore: regenerate files with year-less copyright headers

Signed-off-by: tariq-hasan <[email protected]>

* refactor(boilerplate): simplify verification logic

Signed-off-by: tariq-hasan <[email protected]>

* chore(boilerplate): add missing copyright headers

Signed-off-by: tariq-hasan <[email protected]>

* ci(boilerplate): move verifier to code-quality workflow and run unit tests

Signed-off-by: tariq-hasan <[email protected]>

* feat(boilerplate): accept license headers with any year and remove year validation logic

Signed-off-by: tariq-hasan <[email protected]>

* feat(boilerplate): add copyright headers to generated Python API

Signed-off-by: tariq-hasan <[email protected]>

* refactor(boilerplate): use block-comment header for generated Go files

Signed-off-by: tariq-hasan <[email protected]>

* feat(boilerplate): verify copyright headers in Rust files

Signed-off-by: tariq-hasan <[email protected]>

---------

Signed-off-by: tariq-hasan <[email protected]>
 2026-05-29 10:50:56 +00:00
Rob BellGitHubHanzo Dev
 		dc8e6782d1 feat(docs): KEP-2599: Decouple runtime lifecycle from TrainJobs to simplify updating runtimes (#3428) 
* feat(docs): add KEP-2599 for mutable runtimes

Proposes allowing TrainingRuntimes and ClusterTrainingRuntimes to be
mutable by introducing TrainingRuntimeSnapshot resources. TrainJobs
snapshot their referenced runtime configuration on first reconciliation,
decoupling job execution from runtime changes.

Key changes:
- New TrainingRuntimeSnapshot CRD to store point-in-time runtime config
- Remove finalizers from runtimes (no longer needed)
- Remove TrainJobWatcher interface and boilerplate
- Automatic migration for existing TrainJobs on upgrade

Addresses issue #2599

Signed-off-by: Rob Bell <[email protected]>

* feat(docs): improve KEP-2599 clarity and completeness

Improvements to the mutable runtimes KEP:
- Clarify operational problems with finalizers (orphaned finalizers,
  namespace deletion issues)
- Better explain why runtime updates are risky (fetched on every
  reconciliation, no design-level guarantees)
- Add concrete examples of runtime proliferation (pytorch-2.0, pytorch-2.1)
- Add RBAC section showing required permissions
- Improve summary to clearly state API change (new CRD)
- Clarify test cases for migration scenarios

Signed-off-by: Rob Bell <[email protected]>

* docs: address Copilot review comments on KEP-2599

- Fix relative link to include README.md in Trainer v2 design reference
- Remove extra space in Goals heading
- Change 'Training Job' to 'TrainJobs' for consistency
- Fix 'lookup' to 'look up' (correct verb form)
- Add 'create' verb to RBAC permissions for TrainingRuntimeSnapshot

Signed-off-by: Rob Bell <[email protected]>

* docs: clarify KEP-2599 divergence from original design

Signed-off-by: Rob Bell <[email protected]>

* docs: add source runtime annotation to KEP-2599

Signed-off-by: Rob Bell <[email protected]>

* fix: update the KEP based on feedback

Signed-off-by: Rob Bell <[email protected]>

* fix: apply suggestion

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Rob Bell <[email protected]>

* fix: apply suggestion

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Rob Bell <[email protected]>

* fix: apply suggestion

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Rob Bell <[email protected]>

* fix: remove annotation for snapshot

Signed-off-by: Rob Bell <[email protected]>

---------

Signed-off-by: Rob Bell <[email protected]>

Co-authored-by: Andrey Velichkevich <[email protected]>

Co-authored-by: Hanzo Dev <[email protected]>
 2026-05-19 13:03:36 +00:00
Peter PanGitHubAndrey VelichkevichRob Bell
 		f53edcc769 feat: KEP for inject PET envs into init-container (#3417) 
* docs(proposals): add draft KEP for inject PET envs into trainer init containers

Signed-off-by: Peter Pan <[email protected]>

* fix comments

Signed-off-by: Peter Pan <[email protected]>

* address comments

Signed-off-by: Peter Pan <[email protected]>

* Add OPT-In annotation

Polish more

Signed-off-by: Peter Pan <[email protected]>

* add more detailed user story

Signed-off-by: Peter Pan <[email protected]>

* change annotation name to more generic

Signed-off-by: Peter Pan <[email protected]>

* docs(proposals): clarify plugin env injection mode in KEP-3416

Signed-off-by: Peter Pan <[email protected]>

* docs(proposals): switch from annotation to TorchMLPolicy API field for env injection

Signed-off-by: Peter Pan <[email protected]>

* docs(proposals): clarify envInjection default state semantics

Signed-off-by: Peter Pan <[email protected]>

* docs(proposals): refine envInjection API to use initContainers name list

Replace containerTypes enum with explicit initContainers []string for
precise targeting. The main container (node) always receives PET_* envs,
eliminating the need for container type distinction and extra validation.

Signed-off-by: Peter Pan <[email protected]>

* docs(proposals): adopt targets/jobName/containerNames API per review consensus

Use explicit targets list with jobName and containerNames for declarative
API. Main container (node) always injected automatically. jobName chosen
over replicatedJobName for future CRD compatibility (LWS, Grove, Slurm).

Signed-off-by: Peter Pan <[email protected]>

* docs(proposals): fix stale text to align with targets API

Proposal description, Goal, and Non-Goals previously referenced
trainer init containers only. With the targets/jobName/containerNames
API, injection targets any container in any replicated job.

Signed-off-by: Peter Pan <[email protected]>

* docs(proposals): finalize API per offline sync with Andre/tenzen-y

Keep jobName + containerNames (plural) design. Add container existence
validation. Rename TorchEnvInjection to EnvInjection for policy reuse.

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Peter Pan <[email protected]>

* Update docs/proposals/3416-pet-env-init-containers/README.md

Co-authored-by: Rob Bell <[email protected]>
Signed-off-by: Peter Pan <[email protected]>

* chore: fix trailing whitespace in KEP README

Signed-off-by: Peter Pan <[email protected]>

---------

Signed-off-by: Peter Pan <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
Co-authored-by: Rob Bell <[email protected]>
 2026-05-15 15:21:02 +00:00
Akash JaiswalandGitHub 27366f6b19 chore: added docs for cncf gpu arc (#3218) 
* doc: added docs for cncf gpu arc

Signed-off-by: Akash Jaiswal <[email protected]>

* add: diagram and cncf arc intro

Signed-off-by: Akash Jaiswal <[email protected]>

---------

Signed-off-by: Akash Jaiswal <[email protected]>
 2026-04-15 01:34:49 +00:00
Andrey VelichkevichGitHubHanzo Dev
 		72f6a855d7 fix(docs): Update steps in release document (#3335) 
* fix(docs): Update steps in release document

Signed-off-by: Andrey Velichkevich <[email protected]>

* Potential fix for pull request finding

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>

Co-authored-by: Hanzo Dev <[email protected]>
 2026-03-15 13:13:08 +00:00
Rob BellandGitHub 78b4a00929 feat: add support for tracking TrainJob progress and training metrics (#3227) 
* feat(api): add progress types to api

Signed-off-by: Rob Bell <[email protected]>

* feat: progress server stub

Signed-off-by: Rob Bell <[email protected]>

* feat: setup tls for server

Signed-off-by: Rob Bell <[email protected]>

* refactor: pull out middleware

Signed-off-by: Rob Bell <[email protected]>

* refactor: remove logger message noise from tests

Signed-off-by: Rob Bell <[email protected]>

* fix: send server error logs to main logger

Signed-off-by: Rob Bell <[email protected]>

* feat: update the trainer status

Signed-off-by: Rob Bell <[email protected]>

* feat: use separate client to avoid impacting main reconciler client-side rate limits

Signed-off-by: Rob Bell <[email protected]>

* feat: configure progress server in helm chart and configmap

Signed-off-by: Rob Bell <[email protected]>

* fix: prevent race condition

Signed-off-by: Rob Bell <[email protected]>

* feat: inject progress runtime config

Signed-off-by: Rob Bell <[email protected]>

* fix: progress client config

Signed-off-by: Rob Bell <[email protected]>

* fix: update generated config

Signed-off-by: Rob Bell <[email protected]>

* feat: validate auth tokens in endpoint

Signed-off-by: Rob Bell <[email protected]>

* test: validate auth tokens in endpoint

Signed-off-by: Rob Bell <[email protected]>

* refactor: tidy tests to use same format as other tests

Signed-off-by: Rob Bell <[email protected]>

* fix: look up the cluster issuer from the service account token

Different clusters can use different issuers so look up the issuer from the trusted in-cluster service account token.

Signed-off-by: Rob Bell <[email protected]>

* refactor: rename authn middleware

Signed-off-by: Rob Bell <[email protected]>

* feat: add authn to status update endpoint

Signed-off-by: Rob Bell <[email protected]>

* refactor: tidy up reading in-cluster service account token

Signed-off-by: Rob Bell <[email protected]>

* fix: rbac permissions

Signed-off-by: Rob Bell <[email protected]>

* fix: better error response

Signed-off-by: Rob Bell <[email protected]>

* refactor: move kubebuilder annotation higher up

Signed-off-by: Rob Bell <[email protected]>

* fix: make lastUpdateTime required

Signed-off-by: Rob Bell <[email protected]>

* chore: fix config tests after rebase

Signed-off-by: Rob Bell <[email protected]>

* test: update config test with new progress server config

Signed-off-by: Rob Bell <[email protected]>

* test: add progress tracking e2e test

Signed-off-by: Rob Bell <[email protected]>

* fix: allow feature gates to be configurable from command line argument

So they can be overridden in e2e tests

Signed-off-by: Rob Bell <[email protected]>

* refactor: reuse shared progress StatusUrl

Signed-off-by: Rob Bell <[email protected]>

* test: tidy up tests

Signed-off-by: Rob Bell <[email protected]>

* refactor: allow plugins to use config

Signed-off-by: Rob Bell <[email protected]>

* refactor: centralise shared constants

Signed-off-by: Rob Bell <[email protected]>

* fix: disable http2 in progress server tls opts if disabled by config

Signed-off-by: Rob Bell <[email protected]>

* fix: minor improvements suggested by copilot

Signed-off-by: Rob Bell <[email protected]>

* chore: rename progress server => status server

Signed-off-by: Rob Bell <[email protected]>

* chore: update type doc

Signed-off-by: Rob Bell <[email protected]>

* chore: update name of feature gate

Signed-off-by: Rob Bell <[email protected]>

* fix: after rebase

Signed-off-by: Rob Bell <[email protected]>

* chore: fix typo

Signed-off-by: Rob Bell <[email protected]>

* chore: rename handler

Signed-off-by: Rob Bell <[email protected]>

* fix: run status server on all replicas

Signed-off-by: Rob Bell <[email protected]>

* fix: deep copy the rest config

Signed-off-by: Rob Bell <[email protected]>

* refactor: use ssa

Signed-off-by: Rob Bell <[email protected]>

* refactor: separate token audience per train job

Signed-off-by: Rob Bell <[email protected]>

* chore: rename status server

Signed-off-by: Rob Bell <[email protected]>

* fix: revert adding status pkg to manifest gen paths

Signed-off-by: Rob Bell <[email protected]>

* chore: update log messages

Signed-off-by: Rob Bell <[email protected]>

* chore: update api docs

Signed-off-by: Rob Bell <[email protected]>

* chore: update format

Signed-off-by: Rob Bell <[email protected]>

* fix: revert inadvertent change

Signed-off-by: Rob Bell <[email protected]>

* chore: update api name and type docs

Signed-off-by: Rob Bell <[email protected]>

* refactor: initialise oidc provider in manager startup

Signed-off-by: Rob Bell <[email protected]>

* fix: allow empty update request

Signed-off-by: Rob Bell <[email protected]>

* fix: wait for server shut down

Signed-off-by: Rob Bell <[email protected]>

* fix: handle missing train job

Signed-off-by: Rob Bell <[email protected]>

* refactor: update env var names

Signed-off-by: Rob Bell <[email protected]>

* chore: rename packages, plugins, feature gate

Signed-off-by: Rob Bell <[email protected]>

* refactor: update env var names

Signed-off-by: Rob Bell <[email protected]>

* chore: regenerate after rebase

Signed-off-by: Rob Bell <[email protected]>

* chore: fixes after rebase

Signed-off-by: Rob Bell <[email protected]>

* chore: minor doc updates

Signed-off-by: Rob Bell <[email protected]>

* chore: rename status server config

Signed-off-by: Rob Bell <[email protected]>

* chore: replace placeholder config with nil

Signed-off-by: Rob Bell <[email protected]>

* chore: revert separate runtime utils package

Signed-off-by: Rob Bell <[email protected]>

* chore: remove unused config from tests

Signed-off-by: Rob Bell <[email protected]>

---------

Signed-off-by: Rob Bell <[email protected]>
 2026-03-13 20:01:08 +00:00
Antonin StefanuttiGitHubAndrey Velichkevich
 		37c8a07a8a feat(api): Replace PodTemplateOverrides with RuntimePatches API (#3309) 
* feat(api): Replace PodTemplateOverrides with RuntimePatches API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update goal with RuntimePatches API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add diagram for RuntimePatches

Signed-off-by: Andrey Velichkevich <[email protected]>

* feat(api): Replace PodTemplateOverrides with RuntimePatches API

Signed-off-by: Antonin Stefanutti <[email protected]>

* Fix kube lint errors

Signed-off-by: Antonin Stefanutti <[email protected]>

* Update Python models

Signed-off-by: Antonin Stefanutti <[email protected]>

* Enable maxlength Kube-API-Linter rule

Signed-off-by: Antonin Stefanutti <[email protected]>

* Restore manger field IsDomainPrefixedPath validation

Signed-off-by: Antonin Stefanutti <[email protected]>

* Fix integration tests

Signed-off-by: Antonin Stefanutti <[email protected]>

* Apply StrategicMergePatch to batchv1.JobTemplateSpec

Signed-off-by: Antonin Stefanutti <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Antonin Stefanutti <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
 2026-03-12 16:29:44 +00:00
Andrey VelichkevichandGitHub 63d928468c feat(api): BREAKING CHANGE: Remove numProcPerNode from Torch API (#3239) 
* feat(api): BREAKING CHANGE: Remove numProcPerNode from Torch API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove trainer_v1alpha1_torch_elastic_policy.py from Py models

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix numNodes validation in torchtune

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2026-03-01 06:53:03 +00:00
Yash AgarwalandGitHub 09ab8cbe03 feat(docs): proposal for adding TTLSecondsAfterFinished and ActiveDeadlineSeconds fields to TrainJob CRD (#3068) 
* feat(docs): proposal for  adding TTLSecondsAfterFinished and ActiveDeadlineSeconds fields to TrainJob CRD

Signed-off-by: XploY04 <[email protected]>

* fix(docs): add title

Signed-off-by: XploY04 <[email protected]>

* fix(docs): made fixes to match Kubeflow's template

Signed-off-by: XploY04 <[email protected]>

* fix(docs): updated adding the fields from TrainJob CRD to Trainer APIs

Signed-off-by: XploY04 <[email protected]>

* docs: Clarify ActiveDeadlineSeconds behavior with suspension, add TTLSecondsAfterFinished validation, and remove proposed status fields, SDK changes, and metrics.

Signed-off-by: XploY04 <[email protected]>

* fix(docs): improvements in proposal

Signed-off-by: XploY04 <[email protected]>

* timeout changed to active_deadline_seconds

Signed-off-by: XploY04 <[email protected]>

* docs: update  parameter to  in the proposal README.

Signed-off-by: XploY04 <[email protected]>

* docs(proposals): postpone TTL to Future Plan

Signed-off-by: XploY04 <[email protected]>

* docs(proposals): rename KEP to Resource Timeouts

Signed-off-by: XploY04 <[email protected]>

---------

Signed-off-by: XploY04 <[email protected]>
 2026-02-28 00:52:23 +00:00
Andrey VelichkevichandGitHub 60004df3d3 feat(api): BREAKING CHANGE – Remove ElasticPolicy API (#3235) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2026-02-24 20:58:47 +00:00
Krishna GuptaandGitHub 58cc854833 feat(docs): KEP-2598 XGBoost Runtime for Trainer V2 (#3118) 
* KEP-2598: XGBoost Runtime for Trainer V2

Signed-off-by: Krishna-kg732 <[email protected]>

* final proposal

Signed-off-by: Krishna-kg732 <[email protected]>

* fix(docs): address review feedback on KEP-2598

Signed-off-by: Krishna-kg732 <[email protected]>

* docs: update KEP-2598 header format and implementation history

Signed-off-by: Krishna-kg732 <[email protected]>

* KEP-2598: XGBoost Runtime updates - collective API and review feedback

Signed-off-by: Krishna-kg732 <[email protected]>

---------

Signed-off-by: Krishna-kg732 <[email protected]>
 2026-02-11 10:44:14 +00:00
Surya Sameer Datta VaddadiGitHubHanzo Dev
 		cc90537c31 chore: Expose trainer API version via public ConfigMap (#3083) 
* Expose trainer API version via public ConfigMap

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* Update manifests/base/manager/kubeflow-trainer-public-configmap.yaml

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* Update manifests/base/manager/kubeflow-trainer-public-configmap.yaml

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* added configMapGenerator to kustomization.yaml

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* changed naming and updated helm charts

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* ran make generate

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* chore: regenerate assets after rebase

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* Changed ClusterRole to Role and ClusterRoleBinding to RoleBinding

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* Ran mod tidy, make generate to pass CI

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* changed behaviour replace so we dont need any base configmap

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* updating helper function

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* Addressing comments

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* Update manifests/base/rbac/public_configmap_role.yaml

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* Update manifests/base/rbac/public_configmap_role_binding.yaml

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* Added get, list, watch to role verbs

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

* removed unnecessary comment

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

---------

Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>
Signed-off-by: Surya Sameer Datta Vaddadi <[email protected]>

Co-authored-by: Andrey Velichkevich <[email protected]>

Co-authored-by: Hanzo Dev <[email protected]>
 2026-01-26 18:00:33 +00:00
Rob BellandGitHub fa6c4006ec feat(docs): KEP-2779: Track TrainJob progress and expose training metrics (#2905) 
* feat(docs): KEP-2779 Track TrainJob progress and expose training metrics

Signed-off-by: Rob Bell <[email protected]>

* feat(docs): update progress tracking KEP to use a push-based HTTP mechanism

Signed-off-by: Rob Bell <[email protected]>

* feat(docs): update progress tracking KEP to add an alternative pull-based approach

Signed-off-by: Rob Bell <[email protected]>

* feat(docs): update progress tracking KEP pull-based approach

Add a simpler, more reliable approach to collect the final status.

Signed-off-by: Rob Bell <[email protected]>

* feat(docs): update TrainerStatus api and minor formatting/text updates

Signed-off-by: Rob Bell <[email protected]>

* feat(docs): update to use the push-based approach

Signed-off-by: Rob Bell <[email protected]>

* feat(docs): remove the framework-specific custom trainers.

Signed-off-by: Rob Bell <[email protected]>

* feat(docs): update the endpoint spec and add details of the feature gate

Signed-off-by: Rob Bell <[email protected]>

* feat(docs): update the endpoint spec and update feature gate spec

Signed-off-by: Rob Bell <[email protected]>

* feat(docs): update spec for sidecar

Signed-off-by: Rob Bell <[email protected]>

---------

Signed-off-by: Rob Bell <[email protected]>
 2026-01-22 04:41:30 +00:00
Vanessa SochatGitHubvsoch
 		092428a874 feat: KEP 2841 Flux Policy to support Flux Framework (#2909) 
* feat: kep for flux hpc (2841)

This KEP proposes adding an hpcPolicy to support Flux
Framework and (in the future) other workload managers
that provide more traditional HPC features.

Signed-off-by: vsoch <[email protected]>

* review: see updates below.

Changed crd examples to reflect documentation
removed tasks from definition - can go in settings
removed mentions of minicluster out of context
specified train image instead of custom logic
added user stories

Signed-off-by: vsoch <[email protected]>

* feat: flux policy

Update the KEP to define a FluxMLPolicySource that
exposes attributes specific to Flux.

Signed-off-by: vsoch <[email protected]>

* review: add details of cm and init container

Signed-off-by: vsoch <[email protected]>

---------

Signed-off-by: vsoch <[email protected]>
Co-authored-by: vsoch <[email protected]>
 2025-12-29 18:37:04 +00:00
Andrey VelichkevichandGitHub e83200385d feat(docs): Add changelog for Kubeflow Trainer v2.1.0 (#2921) 
* feat(docs): Add changelog for Kubeflow Trainer v2.1.0

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update changelog and release script for 2.1.0

Signed-off-by: Andrey Velichkevich <[email protected]>

* Clarify on steps

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add cache image info to release doc

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-11-07 08:56:33 +00:00
Aditya RautGitHubAndrey Velichkevich
 		fa00b5c1c5 feat(manifests): Publish Trainer Helm Charts (#2906) 
* Solve Remaining Error and bugs

Signed-off-by: adity1raut <[email protected]>

* Solve the confige

Signed-off-by: adity1raut <[email protected]>

* Update The Suggest Change

Signed-off-by: adity1raut <[email protected]>

* Update After REview

Signed-off-by: adity1raut <[email protected]>

* Update the Helm publish action

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update release doc

Signed-off-by: Andrey Velichkevich <[email protected]>

* Use 0.0.0 version for master branch

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update release doc

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: adity1raut <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
 2025-11-03 16:02:15 +00:00
Andrey VelichkevichandGitHub c1bb75d7fb feat(docs): Add changelog for Kubeflow Trainer v2.1.0-rc.0 (#2902) 
* feat(docs): Add changelog for Kubeflow Trainer v2.1.0-rc.0

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add helm charts to release doc

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add breaking changes and Kueue enhancements

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename to LLM Post-Training

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-10-26 05:21:07 +00:00
Du XinminandGitHub 453f1ede15 fix(docs): correct example usage in KEP-2437-Support-Volcano-Scheduler (#2898) 
Signed-off-by: Xinmin Du <[email protected]>
 2025-10-18 07:09:02 +00:00
Shao WangGitHubAndrey Velichkevich
 		615e338bf4 feat(runtimes): Add LoRA/QLoRA/DoRA support in LLM Trainer V2 (#2832) 
* feat(runtimes): Add lora recipe and config in torch.plugin.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: add --trainer-use-lora flag and related logics.

Signed-off-by: Electronic-Waste <[email protected]>

* feat(lora): Add support for QLoRA.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(lora): fix extra rdzv backend in single device mode.

Signed-off-by: Electronic-Waste <[email protected]>

* test(lora): Add UTs for lora/qlora in trainingruntime.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(lora): remove extra quote symbol in lora attn module.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(lint): fix lint error.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(runtime): check default GPU resources allocated in CTRs.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(runtime): add getNumProcPerNode.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(runtime): remove specific vendor for GPU.

Signed-off-by: Electronic-Waste <[email protected]>

* test(runtime): add UTs for lora validation.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(runtimes): remove extra flags for torchtune.

Signed-off-by: Electronic-Waste <[email protected]>

* Update pkg/runtime/framework/plugins/torch/torch.go

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Shao Wang <[email protected]>

* chore(runtime): add extractGPUCountFromRuntime.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(runtimes): remove filtering args logics.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(runtimes): use fallbackNumProcPerNode if GPU is set in runtimes.

Signed-off-by: Electronic-Waste <[email protected]>

* refactor(runtimes): refactor getNumProcPerNode logics.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(lint): fix lint error.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(runtimes): call getNumProcPerNode only once.

Signed-off-by: Electronic-Waste <[email protected]>

* test(runtime): fix UTs for torch.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(runtimes): add limits to calculation.

Signed-off-by: Electronic-Waste <[email protected]>

* refactor(runtimes): reorg nppNode related logics.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(runtimes): fix lints.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(runtimes): update condition that use nppNode in Limits.

Signed-off-by: Electronic-Waste <[email protected]>

* refactor(runtimes): add torchtune.go

Signed-off-by: Electronic-Waste <[email protected]>

* fix(lint): fix lint error.

Signed-off-by: Electronic-Waste <[email protected]>

* refactor(torch): only reset nppNode when using CPU.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(runtimes): remove getNumProcPerNodeFromCPU.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
Signed-off-by: Shao Wang <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
 2025-10-15 12:44:09 +00:00
Xigang WangandGitHub de8ab7ce76 feat: Add PodTemplateOverrides into TrainJob V2 API (#2882) 
Signed-off-by: xigang <[email protected]>
 2025-10-09 11:36:14 +00:00
Mahdi KhashanGitHubShao WangAndrey Velichkevich
 		7b8d096650 feat(docs): KEP-2442-Support JAX Training Runtime (#2643) 
* proposal

Signed-off-by: mahdikhashan <[email protected]>

fix

Update docs/proposals/2442-jax-runtime-trainer-v2/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

Update docs/proposals/2442-jax-runtime-trainer-v2/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

Update docs/proposals/2442-jax-runtime-trainer-v2/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

clean table of contents

simplify JAX traning workflow

improve design details

update table of contents

fix

fix

add

Signed-off-by: Mahdi Khashan <[email protected]>

* Update docs/proposals/2442-jax-runtime-trainer-v2/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

* Update docs/proposals/2442-jax-runtime-trainer-v2/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

* Update docs/proposals/2442-jax-runtime-trainer-v2/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

* Update docs/proposals/2442-jax-runtime-trainer-v2/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

* Update docs/proposals/2442-jax-runtime-trainer-v2/README.md

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

* Update docs/proposals/2442-jax-runtime-trainer-v2/README.md

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

* Update docs/proposals/2442-jax-runtime-trainer-v2/README.md

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

* update drawing

Signed-off-by: Mahdi Khashan <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>

* update non-goals

Signed-off-by: Mahdi Khashan <[email protected]>

* update goal

Signed-off-by: Mahdi Khashan <[email protected]>

* update user persona names

Signed-off-by: Mahdi Khashan <[email protected]>

* improve summary

Signed-off-by: Mahdi Khashan <[email protected]>

* improve motivation

Signed-off-by: Mahdi Khashan <[email protected]>

* improve sample code in story 2

Signed-off-by: Mahdi Khashan <[email protected]>

* improve code

Signed-off-by: Mahdi Khashan <[email protected]>

* add table

Signed-off-by: Mahdi Khashan <[email protected]>

* wip: jax-ml-policy

Signed-off-by: Mahdi Khashan <[email protected]>

* use a table for workflow description

Signed-off-by: Mahdi Khashan <[email protected]>

* remove communication backend section and add future work

Signed-off-by: Mahdi Khashan <[email protected]>

* remove extra lines

Signed-off-by: Mahdi Khashan <[email protected]>

* separate jaxmlpolicy source block

Signed-off-by: Mahdi Khashan <[email protected]>

* update the table of contents with future work

Signed-off-by: Mahdi Khashan <[email protected]>

* simplify the testing plan section

Signed-off-by: Mahdi Khashan <[email protected]>

* update the history section

Signed-off-by: Mahdi Khashan <[email protected]>

* improve design detail section

Signed-off-by: Mahdi Khashan <[email protected]>

* update future work

Signed-off-by: Mahdi Khashan <[email protected]>

* update test plan

Signed-off-by: Mahdi Khashan <[email protected]>

* update workflow description

Signed-off-by: Mahdi Khashan <[email protected]>

* improve design detail section

Signed-off-by: Mahdi Khashan <[email protected]>

* change system to Trainer Controller Manager

Signed-off-by: Mahdi Khashan <[email protected]>

* merge runtime and trainer controller manager

Signed-off-by: Mahdi Khashan <[email protected]>

* change plugin details

Signed-off-by: Mahdi Khashan <[email protected]>

* update goals

Signed-off-by: Mahdi Khashan <[email protected]>

* use kwargs

Signed-off-by: Mahdi Khashan <[email protected]>

* fix ci

Signed-off-by: mahdikhashan <[email protected]>

* fix ci

Signed-off-by: mahdikhashan <[email protected]>

* update non-goals

Signed-off-by: mahdikhashan <[email protected]>

---------

Signed-off-by: Mahdi Khashan <[email protected]>
Signed-off-by: Mahdi Khashan <[email protected]>
Signed-off-by: mahdikhashan <[email protected]>
Co-authored-by: Shao Wang <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
 2025-10-05 13:02:10 +00:00
Andrey VelichkevichandGitHub 6e5b6e6768 feat(docs): Update Trainer diagram and SDK release (#2867) 
* feat(docs): Update Trainer diagram and SDK release

Signed-off-by: Andrey Velichkevich <[email protected]>

* reimport diagram

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update diagram

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-09-30 14:15:32 +00:00
Andrey VelichkevichandGitHub 86448d4f93 fix(docs): Update the release document to push all changes (#2865) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-09-29 14:28:32 +00:00
Tsubasa NagasawaGitHubAntonin Stefanutti
 		39e4b08a03 feat: support imagePullSecrets in TrainJob pod spec overrides (#2806) 
Signed-off-by: Tsubasa Nagasawa <[email protected]>
Co-authored-by: Antonin Stefanutti <[email protected]>
 2025-09-08 12:43:36 +00:00
Akash JaiswalandGitHub 71db59b147 fix: teraform for oci gpu based vm (#2810) 
Signed-off-by: Akash Jaiswal <[email protected]>
 2025-09-02 19:51:02 +00:00
Akash JaiswalandGitHub 357f0c52aa feat: KEP-2432: GPU Testing for LLM Blueprints (#2689) 
* kep: added kep for gsoc25 project 7

Signed-off-by: Akash Jaiswal <[email protected]>

* format: formatted kep with kubeflow kep template

Signed-off-by: Akash Jaiswal <[email protected]>

* format: removed todo list and timeline

Signed-off-by: Akash Jaiswal <[email protected]>

* format: removed screenshots

Signed-off-by: Akash Jaiswal <[email protected]>

* fix: pre commit check

Signed-off-by: Akash Jaiswal <[email protected]>

* fix: scope and review comments from Andrey

Signed-off-by: Akash Jaiswal <[email protected]>

* add: updated KEP and added tf file for setup

Signed-off-by: Akash Jaiswal <[email protected]>

---------

Signed-off-by: Akash Jaiswal <[email protected]>
 2025-08-29 02:08:22 +00:00
Tsubasa NagasawaandGitHub 187a5de400 feat: support affinity in TrainJob pod spec overrides (#2796) 
Signed-off-by: Tsubasa Nagasawa <[email protected]>
 2025-08-28 15:52:22 +00:00
Andrey VelichkevichandGitHub beff860186 feat(docs): How to release Python API modules (#2786) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-08-11 14:08:43 +00:00
Shao WangandGitHub 21d3b02f74 fix(docs): update KEP-2401 according to current implementation. (#2765) 
Signed-off-by: Electronic-Waste <[email protected]>
 2025-08-05 12:23:53 +00:00
Du XinminGitHubShao WangYuchen ChengAndrey Velichkevich
 		9f44378983 feat(docs): KEP-2437-Support Volcano Scheduler in Kubeflow Trainer V2 (#2672) 
* doc: KEP creation

Signed-off-by: Xinmin Du <[email protected]>

* fix: pre-commit fix

Signed-off-by: Xinmin Du <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: syntax err

Signed-off-by: Xinmin Du <[email protected]>

* fix: change the example

Signed-off-by: Xinmin Du <[email protected]>

* fix: change the explanation for fig.

Signed-off-by: Xinmin Du <[email protected]>

* fix: remove unused part

Signed-off-by: Xinmin Du <[email protected]>

* feat: add test plan

Signed-off-by: Xinmin Du <[email protected]>

* fix

Signed-off-by: Xinmin Du <[email protected]>

* fix: update examples

Signed-off-by: Xinmin Du <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: reword "integrate with Volcano" to "apply PodGroup"

Signed-off-by: Xinmin Du <[email protected]>

* docs: add code block with VolcanoPodPolicySource struct

Signed-off-by: Xinmin Du <[email protected]>

* fix: declare permissions with kubebuilder

Signed-off-by: Xinmin Du <[email protected]>

* fix: pre-commit fix

Signed-off-by: Xinmin Du <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Yuchen Cheng <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: inaccurate description

Signed-off-by: Xinmin Du <[email protected]>

* fix: modify code example & remove unnecessary installation step

Signed-off-by: Xinmin Du <[email protected]>

* fix: update test plan

Signed-off-by: Xinmin Du <[email protected]>

* fix: a few nits

Signed-off-by: Xinmin Du <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: code block format

Signed-off-by: Xinmin Du <[email protected]>

* fix: omit minTaskMember

Signed-off-by: Xinmin Du <[email protected]>

* fix: configure queue in annotation

Signed-off-by: Xinmin Du <[email protected]>

* fix: trim trail whitespace

Signed-off-by: Xinmin Du <[email protected]>

* Update docs/proposals/2437-volcano-scheduler/README.md

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>

* fix: Sedna case in Motivation

Signed-off-by: Xinmin Du <[email protected]>

* fix: configure priorityClassName from pod spec

Signed-off-by: Xinmin Du <[email protected]>

* fix: rm PodGroupInterface

Signed-off-by: Xinmin Du <[email protected]>

* fix: explain `queue` override

Signed-off-by: Xinmin Du <[email protected]>

* feat: Volcano Scheduler Plugin Configuration

Signed-off-by: Xinmin Du <[email protected]>

---------

Signed-off-by: Xinmin Du <[email protected]>
Signed-off-by: Du Xinmin <[email protected]>
Co-authored-by: Shao Wang <[email protected]>
Co-authored-by: Yuchen Cheng <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
 2025-08-01 10:13:50 +00:00
Andrey VelichkevichandGitHub e590ad5231 chore(docs): Update Release Guide (#2710) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-07-04 03:33:19 +00:00
Anya KramarandGitHub f070f80b7f Add Changelog for Trainer v2.0.0-rc.0 (#2666) 
* fix(docs): convert commits to list in changelog.py for compatibility

Signed-off-by: kramaranya <[email protected]>

* chore(docs): add Changelog for Trainer v2.0.0-rc.0

Signed-off-by: kramaranya <[email protected]>

---------

Signed-off-by: kramaranya <[email protected]>
 2025-06-11 08:18:50 +00:00
Eoin FennessyandGitHub 7ffef77be3 Remove SDK (#2657) 
* Remove SDK

Signed-off-by: Eoin Fennessy <[email protected]>

* Fix e2e test

Signed-off-by: Eoin Fennessy <[email protected]>

* Remove unnecessary `pip install ./sdk` for unit tests

Signed-off-by: Eoin Fennessy <[email protected]>

* Remove sdk from pre-commit config

Signed-off-by: Eoin Fennessy <[email protected]>

* Update docstring for `generate` target

Signed-off-by: Eoin Fennessy <[email protected]>

* Update CONTRIBUTING.md

Signed-off-by: Eoin Fennessy <[email protected]>

* Remove .gitignore for OpenAPI Generator CLI JAR

Signed-off-by: Eoin Fennessy <[email protected]>

* README.md: Add link to `kubeflow/sdk` + some minor edits

Signed-off-by: Eoin Fennessy <[email protected]>

* Add TODO to repurpose SDK release info if needed

Signed-off-by: Eoin Fennessy <[email protected]>

* Add SDK installation step to all notebooks

Signed-off-by: Eoin Fennessy <[email protected]>

* Comment out SDK installation command in all notebooks

Signed-off-by: Eoin Fennessy <[email protected]>

---------

Signed-off-by: Eoin Fennessy <[email protected]>
 2025-06-09 13:41:48 +00:00
Andrey VelichkevichGitHubShao WangAntonin StefanuttiAntonin Stefanutti
 		434d953004 feat(controller): Implement PodSpecOverride API (#2614) 
* feat(controller): Implement PodSpecOverride API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update API comments

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix InitContainers override

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix generate

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update pkg/apis/trainer/v1alpha1/trainjob_types.go

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>

* Change API to targetJob and add validation

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add unit test for the JobSet builder

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add integration tests

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update pkg/apis/trainer/v1alpha1/trainjob_types.go

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>

* Update pkg/apis/trainer/v1alpha1/trainjob_types.go

Co-authored-by: Shao Wang <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>

* Update pkg/apis/trainer/v1alpha1/trainjob_types.go

Co-authored-by: Antonin Stefanutti <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>

* Merge PodSpecOverrides before the build phase

Signed-off-by: Antonin Stefanutti <[email protected]>

* Fix make generate

Signed-off-by: Antonin Stefanutti <[email protected]>

* Fix PodSpec SMT patch unmarshalling into JobSet template

Signed-off-by: Antonin Stefanutti <[email protected]>

* Add UT for volumes PodSpecOverrides

Signed-off-by: Antonin Stefanutti <[email protected]>

* Add UT for tolerations PodSpecOverrides

Signed-off-by: Antonin Stefanutti <[email protected]>

* Add UT for node selector PodSpecOverrides

Signed-off-by: Antonin Stefanutti <[email protected]>

* Revert back to using TargetJobs []PodSpecOverrideTargetJob

Signed-off-by: Antonin Stefanutti <[email protected]>

* Run make fmt

Signed-off-by: Antonin Stefanutti <[email protected]>

* Add target jobs unicity validation for PodSpecOverrides

Signed-off-by: Antonin Stefanutti <[email protected]>

* Update with code review from @tenzen-y

Signed-off-by: Antonin Stefanutti <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Antonin Stefanutti <[email protected]>
Co-authored-by: Shao Wang <[email protected]>
Co-authored-by: Antonin Stefanutti <[email protected]>
Co-authored-by: Antonin Stefanutti <[email protected]>
 2025-06-06 17:04:18 +00:00
Shao WangandGitHub fc7d3cca19 KEP-2401: Support mutating dataset preprocessing config in SDK (#2638) 
* feat(sdk): Add InstructDataset and dataset_preprocess_config.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update dataset preprocessing API definition in KEP.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): Add get_args_in_dataset_preprocess_config func.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): Add the prefix path for dataset.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(manifests): Load local datasets.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): Add TorchTune prefix to dataset class.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(initializer): Update HF dataset initializer to support data_dir and data_files.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): remove data_files and data_dir definition.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): extract data_files and data_dir from storage_uri.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): fix errors in UT.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(manifest): Update dataset.data_dir in torchtune CTRs.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): fix dataset_uri.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
 2025-06-04 18:08:15 +00:00
Antonin StefanuttiandGitHub 2af1136113 Remove TrainJobCreated condition (#2621) 
* Remove TrainJobCreated condition

Signed-off-by: Antonin Stefanutti <[email protected]>

* Update KEP-2170 proposal

Signed-off-by: Antonin Stefanutti <[email protected]>

* Remove Created condition from SDK

Signed-off-by: Antonin Stefanutti <[email protected]>

* Default TrainJob status to Created unconditionally

Signed-off-by: Antonin Stefanutti <[email protected]>

* Set Failed condition on TrainJob runtime creation errors

Signed-off-by: Antonin Stefanutti <[email protected]>

* Emit a warning event upon TrainJob resources reconcile error

Signed-off-by: Antonin Stefanutti <[email protected]>

* Update TrainJob resources creation failed event

Signed-off-by: Antonin Stefanutti <[email protected]>

* Truncate event message to the maximum length limit

Signed-off-by: Antonin Stefanutti <[email protected]>

* Update state diagram in KEP-2170

Signed-off-by: Antonin Stefanutti <[email protected]>

* Append ellipsis to event message if it's truncated

Signed-off-by: Antonin Stefanutti <[email protected]>

---------

Signed-off-by: Antonin Stefanutti <[email protected]>
 2025-05-02 17:59:05 +00:00
Shao WangandGitHub 998084d2b2 fix(doc): tidy up KEP-2401. (#2594) 
Signed-off-by: Electronic-Waste <[email protected]>
 2025-04-11 22:04:05 +00:00
Yuki IwaiandGitHub 6bb91a5a4f Add PodNetwork plugin to KEP-2170 Job Pipeline Framework description (#2578) 
Signed-off-by: Yuki Iwai <[email protected]>
 2025-03-30 22:35:30 +00:00
Shao WangandGitHub f0edb5271f KEP-2401: Add TorchTuneConfig to train() API (#2522) 
* feat(sdk): add TorchTuneConfig.

Signed-off-by: Electronic-Waste <[email protected]>

* rebase(sdk): rebase on the newest master branch.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): add args description in train().

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): add description for train() func.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): split train() according to trainer and fine_tuning_config

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): update the launching command and args.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): add get_args_using_torchtune_config.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): fix some wrong description in train()

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): update the description of fine_tuning_config.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): remove numProcPernode in train().

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): add TorchTuneConfig in train()

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): add torchtune logic in train()

Signed-off-by: Electronic-Waste <[email protected]>

* feat(sdk): add BuiltinTrainer.

Signed-off-by: Electronic-Waste <[email protected]>

* feat(sdk): add BuiltinTrainer logic.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): add description for initializer.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): update description of runtime

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): address unresolved merge error.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): remove duplicated fields.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): fix train() description according to the review.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): add get_trainer_crd_from_custom_trainer

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): add get_trainer_crd_from_builtin_trainer and refactor train() API.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(sdk): add Loss enum class.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update loss type in KEP-2401

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): remove BuiltinTrainer in train().

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): add enum type for dtype.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update KEP according to the type update of dtype.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update the type description in the table.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): update dtype validation in utils.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): update dtype override according to the review.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
 2025-03-26 12:23:04 +00:00
Shao WangandGitHub 3da33088a8 feat(doc): add Runtime API design in KEP-2401. (#2501) 
* feat(doc): add Runtime API design in KEP-2401.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): fix typo error.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(doc): update the implementation history.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): rename model to pretrained_model.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(doc): update runtime class according to the review.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(doc): update the runtimes design according to PR #2545

Signed-off-by: Electronic-Waste <[email protected]>

* chore(doc): update train() API according to PR #2545

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update runtime_ref field.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
 2025-03-25 02:28:56 +00:00
Andrey VelichkevichandGitHub eb1ee9d0f4 feat(sdk): Support MPI-based TrainJobs (#2545) 
* feat(sdk): Support MPI-based TrainJobs

Signed-off-by: Andrey Velichkevich <[email protected]>

* Refactor list_runtimes

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix example

Signed-off-by: Andrey Velichkevich <[email protected]>

* Add Runtime Trainer object

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update for new Runtime object

Signed-off-by: Andrey Velichkevich <[email protected]>

* Implement get_runtime API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix Torch example

Signed-off-by: Andrey Velichkevich <[email protected]>

* Remove un-unsed consts

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update func args

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update SDK constants

Signed-off-by: Andrey Velichkevich <[email protected]>

* Change to 16Gi

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix container name for MPI

Signed-off-by: Andrey Velichkevich <[email protected]>

* Keep launcher container for MPI

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-03-20 18:08:02 +00:00
Shao WangGitHubAndrey Velichkevich
 		e09f1b46c9 fix(doc): Update train() API in KEP-2401 (#2536) 
* fix(doc): update train API.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update example for train API.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): fix error in train() API example.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update func type in CustomTrainer.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): fix error in runtime_ref type.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): fix some typos.

Signed-off-by: Electronic-Waste <[email protected]>

* Update docs/proposals/2401-llm-trainer-v2/README.md

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Shao Wang <[email protected]>

* Update docs/proposals/2401-llm-trainer-v2/README.md

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Shao Wang <[email protected]>

* Update docs/proposals/2401-llm-trainer-v2/README.md

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Shao Wang <[email protected]>

* Update docs/proposals/2401-llm-trainer-v2/README.md

Co-authored-by: Andrey Velichkevich <[email protected]>
Signed-off-by: Shao Wang <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
Signed-off-by: Shao Wang <[email protected]>
Co-authored-by: Andrey Velichkevich <[email protected]>
 2025-03-18 02:35:20 +00:00
Andrey VelichkevichandGitHub 239b27d311 feat(controller): Refactor the Initializer APIs of TrainJob (#2523) 
* feat(controller): Refactor the Initializer APIs of TrainJob

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix go unit test

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix integration test

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-03-17 07:15:51 +00:00
Shao WangandGitHub e974d313a2 KEP-2401: Kubeflow LLM Trainer V2 (#2410) 
* doc: add initial doc for KEP-2401.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: update motivation.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add llm lifecycle picture.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add goals and non-goals.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add alternatives.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add proposal chapter.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add multiple frameworks support section in design chapter.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add data preprocess section in design chapter.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add fine-tuning config section in design details chapter.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): remote all trailing whitespaces.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: update llm-trainer-v2-workflow img.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: update goals and non-goals.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: remove torchrun proposal to alternatives.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: move torchrun design to alternatives.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: move some fine-tuning config not support by torchtune to alternatives.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: move torchtune sections to proposal and design chapters.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: update proposal & move FSDP config to alternatives.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: update fine-tuning config & unify lora/qlora/dora.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update fine-tuning config & fix doc according to comments.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add model & dataset initialization / model exporting.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add dataset preprocess/tokenizer chapter.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: fix some errors in doc.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: update chapter name.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add type in the diagrams.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add optimizer and scheduler config.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): fix some errors in doc.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add initial parameter override.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: update config override.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: fix some errors in doc.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): add CustomTrainingConfig dataclass.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): integrate torchtune mutation logic into torch plugin.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): split torchtune config chapter.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): add two options for SDK & seperate LoRA chapter.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add an example to show parameters mutation.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add detailed design on mutation in torch plugin.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add dir structure for option 1.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add dir structure for option 2.

Signed-off-by: Electronic-Waste <[email protected]>

* doc: add Test Plans chapter.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): remove device parameter.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): fix typo error.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): fix code line format.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update error in proposal example & add num_nodes and resources_per_node to TorchtuneConfig.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update manifests dir in option 1.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): split complement torch plugin chapter.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): move option 1 (reserving recipe and config) to alternatives & reorganize structures.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update goals & add description in propagate torchtune settings in SDK.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(doc): complete map section in SDK.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(doc): add maintaining ClusterTrainingRuntime chapter.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update recipe selection.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): remove some CTRs & only reserve llama family.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): rename TorchtuneConfig to TorchTuneConfig.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): remove name prefix in CTRs.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update TrainJob and CTR example.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): fix some typos & address comments.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update complement torch plugin section.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): add gemma2 mistral qwen2_5 back.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update implementation history.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): remove the name prefix in CTRs.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update typo according to the review.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(doc): add webhook section.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(doc): add webhook func description.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update item format.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): add the lifecyle of LLM fine-tuning with torchtune.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): remove diagram description.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): reorg and update the doc according to the review.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): fix some typos.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): fix some format error.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update implementation history.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): rename CTRs' file name.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): remove detailed design.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
 2025-03-11 11:29:39 +00:00
Andrey VelichkevichGitHubYuki Iwai
 		0cae7e1b0b feat(controller): Integrate DependsOn API (#2484) 
* feat(controller): Integrate DependsOn API

Signed-off-by: Andrey Velichkevich <[email protected]>

* Use go for unit test

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update Makefile

Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>

* Update Makefile

Co-authored-by: Yuki Iwai <[email protected]>
Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix integration test

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix e2e

Signed-off-by: Andrey Velichkevich <[email protected]>

* Exit 1 if e2e fails

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
Co-authored-by: Yuki Iwai <[email protected]>
 2025-03-07 01:11:34 +00:00
Yuki IwaiandGitHub b6812d7f86 KEP-2170: Add Kubeflow Trainer Pipeline Framework Design (#2439) 
Signed-off-by: Yuki Iwai <[email protected]>
 2025-03-03 21:51:51 +00:00
Anish AsthanaandGitHub d7ee33fbdd Add 'KEP Usage' KEP and template link (#2423) 
Signed-off-by: Anish Asthana <[email protected]>
 2025-02-15 00:23:37 +00:00
Andrey VelichkevichandGitHub 1ff1d8ad28 Update the naming conventions for Kubeflow Trainer (#2415) 
* Update the naming conventions for Kubeflow Trainer

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix webhooks

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix paths for webhooks

Signed-off-by: Andrey Velichkevich <[email protected]>

* Update go test cmd

Signed-off-by: Andrey Velichkevich <[email protected]>

* Rename kubeflowv1 to trainer pkg

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
 2025-02-06 13:48:30 +00:00
Shao WangandGitHub 7777f61acb KEP-2170: Change API Group Name to trainer.kubeflow.org (#2413) 
* fix(apis): change the group of API to trainer.kubeflow.org.

Signed-off-by: Electronic-Waste <[email protected]>

* chore(manifests): update crds in manifests using make manifests.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: change the apia dir name to trainer.kubeflow.org and update reference.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: execute make generate.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: remove remaining kubeflow.org dirs.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): remove outdated docs & update models reference.

Signed-off-by: Electronic-Waste <[email protected]>

* fix: rename apis dir to ttrainer.

Signed-off-by: Electronic-Waste <[email protected]>

* chore: execute make generate.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): remove outdated docs & update models reference.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(sdk): update model reference in code.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(doc): update api grou p in KEP-2170.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
 2025-02-05 13:34:37 +00:00