hanzo-ml/trainer
1
0
Fork 0
mirror of https://github.com/hanzo-ml/trainer.git synced 2026-09-24 00:31:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,765 Commits 2 Branches 1 Tag
master
Commit Graph
278 Commits
Author SHA1 Message Date
zeekay 5707910af9 Merge upstream/master into master (sync fork with upstream) 
# Conflicts:
#	README.md
 2026-07-05 21:03:15 -07:00
zeekayGitHubHanzo Dev
 		0b97a47048 feat(runtimes): hanzo-ft-{lora,qlora,full} — env-driven HF fine-tuning runtimes (#2) 
Adds one transformers + PEFT + TRL ClusterTrainingRuntime per method that
fine-tunes ANY HuggingFace causal LM. The base model + dataset come from the
TrainJob's model/dataset initializers (hf:// or s3://, secretRef for private/gated
repos); every hyperparameter is read from the trainer container env that the Hanzo
Cloud broker sets. Adapters are merged into the base on completion, so one serving
path (KServe HuggingFace runtime) works for lora/qlora/full alike; output is
written to OUTPUT_DIR (the org's S3 Space when s3://).

- manifests/base/runtimes/hanzo_finetune.yaml  3 ClusterTrainingRuntimes (+kustomization)
- cmd/trainers/hanzo/finetune.py               env-driven entrypoint (LoRA/QLoRA/full)
- cmd/trainers/hanzo/finetune_test.py          pytest for the pure config/format helpers
- cmd/trainers/hanzo/{Dockerfile,requirements.txt,README.md}
- examples/yaml/hanzo-finetune-qlora.yaml      example TrainJob (the broker's output)

kustomize build clean · ruff clean · 14 pytest pass. Image built in CI
(ghcr.io/hanzoai/finetune-runtime), not locally.

Co-authored-by: Hanzo Dev <[email protected]>
 2026-06-29 23:53:55 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		478cfaec8d chore(deps): bump transformers from 5.12.0 to 5.12.1 in /cmd/runtimes/deepspeed (#3608) 
Bumps [transformers](https://github.com/huggingface/transformers) from 5.12.0 to 5.12.1.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v5.12.0...v5.12.1)

---
updated-dependencies:
- dependency-name: transformers
  dependency-version: 5.12.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-17 15:22:09 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		f620d0cd19 chore(deps): bump transformers from 5.10.1 to 5.12.0 in /cmd/runtimes/deepspeed (#3585) 
Bumps [transformers](https://github.com/huggingface/transformers) from 5.10.1 to 5.12.0.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v5.10.1...v5.12.0)

---
updated-dependencies:
- dependency-name: transformers
  dependency-version: 5.10.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-12 16:04:51 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		ebf8ad5a22 chore(deps): bump nvidia/cuda from 13.2.1-devel-ubuntu22.04 to 13.3.0-devel-ubuntu22.04 in /cmd/runtimes/deepspeed (#3582) 
Bumps nvidia/cuda from 13.2.1-devel-ubuntu22.04 to 13.3.0-devel-ubuntu22.04.

---
updated-dependencies:
- dependency-name: nvidia/cuda
  dependency-version: 13.3.0-devel-ubuntu22.04
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-12 15:52:59 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		e62951106e chore(deps): bump datasets from 4.8.5 to 5.0.0 in /cmd/runtimes/mlx (#3584) 
Bumps [datasets](https://github.com/huggingface/datasets) from 4.8.5 to 5.0.0.
- [Release notes](https://github.com/huggingface/datasets/releases)
- [Commits](https://github.com/huggingface/datasets/compare/4.8.5...5.0.0)

---
updated-dependencies:
- dependency-name: datasets
  dependency-version: 5.0.0
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-12 15:07:24 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		fd56945654 chore(deps): bump nvidia/cuda from 13.2.1-devel-ubuntu22.04 to 13.3.0-devel-ubuntu22.04 in /cmd/runtimes/mlx (#3583) 
Bumps nvidia/cuda from 13.2.1-devel-ubuntu22.04 to 13.3.0-devel-ubuntu22.04.

---
updated-dependencies:
- dependency-name: nvidia/cuda
  dependency-version: 13.3.0-devel-ubuntu22.04
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-12 15:04:37 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		089da38710 chore(deps): bump datasets from 4.8.5 to 5.0.0 in /cmd/runtimes/deepspeed (#3586) 
Bumps [datasets](https://github.com/huggingface/datasets) from 4.8.5 to 5.0.0.
- [Release notes](https://github.com/huggingface/datasets/releases)
- [Commits](https://github.com/huggingface/datasets/compare/4.8.5...5.0.0)

---
updated-dependencies:
- dependency-name: datasets
  dependency-version: 5.0.0
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-12 15:03:16 +00:00
Krishna GuptaGitHubHanzo Dev
 		4554a7693c feat(ci): automate release process (#3536) 
* feat(release): Add workflows for automated release process and version checks

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Implement automated release process with changelog generation

Signed-off-by: milinddethe15 <[email protected]>

fix lint

Signed-off-by: milinddethe15 <[email protected]>

enhance tag validation and branch creation

Signed-off-by: milinddethe15 <[email protected]>

fix: Add 'area/release' to ignored labels in PR title check

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Enhance release workflows with manual trigger and image build steps

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Add PyPI API token for publishing packages

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Update concurrency settings in publish-helm-charts workflow and upgrade git-cliff-action version

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Update git-cliff-action args to include --unreleased option

Signed-off-by: milinddethe15 <[email protected]>

refactor: reorganize release workflow to generate changelog before GitHub release

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Update GitHub release action to remove changelog prepending and simplify release name

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Refactor GitHub release job to integrate changelog generation and simplify workflow

Signed-off-by: milinddethe15 <[email protected]>

feat(release): create_branch_and_tag job to create_branch and streamline tagging process

Signed-off-by: milinddethe15 <[email protected]>

rebase commit

Signed-off-by: krishna-kg732 <[email protected]>

fix: update release branch naming to use major.minor version format

Signed-off-by: milinddethe15 <[email protected]>

fix endline

Signed-off-by: milinddethe15 <[email protected]>

feat(release): update README with upstream tag fetching instructions

Signed-off-by: milinddethe15 <[email protected]>

Release v2.2.2

Signed-off-by: krishna-kg732 <[email protected]>

Revert "Release v2.2.2"

chore: configure TestPyPI publishing for fork testing

feat: split changelog by release line

Signed-off-by: Krishna Gupta <[email protected]>

chore:removed the monoloith CHANGELOG.md

Signed-off-by: Krishna Gupta <[email protected]>

chore: capitalize Changelog file name

Signed-off-by: krishna-kg732 <[email protected]>

chore: revert fork testing config

Signed-off-by: krishna-kg732 <[email protected]>

chore:latest minor release support updated

Signed-off-by: Krishna Gupta <[email protected]>

chore:resolve changelog casing conflict and restore correct file

Signed-off-by: Krishna Gupta <[email protected]>

chore: resolve git casing conflict

Signed-off-by: Krishna Gupta <[email protected]>

feat: split changelog by release line

Signed-off-by: Krishna Gupta <[email protected]>

chore: capitalize Changelog file name

Signed-off-by: krishna-kg732 <[email protected]>

chore:latest minor release support updated

Signed-off-by: Krishna Gupta <[email protected]>

chore: remove duplicate lowercase changelog file

Signed-off-by: krishna-kg732 <[email protected]>

* Chore:remove the Test release changeLog update

Signed-off-by: krishna-kg732 <[email protected]>

* Potential fix for pull request finding (fix by copilot)

Signed-off-by: Krishna Gupta <[email protected]>

* chore:address review comments

Signed-off-by: Krishna Gupta <[email protected]>

* chore:run pip-compile

Signed-off-by: Krishna Gupta <[email protected]>

* chore: address review

Signed-off-by: Krishna Gupta <[email protected]>

* fix(release): wait for artifact publishing before GitHub release

Signed-off-by: Krishna Gupta <[email protected]>

* refactor(release): delete release.sh, inline make release, and move asset updates to release workflow

Signed-off-by: Krishna Gupta <[email protected]>

* chore(ci): align release workflow and cliff.toml with SDK conventions

Signed-off-by: Krishna Gupta <[email protected]>

* chore: sync requirements lockfiles

Signed-off-by: Krishna Gupta <[email protected]>

* chore: added a new create_tag job and rebased to pass ci

Signed-off-by: Krishna Gupta <[email protected]>

* chore: regenerate lockfiles with Python 3.12 to fix CI

Signed-off-by: Krishna Gupta <[email protected]>

* chore: retrigger CI

Signed-off-by: Krishna Gupta <[email protected]>

* chore : address PR review

Signed-off-by: Krishna Gupta <[email protected]>

---------

Signed-off-by: krishna-kg732 <[email protected]>
Signed-off-by: Krishna Gupta <[email protected]>
Co-authored-by: milinddethe15 <[email protected]>

Co-authored-by: Hanzo Dev <[email protected]>
 2026-06-11 19:59:37 +01:00
Abhijeet DhumalandGitHub 8be19521bf fix: apply clientConnection QPS/burst to the manager client (#3432) 
* fix: Apply clientConnection QPS/burst to the manager's REST client

Signed-off-by: abhijeet-dhumal <[email protected]>

* chore: Regenerate Helm README for clientConnection values

Signed-off-by: abhijeet-dhumal <[email protected]>

* refactor: convert test cases from slices to maps per CONTRIBUTING.md convention

Signed-off-by: abhijeet-dhumal <[email protected]>

* fix: drop redundant default in Helm template and simplify smoke test

Signed-off-by: abhijeet-dhumal <[email protected]>

* fix: address review feedback - update ApplyClientConnection doc, drop redundant test, fractional QPS in values

Signed-off-by: abhijeet-dhumal <[email protected]>

* fix: adjust generated readme

Signed-off-by: abhijeet-dhumal <[email protected]>

* chore: run gofmt on config_test.go

Signed-off-by: abhijeet-dhumal <[email protected]>

* fix failing Helm e2e test PR check

Signed-off-by: abhijeet-dhumal <[email protected]>

---------

Signed-off-by: abhijeet-dhumal <[email protected]>
 2026-06-09 20:21:50 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		462b2ee3ed chore(deps): bump transformers from 5.8.0 to 5.10.1 in /cmd/runtimes/deepspeed (#3571) 
Bumps [transformers](https://github.com/huggingface/transformers) from 5.8.0 to 5.10.1.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v5.8.0...v5.10.1)

---
updated-dependencies:
- dependency-name: transformers
  dependency-version: 5.10.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-04 04:42:54 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		0a67d592bb chore(deps): bump deepspeed from 0.19.0 to 0.19.1 in /cmd/runtimes/deepspeed (#3569) 
Bumps [deepspeed](https://github.com/deepspeedai/DeepSpeed) from 0.19.0 to 0.19.1.
- [Release notes](https://github.com/deepspeedai/DeepSpeed/releases)
- [Commits](https://github.com/deepspeedai/DeepSpeed/compare/v0.19.0...v0.19.1)

---
updated-dependencies:
- dependency-name: deepspeed
  dependency-version: 0.19.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-04 04:41:24 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		3810dd15dc chore(deps): update kagglehub requirement from <1.0.0 to <2.0.0 in /cmd/trainers/torchtune (#3568) 
Updates the requirements on [kagglehub](https://github.com/Kaggle/kagglehub) to permit the latest version.
- [Release notes](https://github.com/Kaggle/kagglehub/releases)
- [Changelog](https://github.com/Kaggle/kagglehub/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Kaggle/kagglehub/compare/v0.0.1a0...v1.0.1)

---
updated-dependencies:
- dependency-name: kagglehub
  dependency-version: 1.0.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-04 04:39:59 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		87b2260f79 chore(deps): bump rust from 1.95-bullseye to 1.96-bullseye in /cmd/data_cache (#3567) 
Bumps rust from 1.95-bullseye to 1.96-bullseye.

---
updated-dependencies:
- dependency-name: rust
  dependency-version: 1.96-bullseye
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-04 04:38:33 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		49b7e29037 chore(deps): bump torch from 2.11.0 to 2.12.0 in /cmd/runtimes/deepspeed (#3527) 
Bumps [torch](https://github.com/pytorch/pytorch) from 2.11.0 to 2.12.0.
- [Release notes](https://github.com/pytorch/pytorch/releases)
- [Changelog](https://github.com/pytorch/pytorch/blob/main/RELEASE.md)
- [Commits](https://github.com/pytorch/pytorch/compare/v2.11.0...v2.12.0)

---
updated-dependencies:
- dependency-name: torch
  dependency-version: 2.12.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-03 17:00:55 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		eb8cd9e3df chore(deps): bump mpi4py from 4.1.1 to 4.1.2 in /cmd/runtimes/deepspeed (#3525) 
Bumps [mpi4py](https://github.com/mpi4py/mpi4py) from 4.1.1 to 4.1.2.
- [Release notes](https://github.com/mpi4py/mpi4py/releases)
- [Changelog](https://github.com/mpi4py/mpi4py/blob/master/CHANGES.rst)
- [Commits](https://github.com/mpi4py/mpi4py/compare/4.1.1...4.1.2)

---
updated-dependencies:
- dependency-name: mpi4py
  dependency-version: 4.1.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-06-03 16:59:34 +00:00
Tariq HasanandGitHub 9183dfd24f chore(scripts): add copyright boilerplate verification (#3359) 
* chore(scripts): add copyright boilerplate verification system

Signed-off-by: tariq-hasan <[email protected]>

* chore(ci): add boilerplate verification to CI pipeline

Signed-off-by: tariq-hasan <[email protected]>

* chore: regenerate files with year-less copyright headers

Signed-off-by: tariq-hasan <[email protected]>

* refactor(boilerplate): simplify verification logic

Signed-off-by: tariq-hasan <[email protected]>

* chore(boilerplate): add missing copyright headers

Signed-off-by: tariq-hasan <[email protected]>

* ci(boilerplate): move verifier to code-quality workflow and run unit tests

Signed-off-by: tariq-hasan <[email protected]>

* feat(boilerplate): accept license headers with any year and remove year validation logic

Signed-off-by: tariq-hasan <[email protected]>

* feat(boilerplate): add copyright headers to generated Python API

Signed-off-by: tariq-hasan <[email protected]>

* refactor(boilerplate): use block-comment header for generated Go files

Signed-off-by: tariq-hasan <[email protected]>

* feat(boilerplate): verify copyright headers in Rust files

Signed-off-by: tariq-hasan <[email protected]>

---------

Signed-off-by: tariq-hasan <[email protected]>
 2026-05-29 10:50:56 +00:00
Yash AgarwalandGitHub 0f4c4be96d fix(examples): use namespaced SQuAD dataset (#3560) 
* fix(examples): use namespaced SQuAD dataset

Signed-off-by: XploY04 <[email protected]>

* fix(runtimes): cap kagglehub below 1.0

Signed-off-by: XploY04 <[email protected]>

---------

Signed-off-by: XploY04 <[email protected]>
 2026-05-28 23:21:00 +00:00
Fiona WatersGitHubHanzo Dev
 		4af1d0a81b feat(ci): add Python dependency scanning to OSV-Scanner workflow (#3530) 
* feat(ci): add Python dependency scanning to OSV-Scanner workflow

Add lockfiles and scanning for Python dependencies in the initializers
and python_api. This extends the nightly OSV-Scanner workflow to cover
Python in addition to Go.

- Generate requirements-lock.txt files via pip-compile for:
  - cmd/initializers/dataset/
  - cmd/initializers/model/
  - api/python_api/
- Add osv-scan-python job with SARIF scanning and auto-fix
- Add validate-lockfile.yaml to ensure lockfiles stay in sync on PRs
- Handle both direct and transitive dependency upgrades

Closes #3528

Signed-off-by: Fiona-Waters <[email protected]>

* fix(ci): address review feedback on Python OSV-Scanner workflow

- Fix validate-lockfile false positives by stripping header comments
  before diffing (pip-compile embeds output filename in header)
- Regenerate lockfiles in clean Python 3.12 venv with --strip-extras
  to include all transitive deps and silence pip-tools deprecation warning
- Fix PR body table formatting: use Markdown table rows instead of
  bullet items in both Go and Python auto-fix jobs
- Escape dots in package names for grep/sed regex safety

Signed-off-by: Fiona-Waters <[email protected]>

* fix(ci): address review feedback on OSV-Scanner Python workflow

- Replace shell grep/sed with Python helper script using
  packaging.requirements.Requirement for exact name matching,
  fixing prefix collision (requests vs requests-oauthlib),
  constraint dropping, and extras stripping
- Skip entry when package not found in lockfile after pip-compile
  instead of recording a false version
- Bump actions/setup-python from v5 to v6 for consistency

Signed-off-by: Fiona-Waters <[email protected]>

* fix(ci): pin pip-tools version in CI workflows

Pin pip-tools to 7.4.1 in osv-scanner and validate-lockfile workflows
to mitigate supply-chain risk in workflows with elevated permissions.

Signed-off-by: Fiona-Waters <[email protected]>

* fix(deps): update lockfiles for certifi 2026.5.20

Signed-off-by: Fiona-Waters <[email protected]>

---------

Signed-off-by: Fiona-Waters <[email protected]>

Co-authored-by: Hanzo Dev <[email protected]>
 2026-05-20 13:34:59 +00:00
Kapil NemaandGitHub 8ad742c557 fix: remove unnecessary setcap CAP_NET_BIND_SERVICE from MPI runtime docker file (#3286) 
sshd in the MPI runtime listens on port 2222 (non-privileged),
so CAP_NET_BIND_SERVICE is not needed. Also removes libcap2-bin
which was only installed to provide the setcap binary.

Fixes #3254

Signed-off-by: kapil27 <[email protected]>
 2026-05-12 16:41:32 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		8d5520ba9e chore(deps): update huggingface-hub requirement from <1.14,>=1.13.0 to >=1.14.0,<1.15 in /cmd/initializers/model (#3502) 
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v1.13.0...v1.14.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.14.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-05-12 13:36:54 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		1a873bf771 chore(deps): update huggingface-hub requirement from <1.14,>=1.13.0 to >=1.14.0,<1.15 in /cmd/initializers/dataset (#3499) 
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v1.13.0...v1.14.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.14.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-05-12 08:17:05 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		59ed336452 chore(deps): bump transformers from 5.7.0 to 5.8.0 in /cmd/runtimes/deepspeed (#3498) 
Bumps [transformers](https://github.com/huggingface/transformers) from 5.7.0 to 5.8.0.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v5.7.0...v5.8.0)

---
updated-dependencies:
- dependency-name: transformers
  dependency-version: 5.8.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-05-12 08:15:48 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		07a520389a chore(deps): bump deepspeed from 0.18.9 to 0.19.0 in /cmd/runtimes/deepspeed (#3496) 
Bumps [deepspeed](https://github.com/deepspeedai/DeepSpeed) from 0.18.9 to 0.19.0.
- [Release notes](https://github.com/deepspeedai/DeepSpeed/releases)
- [Commits](https://github.com/deepspeedai/DeepSpeed/compare/v0.18.9...v0.19.0)

---
updated-dependencies:
- dependency-name: deepspeed
  dependency-version: 0.19.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-05-12 07:47:00 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		c92daa7c0c chore(deps): update opendal requirement from >=0.46.0 to >=0.47.1 in /cmd/initializers/model (#3484) 
Updates the requirements on [opendal](https://github.com/apache/opendal) to permit the latest version.
- [Release notes](https://github.com/apache/opendal/releases)
- [Changelog](https://github.com/apache/opendal/blob/main/CHANGELOG.md)
- [Commits](https://github.com/apache/opendal/compare/v0.46.0...v0.47.1)

---
updated-dependencies:
- dependency-name: opendal
  dependency-version: 0.47.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-05-07 18:49:36 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		40d42a0df6 chore(deps): update opendal requirement from >=0.46.0 to >=0.47.1 in /cmd/initializers/dataset (#3477) 
Updates the requirements on [opendal](https://github.com/apache/opendal) to permit the latest version.
- [Release notes](https://github.com/apache/opendal/releases)
- [Changelog](https://github.com/apache/opendal/blob/main/CHANGELOG.md)
- [Commits](https://github.com/apache/opendal/compare/v0.46.0...v0.47.1)

---
updated-dependencies:
- dependency-name: opendal
  dependency-version: 0.47.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-05-07 07:25:38 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		033b8c1970 chore(deps): update huggingface-hub requirement from <1.13,>=1.12.0 to >=1.13.0,<1.14 in /cmd/initializers/model (#3480) 
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v1.12.0...v1.13.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.13.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-05-07 07:23:38 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		66032ba305 chore(deps): bump transformers from 5.6.2 to 5.7.0 in /cmd/runtimes/deepspeed (#3479) 
Bumps [transformers](https://github.com/huggingface/transformers) from 5.6.2 to 5.7.0.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v5.6.2...v5.7.0)

---
updated-dependencies:
- dependency-name: transformers
  dependency-version: 5.7.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-05-05 10:43:04 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		5d6ef73ed4 chore(deps): update kagglehub requirement from >=1.0.0 to >=1.0.1 in /cmd/trainers/torchtune (#3476) 
Updates the requirements on [kagglehub](https://github.com/Kaggle/kagglehub) to permit the latest version.
- [Release notes](https://github.com/Kaggle/kagglehub/releases)
- [Changelog](https://github.com/Kaggle/kagglehub/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Kaggle/kagglehub/compare/v1.0.0...v1.0.1)

---
updated-dependencies:
- dependency-name: kagglehub
  dependency-version: 1.0.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-05-05 05:05:11 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		3021c58db4 chore(deps): update huggingface-hub requirement from <1.13,>=1.12.0 to >=1.13.0,<1.14 in /cmd/initializers/dataset (#3481) 
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v1.12.0...v1.13.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.13.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-05-05 05:02:52 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		3bb112a4c2 chore(deps): update bitsandbytes requirement from >=0.41.1 to >=0.49.2 in /cmd/trainers/torchtune (#3463) 
Updates the requirements on [bitsandbytes](https://github.com/bitsandbytes-foundation/bitsandbytes) to permit the latest version.
- [Release notes](https://github.com/bitsandbytes-foundation/bitsandbytes/releases)
- [Changelog](https://github.com/bitsandbytes-foundation/bitsandbytes/blob/main/CHANGELOG.md)
- [Commits](https://github.com/bitsandbytes-foundation/bitsandbytes/compare/0.42.0...0.49.2)

---
updated-dependencies:
- dependency-name: bitsandbytes
  dependency-version: 0.49.2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-28 12:13:00 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		03632164b0 chore(deps): bump transformers from 5.5.4 to 5.6.2 in /cmd/runtimes/deepspeed (#3462) 
Bumps [transformers](https://github.com/huggingface/transformers) from 5.5.4 to 5.6.2.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v5.5.4...v5.6.2)

---
updated-dependencies:
- dependency-name: transformers
  dependency-version: 5.6.2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-28 12:10:00 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		b348187c3e chore(deps): bump datasets from 4.8.4 to 4.8.5 in /cmd/runtimes/deepspeed (#3465) 
Bumps [datasets](https://github.com/huggingface/datasets) from 4.8.4 to 4.8.5.
- [Release notes](https://github.com/huggingface/datasets/releases)
- [Commits](https://github.com/huggingface/datasets/compare/4.8.4...4.8.5)

---
updated-dependencies:
- dependency-name: datasets
  dependency-version: 4.8.5
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-28 10:18:01 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		477bfa9d02 chore(deps): bump mlx-lm from 0.31.2 to 0.31.3 in /cmd/runtimes/mlx (#3461) 
Bumps [mlx-lm](https://github.com/ml-explore/mlx-lm) from 0.31.2 to 0.31.3.
- [Release notes](https://github.com/ml-explore/mlx-lm/releases)
- [Commits](https://github.com/ml-explore/mlx-lm/compare/v0.31.2...v0.31.3)

---
updated-dependencies:
- dependency-name: mlx-lm
  dependency-version: 0.31.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-28 05:57:00 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		8baccfa65e chore(deps): update huggingface-hub requirement from <1.12,>=0.27.0 to >=1.12.0,<1.13 in /cmd/initializers/dataset (#3464) 
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.12.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.12.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-28 05:56:00 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		a91426fe67 chore(deps): update huggingface-hub requirement from <1.12,>=0.27.0 to >=1.12.0,<1.13 in /cmd/initializers/model (#3460) 
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.12.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.12.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-28 04:23:59 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		a878297264 chore(deps): update kagglehub requirement from >=0.4.0 to >=1.0.0 in /cmd/trainers/torchtune (#3459) 
Updates the requirements on [kagglehub](https://github.com/Kaggle/kagglehub) to permit the latest version.
- [Release notes](https://github.com/Kaggle/kagglehub/releases)
- [Changelog](https://github.com/Kaggle/kagglehub/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Kaggle/kagglehub/compare/v0.4.0...v1.0.0)

---
updated-dependencies:
- dependency-name: kagglehub
  dependency-version: 1.0.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-28 04:22:59 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		d96a36c271 chore(deps): update kubernetes requirement from >=27.2.0 to >=35.0.0 in /cmd/initializers/dataset (#3458) 
Updates the requirements on [kubernetes](https://github.com/kubernetes-client/python) to permit the latest version.
- [Release notes](https://github.com/kubernetes-client/python/releases)
- [Changelog](https://github.com/kubernetes-client/python/blob/master/CHANGELOG.md)
- [Commits](https://github.com/kubernetes-client/python/compare/v27.2.0...v35.0.0)

---
updated-dependencies:
- dependency-name: kubernetes
  dependency-version: 35.0.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-28 04:21:59 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		7f300468b9 chore(deps): bump datasets from 4.8.4 to 4.8.5 in /cmd/runtimes/mlx (#3457) 
Bumps [datasets](https://github.com/huggingface/datasets) from 4.8.4 to 4.8.5.
- [Release notes](https://github.com/huggingface/datasets/releases)
- [Commits](https://github.com/huggingface/datasets/compare/4.8.4...4.8.5)

---
updated-dependencies:
- dependency-name: datasets
  dependency-version: 4.8.5
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-28 04:20:59 +00:00
Andrey VelichkevichandGitHub 1600c14be8 chore(deps): Bumo Go to 1.26 (#3451) 
Signed-off-by: Andrey Velichkevich <[email protected]>
 2026-04-28 00:48:59 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		ff13b96e49 chore(deps): bump torch from 2.10.0 to 2.11.0 in /cmd/runtimes/deepspeed (#3383) 
Bumps [torch](https://github.com/pytorch/pytorch) from 2.10.0 to 2.11.0.
- [Release notes](https://github.com/pytorch/pytorch/releases)
- [Changelog](https://github.com/pytorch/pytorch/blob/main/RELEASE.md)
- [Commits](https://github.com/pytorch/pytorch/compare/v2.10.0...v2.11.0)

---
updated-dependencies:
- dependency-name: torch
  dependency-version: 2.11.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-22 17:27:29 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		f5ee240279 chore(deps): bump nvidia/cuda from 13.2.0-devel-ubuntu22.04 to 13.2.1-devel-ubuntu22.04 in /cmd/runtimes/mlx (#3439) 
Bumps nvidia/cuda from 13.2.0-devel-ubuntu22.04 to 13.2.1-devel-ubuntu22.04.

---
updated-dependencies:
- dependency-name: nvidia/cuda
  dependency-version: 13.2.1-devel-ubuntu22.04
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-21 08:43:26 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		eba475cc43 chore(deps): bump rust from 1.94-bullseye to 1.95-bullseye in /cmd/data_cache (#3438) 
Bumps rust from 1.94-bullseye to 1.95-bullseye.

---
updated-dependencies:
- dependency-name: rust
  dependency-version: 1.95-bullseye
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-21 08:42:28 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		86857bf545 chore(deps): bump datasets from 4.7.0 to 4.8.4 in /cmd/runtimes/deepspeed (#3384) 
Bumps [datasets](https://github.com/huggingface/datasets) from 4.7.0 to 4.8.4.
- [Release notes](https://github.com/huggingface/datasets/releases)
- [Commits](https://github.com/huggingface/datasets/compare/4.7.0...4.8.4)

---
updated-dependencies:
- dependency-name: datasets
  dependency-version: 4.8.4
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-21 02:22:26 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		915404d41e chore(deps): bump deepspeed from 0.18.7 to 0.18.9 in /cmd/runtimes/deepspeed (#3402) 
Bumps [deepspeed](https://github.com/deepspeedai/DeepSpeed) from 0.18.7 to 0.18.9.
- [Release notes](https://github.com/deepspeedai/DeepSpeed/releases)
- [Commits](https://github.com/deepspeedai/DeepSpeed/compare/v0.18.7...v0.18.9)

---
updated-dependencies:
- dependency-name: deepspeed
  dependency-version: 0.18.9
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-21 02:21:27 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		7c6452fd28 chore(deps): update huggingface-hub requirement from <1.11,>=0.27.0 to >=0.27.0,<1.12 in /cmd/initializers/dataset (#3443) 
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.11.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.11.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-21 02:16:27 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		44476ec9b2 chore(deps): update huggingface-hub requirement from <1.11,>=0.27.0 to >=0.27.0,<1.12 in /cmd/initializers/model (#3441) 
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.11.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.11.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-21 02:15:27 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		5006cd5d36 chore(deps): bump nvidia/cuda from 13.2.0-devel-ubuntu22.04 to 13.2.1-devel-ubuntu22.04 in /cmd/runtimes/deepspeed (#3437) 
Bumps nvidia/cuda from 13.2.0-devel-ubuntu22.04 to 13.2.1-devel-ubuntu22.04.

---
updated-dependencies:
- dependency-name: nvidia/cuda
  dependency-version: 13.2.1-devel-ubuntu22.04
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-21 02:14:27 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		a9cb80213a chore(deps): bump transformers from 5.4.0 to 5.5.4 in /cmd/runtimes/deepspeed (#3425) 
Bumps [transformers](https://github.com/huggingface/transformers) from 5.4.0 to 5.5.4.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v5.4.0...v5.5.4)

---
updated-dependencies:
- dependency-name: transformers
  dependency-version: 5.5.4
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-14 07:44:13 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		4e6dca5a08 chore(deps): bump nvidia/cuda from 13.1.1-devel-ubuntu22.04 to 13.2.0-devel-ubuntu22.04 in /cmd/runtimes/deepspeed (#3380) 
Bumps nvidia/cuda from 13.1.1-devel-ubuntu22.04 to 13.2.0-devel-ubuntu22.04.

---
updated-dependencies:
- dependency-name: nvidia/cuda
  dependency-version: 13.2.0-devel-ubuntu22.04
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-04-14 03:34:46 +00:00