Commit Graph
33 Commits
Author SHA1 Message Date
4554a7693c feat(ci): automate release process (#3536)
* feat(release): Add workflows for automated release process and version checks

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Implement automated release process with changelog generation

Signed-off-by: milinddethe15 <[email protected]>

fix lint

Signed-off-by: milinddethe15 <[email protected]>

enhance tag validation and branch creation

Signed-off-by: milinddethe15 <[email protected]>

fix: Add 'area/release' to ignored labels in PR title check

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Enhance release workflows with manual trigger and image build steps

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Add PyPI API token for publishing packages

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Update concurrency settings in publish-helm-charts workflow and upgrade git-cliff-action version

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Update git-cliff-action args to include --unreleased option

Signed-off-by: milinddethe15 <[email protected]>

refactor: reorganize release workflow to generate changelog before GitHub release

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Update GitHub release action to remove changelog prepending and simplify release name

Signed-off-by: milinddethe15 <[email protected]>

feat(release): Refactor GitHub release job to integrate changelog generation and simplify workflow

Signed-off-by: milinddethe15 <[email protected]>

feat(release): create_branch_and_tag job to create_branch and streamline tagging process

Signed-off-by: milinddethe15 <[email protected]>

rebase commit

Signed-off-by: krishna-kg732 <[email protected]>

fix: update release branch naming to use major.minor version format

Signed-off-by: milinddethe15 <[email protected]>

fix endline

Signed-off-by: milinddethe15 <[email protected]>

feat(release): update README with upstream tag fetching instructions

Signed-off-by: milinddethe15 <[email protected]>

Release v2.2.2

Signed-off-by: krishna-kg732 <[email protected]>

Revert "Release v2.2.2"

chore: configure TestPyPI publishing for fork testing

feat: split changelog by release line

Signed-off-by: Krishna Gupta <[email protected]>

chore:removed the monoloith CHANGELOG.md

Signed-off-by: Krishna Gupta <[email protected]>

chore: capitalize Changelog file name

Signed-off-by: krishna-kg732 <[email protected]>

chore: revert fork testing config

Signed-off-by: krishna-kg732 <[email protected]>

chore:latest minor release support updated

Signed-off-by: Krishna Gupta <[email protected]>

chore:resolve changelog casing conflict and restore correct file

Signed-off-by: Krishna Gupta <[email protected]>

chore: resolve git casing conflict

Signed-off-by: Krishna Gupta <[email protected]>

feat: split changelog by release line

Signed-off-by: Krishna Gupta <[email protected]>

chore: capitalize Changelog file name

Signed-off-by: krishna-kg732 <[email protected]>

chore:latest minor release support updated

Signed-off-by: Krishna Gupta <[email protected]>

chore: remove duplicate lowercase changelog file

Signed-off-by: krishna-kg732 <[email protected]>

* Chore:remove the Test release changeLog update

Signed-off-by: krishna-kg732 <[email protected]>

* Potential fix for pull request finding (fix by copilot)

Signed-off-by: Krishna Gupta <[email protected]>

* chore:address review comments

Signed-off-by: Krishna Gupta <[email protected]>

* chore:run pip-compile

Signed-off-by: Krishna Gupta <[email protected]>

* chore: address review

Signed-off-by: Krishna Gupta <[email protected]>

* fix(release): wait for artifact publishing before GitHub release

Signed-off-by: Krishna Gupta <[email protected]>

* refactor(release): delete release.sh, inline make release, and move asset updates to release workflow

Signed-off-by: Krishna Gupta <[email protected]>

* chore(ci): align release workflow and cliff.toml with SDK conventions

Signed-off-by: Krishna Gupta <[email protected]>

* chore: sync requirements lockfiles

Signed-off-by: Krishna Gupta <[email protected]>

* chore: added a new create_tag job and rebased to pass ci

Signed-off-by: Krishna Gupta <[email protected]>

* chore: regenerate lockfiles with Python 3.12 to fix CI

Signed-off-by: Krishna Gupta <[email protected]>

* chore: retrigger CI

Signed-off-by: Krishna Gupta <[email protected]>

* chore : address PR review

Signed-off-by: Krishna Gupta <[email protected]>

---------

Signed-off-by: krishna-kg732 <[email protected]>
Signed-off-by: Krishna Gupta <[email protected]>
Co-authored-by: milinddethe15 <[email protected]>

Co-authored-by: Hanzo Dev <[email protected]>
2026-06-11 19:59:37 +01:00
Tariq HasanandGitHub 9183dfd24f chore(scripts): add copyright boilerplate verification (#3359)
* chore(scripts): add copyright boilerplate verification system

Signed-off-by: tariq-hasan <[email protected]>

* chore(ci): add boilerplate verification to CI pipeline

Signed-off-by: tariq-hasan <[email protected]>

* chore: regenerate files with year-less copyright headers

Signed-off-by: tariq-hasan <[email protected]>

* refactor(boilerplate): simplify verification logic

Signed-off-by: tariq-hasan <[email protected]>

* chore(boilerplate): add missing copyright headers

Signed-off-by: tariq-hasan <[email protected]>

* ci(boilerplate): move verifier to code-quality workflow and run unit tests

Signed-off-by: tariq-hasan <[email protected]>

* feat(boilerplate): accept license headers with any year and remove year validation logic

Signed-off-by: tariq-hasan <[email protected]>

* feat(boilerplate): add copyright headers to generated Python API

Signed-off-by: tariq-hasan <[email protected]>

* refactor(boilerplate): use block-comment header for generated Go files

Signed-off-by: tariq-hasan <[email protected]>

* feat(boilerplate): verify copyright headers in Rust files

Signed-off-by: tariq-hasan <[email protected]>

---------

Signed-off-by: tariq-hasan <[email protected]>
2026-05-29 10:50:56 +00:00
4af1d0a81b feat(ci): add Python dependency scanning to OSV-Scanner workflow (#3530)
* feat(ci): add Python dependency scanning to OSV-Scanner workflow

Add lockfiles and scanning for Python dependencies in the initializers
and python_api. This extends the nightly OSV-Scanner workflow to cover
Python in addition to Go.

- Generate requirements-lock.txt files via pip-compile for:
  - cmd/initializers/dataset/
  - cmd/initializers/model/
  - api/python_api/
- Add osv-scan-python job with SARIF scanning and auto-fix
- Add validate-lockfile.yaml to ensure lockfiles stay in sync on PRs
- Handle both direct and transitive dependency upgrades

Closes #3528

Signed-off-by: Fiona-Waters <[email protected]>

* fix(ci): address review feedback on Python OSV-Scanner workflow

- Fix validate-lockfile false positives by stripping header comments
  before diffing (pip-compile embeds output filename in header)
- Regenerate lockfiles in clean Python 3.12 venv with --strip-extras
  to include all transitive deps and silence pip-tools deprecation warning
- Fix PR body table formatting: use Markdown table rows instead of
  bullet items in both Go and Python auto-fix jobs
- Escape dots in package names for grep/sed regex safety

Signed-off-by: Fiona-Waters <[email protected]>

* fix(ci): address review feedback on OSV-Scanner Python workflow

- Replace shell grep/sed with Python helper script using
  packaging.requirements.Requirement for exact name matching,
  fixing prefix collision (requests vs requests-oauthlib),
  constraint dropping, and extras stripping
- Skip entry when package not found in lockfile after pip-compile
  instead of recording a false version
- Bump actions/setup-python from v5 to v6 for consistency

Signed-off-by: Fiona-Waters <[email protected]>

* fix(ci): pin pip-tools version in CI workflows

Pin pip-tools to 7.4.1 in osv-scanner and validate-lockfile workflows
to mitigate supply-chain risk in workflows with elevated permissions.

Signed-off-by: Fiona-Waters <[email protected]>

* fix(deps): update lockfiles for certifi 2026.5.20

Signed-off-by: Fiona-Waters <[email protected]>

---------

Signed-off-by: Fiona-Waters <[email protected]>

Co-authored-by: Hanzo Dev <[email protected]>
2026-05-20 13:34:59 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
8d5520ba9e chore(deps): update huggingface-hub requirement from <1.14,>=1.13.0 to >=1.14.0,<1.15 in /cmd/initializers/model (#3502)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v1.13.0...v1.14.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.14.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-05-12 13:36:54 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1a873bf771 chore(deps): update huggingface-hub requirement from <1.14,>=1.13.0 to >=1.14.0,<1.15 in /cmd/initializers/dataset (#3499)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v1.13.0...v1.14.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.14.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-05-12 08:17:05 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
c92daa7c0c chore(deps): update opendal requirement from >=0.46.0 to >=0.47.1 in /cmd/initializers/model (#3484)
Updates the requirements on [opendal](https://github.com/apache/opendal) to permit the latest version.
- [Release notes](https://github.com/apache/opendal/releases)
- [Changelog](https://github.com/apache/opendal/blob/main/CHANGELOG.md)
- [Commits](https://github.com/apache/opendal/compare/v0.46.0...v0.47.1)

---
updated-dependencies:
- dependency-name: opendal
  dependency-version: 0.47.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-05-07 18:49:36 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
40d42a0df6 chore(deps): update opendal requirement from >=0.46.0 to >=0.47.1 in /cmd/initializers/dataset (#3477)
Updates the requirements on [opendal](https://github.com/apache/opendal) to permit the latest version.
- [Release notes](https://github.com/apache/opendal/releases)
- [Changelog](https://github.com/apache/opendal/blob/main/CHANGELOG.md)
- [Commits](https://github.com/apache/opendal/compare/v0.46.0...v0.47.1)

---
updated-dependencies:
- dependency-name: opendal
  dependency-version: 0.47.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-05-07 07:25:38 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
033b8c1970 chore(deps): update huggingface-hub requirement from <1.13,>=1.12.0 to >=1.13.0,<1.14 in /cmd/initializers/model (#3480)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v1.12.0...v1.13.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.13.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-05-07 07:23:38 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
3021c58db4 chore(deps): update huggingface-hub requirement from <1.13,>=1.12.0 to >=1.13.0,<1.14 in /cmd/initializers/dataset (#3481)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v1.12.0...v1.13.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.13.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-05-05 05:02:52 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
8baccfa65e chore(deps): update huggingface-hub requirement from <1.12,>=0.27.0 to >=1.12.0,<1.13 in /cmd/initializers/dataset (#3464)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.12.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.12.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-28 05:56:00 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
a91426fe67 chore(deps): update huggingface-hub requirement from <1.12,>=0.27.0 to >=1.12.0,<1.13 in /cmd/initializers/model (#3460)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.12.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.12.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-28 04:23:59 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
d96a36c271 chore(deps): update kubernetes requirement from >=27.2.0 to >=35.0.0 in /cmd/initializers/dataset (#3458)
Updates the requirements on [kubernetes](https://github.com/kubernetes-client/python) to permit the latest version.
- [Release notes](https://github.com/kubernetes-client/python/releases)
- [Changelog](https://github.com/kubernetes-client/python/blob/master/CHANGELOG.md)
- [Commits](https://github.com/kubernetes-client/python/compare/v27.2.0...v35.0.0)

---
updated-dependencies:
- dependency-name: kubernetes
  dependency-version: 35.0.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-28 04:21:59 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
7c6452fd28 chore(deps): update huggingface-hub requirement from <1.11,>=0.27.0 to >=0.27.0,<1.12 in /cmd/initializers/dataset (#3443)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.11.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.11.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-21 02:16:27 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
44476ec9b2 chore(deps): update huggingface-hub requirement from <1.11,>=0.27.0 to >=0.27.0,<1.12 in /cmd/initializers/model (#3441)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.11.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.11.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-21 02:15:27 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
527f2e2ace chore(deps): update huggingface-hub requirement from <1.10,>=0.27.0 to >=0.27.0,<1.11 in /cmd/initializers/model (#3424)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.10.1)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.10.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-14 03:11:52 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
d23d094ee0 chore(deps): update huggingface-hub requirement from <1.7,>=0.27.0 to >=0.27.0,<1.10 in /cmd/initializers/model (#3414)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.9.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.9.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-10 13:30:19 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
ec710d9b65 chore(deps): update huggingface-hub requirement from <1.9,>=0.27.0 to >=0.27.0,<1.10 in /cmd/initializers/dataset (#3415)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.9.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.9.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-04-10 13:29:19 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
63e5e9dcc2 chore(deps): update huggingface-hub requirement from <1.7,>=0.27.0 to >=0.27.0,<1.9 in /cmd/initializers/dataset (#3397)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.8.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.8.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-31 04:54:04 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
aed5c0a185 chore(deps): update huggingface-hub requirement from <1.5,>=0.27.0 to >=0.27.0,<1.7 in /cmd/initializers/dataset (#3296)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.6.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.6.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-13 10:48:00 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
e39297d82d chore(deps): update huggingface-hub requirement from <1.5,>=0.27.0 to >=0.27.0,<1.7 in /cmd/initializers/model (#3292)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.6.0)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.6.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-03-13 10:45:00 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
82fc4f385d chore(deps): update huggingface-hub requirement from <1.4,>=0.27.0 to >=0.27.0,<1.5 in /cmd/initializers/dataset (#3194)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.4.1)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.4.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-18 02:53:29 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
d94403d0a9 chore(deps): update huggingface-hub requirement from <1.4,>=0.27.0 to >=0.27.0,<1.5 in /cmd/initializers/model (#3198)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.4.1)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.4.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-02-16 04:20:28 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
80ad26f406 chore(deps): update huggingface-hub requirement from <1.2,>=0.27.0 to >=0.27.0,<1.4 in /cmd/initializers/dataset (#3090)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.3.1)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.3.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-13 16:44:53 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
44739d474c chore(deps): update huggingface-hub requirement from <1.2,>=0.27.0 to >=0.27.0,<1.4 in /cmd/initializers/model (#3091)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.3.1)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.3.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-01-13 14:30:51 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
8908611584 chore(deps): update huggingface-hub requirement from <0.28,>=0.27.0 to >=0.27.0,<1.2 in /cmd/initializers/model (#2957)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.1.2)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.1.2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-11-16 00:55:01 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
6645e5b29e chore(deps): update huggingface-hub requirement from <0.28,>=0.27.0 to >=0.27.0,<1.2 in /cmd/initializers/dataset (#2955)
Updates the requirements on [huggingface-hub](https://github.com/huggingface/huggingface_hub) to permit the latest version.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases)
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.27.0...v1.1.2)

---
updated-dependencies:
- dependency-name: huggingface-hub
  dependency-version: 1.1.2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-11-16 00:53:01 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
dc4bfd0563 chore(deps): bump python from 3.11-slim-bookworm to 3.14-slim-bookworm in /cmd/initializers/model (#2951)
Bumps python from 3.11-slim-bookworm to 3.14-slim-bookworm.

---
updated-dependencies:
- dependency-name: python
  dependency-version: 3.14-slim-bookworm
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-11-10 20:28:56 +00:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
8750553bf1 chore(deps): bump python from 3.11-slim-bookworm to 3.14-slim-bookworm in /cmd/initializers/dataset (#2941)
Bumps python from 3.11-slim-bookworm to 3.14-slim-bookworm.

---
updated-dependencies:
- dependency-name: python
  dependency-version: 3.14-slim-bookworm
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-11-10 20:27:56 +00:00
Yuchen ChengandGitHub 9b198974a7 feat(initializer): add s3 model and dataset initializers (#2728)
* feat(initializer): add s3 model and dataset initializers

Signed-off-by: rudeigerc <[email protected]>

* chore: refactor with opendal

Signed-off-by: rudeigerc <[email protected]>

* chore: support `role_arn` and add `ignore_patterns` field in the Initializers configs

Signed-off-by: rudeigerc <[email protected]>

---------

Signed-off-by: rudeigerc <[email protected]>
2025-10-31 15:28:12 +00:00
4361def5e3 feat(cache): KEP-2655: Adding cache initializer (#2793)
Signed-off-by: Akshay Chitneni <[email protected]>
Co-authored-by: Akshay Chitneni <[email protected]>
2025-10-13 19:53:06 +00:00
Debabrata47andGitHub d6c6ae68bd feat(initializer): Updated base image to Debian image and changed install commands compatible with Debian image (#2528)
Signed-off-by: Debabrata47 <[email protected]>
2025-08-11 00:29:42 +00:00
Shao WangandGitHub c6d3ee01fc fix(plugins): Fix some errors in torchtune mutation process. (#2675)
* fix(plugins): fix errors in trainer command mutation of torchtune.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(plugins): remove config file format suffix.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(test): update UTs.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(initializer): Update the workspace of dataset/model initializer.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(plugins): parse nproc_per_node from GPU resource.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(torchtune): Add bitsandbytes dependency in requirements.txt

Signed-off-by: Electronic-Waste <[email protected]>

* fix(lint): fix lint error.

Signed-off-by: Electronic-Waste <[email protected]>

* fix(torchtune): Remove unnecessary num_proc_per_node calculation.

Signed-off-by: Electronic-Waste <[email protected]>

* test(torch): Update invalid parameters.

Signed-off-by: Electronic-Waste <[email protected]>

---------

Signed-off-by: Electronic-Waste <[email protected]>
2025-06-30 14:56:21 +00:00
Andrey VelichkevichandGitHub 239b27d311 feat(controller): Refactor the Initializer APIs of TrainJob (#2523)
* feat(controller): Refactor the Initializer APIs of TrainJob

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix go unit test

Signed-off-by: Andrey Velichkevich <[email protected]>

* Fix integration test

Signed-off-by: Andrey Velichkevich <[email protected]>

---------

Signed-off-by: Andrey Velichkevich <[email protected]>
2025-03-17 07:15:51 +00:00