Files
9ab3763631 Ray Train Axolotl Integration (#2251)
* current

not clean working version
move torch trainer to do_cli
update code with config changes and clean up
edit config
cleanup
add run name to trainer

* address comments

* use axolotl train in multigpu tests and add ray tests for multi-gpu

* accelerate uses underscores for main_process_port arg

* chore: lint

* fix order of accelerate args

* include ray train in docker images

* current

not clean working version
move torch trainer to do_cli
update code with config changes and clean up
edit config
cleanup
add run name to trainer

* address comments

* use axolotl train in multigpu tests and add ray tests for multi-gpu

* accelerate uses underscores for main_process_port arg

* chore: lint

* fix order of accelerate args

* include ray train in docker images

* fix bf16 resolution behavior

* move dtype logic

* x

Signed-off-by: SumanthRH <[email protected]>

* rename

Signed-off-by: SumanthRH <[email protected]>

* add to sidebar

Signed-off-by: SumanthRH <[email protected]>

* Apply suggestions from code review

Co-authored-by: Eric Tang <[email protected]>

* Update docs/ray-integration.qmd

Co-authored-by: Eric Tang <[email protected]>

* pre-commit fixes

Signed-off-by: SumanthRH <[email protected]>

* use output_dir instead of hardcoded saves path

Co-authored-by: NanoCode012 <[email protected]>

* bugfix storage dir

* change type\ for resources_per_worker

---------

Signed-off-by: SumanthRH <[email protected]>
Co-authored-by: Wing Lian <[email protected]>
Co-authored-by: SumanthRH <[email protected]>
Co-authored-by: Sumanth R Hegde <[email protected]>
Co-authored-by: Wing Lian <[email protected]>
Co-authored-by: NanoCode012 <[email protected]>
2025-01-29 00:10:19 -05:00
..