mirror of https://github.com/zoo-apps/gym.git synced 2026-10-30 14:57:09 +00:00

Files

T

History

* use warmup_ratio as a better default than warmup steps since it's data dependent

* replace remainder of warmup_steps

2025-07-30 06:44:06 -04:00

config.yml

2025-07-30 06:44:06 -04:00

lora.yml

2025-07-30 06:44:06 -04:00

qlora.yml

2025-07-30 06:44:06 -04:00

README.md

2025-07-12 11:39:51 -04:00

openllama-3b

Basic full tune

accelerate launch scripts/finetune.py examples/openllama-3b/config.yml

LoRA

accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml

QLoRA

accelerate launch scripts/finetune.py examples/openllama-3b/qlora.yml