Files
8710794223 Configs for DPO; some repo organization (#183)
* init pr

* add script

* clean config folders

* organization

* up

* tokenizer fixes

* Fix dpo script tokenizer setup + minor fixes (#184)

* copy tokenizer setup

* minor fixes

---------

Co-authored-by: Hamish Ivison <[email protected]>
2024-07-10 10:22:55 -07:00

6 lines
353 B
Bash
Executable File

RAW_MODEL_PATH=$1
model_size=$2
og_name=$3
python scripts/weight_diff.py make_diff --path_raw ${RAW_MODEL_PATH}/${model_size} --path_tuned /model --path_diff /results/${og_name}-diff
python scripts/weight_diff.py recover --path_raw ${RAW_MODEL_PATH}/${model_size} --path_tuned test_recover --path_diff /results/${og_name}-diff --original_model /model