Costa HuangandGitHub afff499a7a Synthetic preference dataset (#332) ...

* push changes

* Support hf revision when generating

* style an quality

* add synthetic preference dataset scripts

* deal with reference generation as part of rejection sampling as well

* add litellm dependency

* suppport dataset_mixer_list

* Add openai api key to useful secretes

* style and quality

* quick push

* add reference

* quick update

2024-10-02 14:39:21 -04:00

602 KiB

2412x1848px

Raw Permalink History