Files
open-instruct/quantize/README.md
2023-06-09 09:25:00 -07:00

130 B

Compression

Model compression using GPTQ. We're going to rely on the AutoGPTQ code base: https://github.com/PanQiWei/AutoGPTQ.