Files
Andrews ArokiamandGitHub 007fc8dfe4 Implement Huggingface model download in storage initializer (#3584)
* initial commit for hugging face model download and load

Signed-off-by: Andrews Arokiam <[email protected]>

* bug fix on storage initializer

Signed-off-by: Andrews Arokiam <[email protected]>

* added hf_token and unittests

Signed-off-by: Andrews Arokiam <[email protected]>

* separate hf-storage-initializer image to reduce image size

Signed-off-by: Andrews Arokiam <[email protected]>

* review comment changes

Signed-off-by: Andrews Arokiam <[email protected]>

* snapshot download

Signed-off-by: Andrews Arokiam <[email protected]>

* use existing image for storage initializer

Signed-off-by: Andrews Arokiam <[email protected]>

* resolved merge conflicts

Signed-off-by: Andrews Arokiam <[email protected]>

* added hf storage uri validation

Signed-off-by: Andrews Arokiam <[email protected]>

* resolved merge conflicts

Signed-off-by: Andrews Arokiam <[email protected]>

---------

Signed-off-by: Andrews Arokiam <[email protected]>
2024-09-29 13:55:20 -04:00
..