Files
Lize CaiandGitHub fab85e09c2 update fluid kserve sample to use huggingface servingruntime (#3907)
* update fluid kserve demo to use huggingface servingruntime and other model.

Signed-off-by: Lize Cai <[email protected]>

* fix lint

Signed-off-by: Lize Cai <[email protected]>

* explicitly set custom servingruntime, update devshm.

Signed-off-by: Lize Cai <[email protected]>

* update the args in custom kserve hfserver

Signed-off-by: Lize Cai <[email protected]>

* address comments

Signed-off-by: Lize Cai <[email protected]>

* add return of line

Signed-off-by: Lize Cai <[email protected]>

---------

Signed-off-by: Lize Cai <[email protected]>
2024-09-23 07:00:02 -04:00

22 lines
458 B
YAML

---
apiVersion: v1
kind: Secret
metadata:
name: s3creds
annotations:
serving.kserve.io/s3-endpoint: "s3.eu-central-1.amazonaws.com"
serving.kserve.io/s3-usehttps: "1"
serving.kserve.io/s3-region: "eu-central-1"
serving.kserve.io/s3-useanoncredential: "false"
type: Opaque
stringData:
AWS_ACCESS_KEY_ID: "xxxxx"
AWS_SECRET_ACCESS_KEY: "xxxxx"
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: s3sa
secrets:
- name: s3creds