Files
kserve/test/e2e/data/bert_fill_mask_v1.json
20a92cbe47 Add e2e tests for huggingface (#3600)
* Fix v2 predict for hf

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Add e2e test for hf

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Fix post processing and e2e image build

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Increase memory limit

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Fix output for v2

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Add more tests

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Reduce parallelism

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Use backend argument

Signed-off-by: Dan Sun <[email protected]>

* Update to use chat completion endpoint

Signed-off-by: Dan Sun <[email protected]>

* Fix openai tests

Signed-off-by: Dan Sun <[email protected]>

---------

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>
Signed-off-by: Dan Sun <[email protected]>
Co-authored-by: Dan Sun <[email protected]>
2024-04-28 22:05:56 -04:00

7 lines
103 B
JSON

{
"instances": [
"The capital of France is [MASK].",
"The capital of [MASK] is paris."
]
}