Files
kserve/test/e2e/data/bert_sequence_classification_v2.json
20a92cbe47 Add e2e tests for huggingface (#3600)
* Fix v2 predict for hf

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Add e2e test for hf

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Fix post processing and e2e image build

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Increase memory limit

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Fix output for v2

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Add more tests

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Reduce parallelism

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>

* Use backend argument

Signed-off-by: Dan Sun <[email protected]>

* Update to use chat completion endpoint

Signed-off-by: Dan Sun <[email protected]>

* Fix openai tests

Signed-off-by: Dan Sun <[email protected]>

---------

Signed-off-by: Sivanantham Chinnaiyan <[email protected]>
Signed-off-by: Dan Sun <[email protected]>
Co-authored-by: Dan Sun <[email protected]>
2024-04-28 22:05:56 -04:00

11 lines
146 B
JSON

{
"inputs": [
{
"name": "input-0",
"datatype": "BYTES",
"shape": [],
"data": ["Hello, my dog is cute."]
}
]
}