mirror of
https://github.com/hanzo-ml/kserve.git
synced 2026-10-30 20:53:49 +00:00
* Fix v2 predict for hf Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Add e2e test for hf Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Fix post processing and e2e image build Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Increase memory limit Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Fix output for v2 Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Add more tests Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Reduce parallelism Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Use backend argument Signed-off-by: Dan Sun <[email protected]> * Update to use chat completion endpoint Signed-off-by: Dan Sun <[email protected]> * Fix openai tests Signed-off-by: Dan Sun <[email protected]> --------- Signed-off-by: Sivanantham Chinnaiyan <[email protected]> Signed-off-by: Dan Sun <[email protected]> Co-authored-by: Dan Sun <[email protected]>
11 lines
146 B
JSON
11 lines
146 B
JSON
{
|
|
"inputs": [
|
|
{
|
|
"name": "input-0",
|
|
"datatype": "BYTES",
|
|
"shape": [],
|
|
"data": ["Hello, my dog is cute."]
|
|
}
|
|
]
|
|
}
|