mirror of
https://github.com/hanzo-ml/kserve.git
synced 2026-10-30 20:53:49 +00:00
20a92cbe47
* Fix v2 predict for hf Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Add e2e test for hf Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Fix post processing and e2e image build Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Increase memory limit Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Fix output for v2 Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Add more tests Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Reduce parallelism Signed-off-by: Sivanantham Chinnaiyan <[email protected]> * Use backend argument Signed-off-by: Dan Sun <[email protected]> * Update to use chat completion endpoint Signed-off-by: Dan Sun <[email protected]> * Fix openai tests Signed-off-by: Dan Sun <[email protected]> --------- Signed-off-by: Sivanantham Chinnaiyan <[email protected]> Signed-off-by: Dan Sun <[email protected]> Co-authored-by: Dan Sun <[email protected]>
6 lines
90 B
JSON
6 lines
90 B
JSON
{
|
|
"model": "hf-t5-small",
|
|
"prompt": "translate this to germany",
|
|
"temperature": 0
|
|
}
|