Files
Dan SunandGitHub d9aa3c6ab5 Parallel inference support (#1637)
* Decouple http handler with KFModel

* Add model type enum

* Throw exception for unknown type

* Implement model worker with RayServe deployment API

* Add ray remote custom example

* Update custom model server doc

* Update custom model inference yaml

* Check the model deployment type

* Fix linting

* Add local testing instruction

* Fix image name

* Reduce cpu resource
2021-06-30 18:33:23 -07:00

2 lines
22 B
Plaintext