3 people 105a2b34ba Support V2 GRPC for KServe Model Server (#2415) ...

* Implemented gRPC in kserve

Signed-off-by: Suresh-Nakkeran <[email protected]>

* Fix gRPC custom model example and test

Signed-off-by: Dan Sun <[email protected]>

* Add python v2 grpc type interface file

Signed-off-by: Dan Sun <[email protected]>

* Fix transformer gRPC example

Signed-off-by: Dan Sun <[email protected]>

* Fix custom grpc docker file

Signed-off-by: Suresh-Nakkeran <[email protected]>

* Fixed issue in master merge
Added kserve version in custom_model_grpc Dockerfile
Added ServerMetadata function in grpc servicer
Truncated points in grpc test case response

Signed-off-by: Suresh-Nakkeran <[email protected]>

* Removed dependency of asyncio in server start

Signed-off-by: Suresh-Nakkeran <[email protected]>

* Fix asyncio.run for examples

Signed-off-by: Dan Sun <[email protected]>

* Add processing/asyncio threading arguments

Signed-off-by: Dan Sun <[email protected]>

* Gracefully terminate grpc server

Signed-off-by: Dan Sun <[email protected]>

* Added support to read headers

Signed-off-by: Suresh-Nakkeran <[email protected]>

* Added grpc response conversation

Signed-off-by: Suresh-Nakkeran <[email protected]>

* Added logging interceptor in gRPC

Signed-off-by: Suresh-Nakkeran <[email protected]>

* Added test cases for grpc model with transformer

Signed-off-by: Suresh-Nakkeran <[email protected]>

Signed-off-by: Suresh-Nakkeran <[email protected]>
Signed-off-by: Dan Sun <[email protected]>
Co-authored-by: Dan Sun <[email protected]>

2022-11-05 13:25:07 -04:00

0 lines

0 B

Python

Raw Permalink Blame History

The file is empty.