Files
Jagadeesh JandGitHub 358e57225d Torchserve v2 protocol (#1870)
* feat: v2 protocol support for torchserve

Signed-off-by: Dan Sun <[email protected]>

Feat: Add unit test for torchserve predictor

 - Add e2e test

Signed-off-by: Dan Sun <[email protected]>

Feat: Add readme doc for v2 support

 - fix lint error
 - add grpc sample yaml
 - add tensor input generation script
 - fix model archiver to support v2 protocol

Signed-off-by: Dan Sun <[email protected]>

Feat: Add gRPC client

 - fix lint error
 - update readme for gRPC

Signed-off-by: Dan Sun <[email protected]>

feat: Add custom handlers for v2 api

Signed-off-by: Dan Sun <[email protected]>

Update torchserve image in test overlay

Signed-off-by: Dan Sun <[email protected]>

Feat: Add readme doc for v2 support

 - fix lint error
 - add grpc sample yaml
 - add tensor input generation script
 - fix model archiver to support v2 protocol

Signed-off-by: Dan Sun <[email protected]>

Update test_transformer.py

Signed-off-by: Dan Sun <[email protected]>

Add e2e test for grpc torchserve

Signed-off-by: Dan Sun <[email protected]>

Update test configuration

Signed-off-by: Dan Sun <[email protected]>

Support torchserve runtime for v2 protocol

Signed-off-by: Dan Sun <[email protected]>

Fix storage uri for v2 example

Signed-off-by: Dan Sun <[email protected]>

Add grpc debug and retry config

Signed-off-by: Dan Sun <[email protected]>

fix: torchserve gRPC test

Signed-off-by: Jagadeesh J <[email protected]>

* fix: skip gRPC test

Signed-off-by: Jagadeesh J <[email protected]>
2021-12-14 10:11:33 -08:00
..
2021-12-14 10:11:33 -08:00