mirror of
https://github.com/hanzo-ml/kserve.git
synced 2026-10-30 20:53:49 +00:00
Jagadeesh JandGitHub
358e57225d
* feat: v2 protocol support for torchserve Signed-off-by: Dan Sun <[email protected]> Feat: Add unit test for torchserve predictor - Add e2e test Signed-off-by: Dan Sun <[email protected]> Feat: Add readme doc for v2 support - fix lint error - add grpc sample yaml - add tensor input generation script - fix model archiver to support v2 protocol Signed-off-by: Dan Sun <[email protected]> Feat: Add gRPC client - fix lint error - update readme for gRPC Signed-off-by: Dan Sun <[email protected]> feat: Add custom handlers for v2 api Signed-off-by: Dan Sun <[email protected]> Update torchserve image in test overlay Signed-off-by: Dan Sun <[email protected]> Feat: Add readme doc for v2 support - fix lint error - add grpc sample yaml - add tensor input generation script - fix model archiver to support v2 protocol Signed-off-by: Dan Sun <[email protected]> Update test_transformer.py Signed-off-by: Dan Sun <[email protected]> Add e2e test for grpc torchserve Signed-off-by: Dan Sun <[email protected]> Update test configuration Signed-off-by: Dan Sun <[email protected]> Support torchserve runtime for v2 protocol Signed-off-by: Dan Sun <[email protected]> Fix storage uri for v2 example Signed-off-by: Dan Sun <[email protected]> Add grpc debug and retry config Signed-off-by: Dan Sun <[email protected]> fix: torchserve gRPC test Signed-off-by: Jagadeesh J <[email protected]> * fix: skip gRPC test Signed-off-by: Jagadeesh J <[email protected]>
20 lines
1.6 KiB
JSON
20 lines
1.6 KiB
JSON
{
|
|
"instances": [{
|
|
"data": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAAAw0lEQVR4nGNgGFggVVj4/y8Q2GOR83n+58/fP0DwcSqmpNN7oOTJw6f+/H2pjUU2JCSEk0EWqN0cl828e/FIxvz9/9cCh1zS5z9/G9mwyzl/+PNnKQ45nyNAr9ThMHQ/UG4tDofuB4bQIhz6fIBenMWJQ+7Vn7+zeLCbKXv6z59NOPQVgsIcW4QA9YFi6wNQLrKwsBebW/68DJ388Nun5XFocrqvIFH59+XhBAxThTfeB0r+vP/QHbuDCgr2JmOXoSsAAKK7bU3vISS4AAAAAElFTkSuQmCC",
|
|
"target": 0
|
|
},
|
|
{
|
|
"data": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAAAw0lEQVR4nGNgGFggVVj4/y8Q2GOR83n+58/fP0DwcSqmpNN7oOTJw6f+/H2pjUU2JCSEk0EWqN0cl828e/FIxvz9/9cCh1zS5z9/G9mwyzl/+PNnKQ45nyNAr9ThMHQ/UG4tDofuB4bQIhz6fIBenMWJQ+7Vn7+zeLCbKXv6z59NOPQVgsIcW4QA9YFi6wNQLrKwsBebW/68DJ388Nun5XFocrqvIFH59+XhBAxThTfeB0r+vP/QHbuDCgr2JmOXoSsAAKK7bU3vISS4AAAAAElFTkSuQmCC",
|
|
"target": 0
|
|
},
|
|
{
|
|
"data": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAAAw0lEQVR4nGNgGFggVVj4/y8Q2GOR83n+58/fP0DwcSqmpNN7oOTJw6f+/H2pjUU2JCSEk0EWqN0cl828e/FIxvz9/9cCh1zS5z9/G9mwyzl/+PNnKQ45nyNAr9ThMHQ/UG4tDofuB4bQIhz6fIBenMWJQ+7Vn7+zeLCbKXv6z59NOPQVgsIcW4QA9YFi6wNQLrKwsBebW/68DJ388Nun5XFocrqvIFH59+XhBAxThTfeB0r+vP/QHbuDCgr2JmOXoSsAAKK7bU3vISS4AAAAAElFTkSuQmCC",
|
|
"target": 0
|
|
},
|
|
{
|
|
"data": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAAAw0lEQVR4nGNgGFggVVj4/y8Q2GOR83n+58/fP0DwcSqmpNN7oOTJw6f+/H2pjUU2JCSEk0EWqN0cl828e/FIxvz9/9cCh1zS5z9/G9mwyzl/+PNnKQ45nyNAr9ThMHQ/UG4tDofuB4bQIhz6fIBenMWJQ+7Vn7+zeLCbKXv6z59NOPQVgsIcW4QA9YFi6wNQLrKwsBebW/68DJ388Nun5XFocrqvIFH59+XhBAxThTfeB0r+vP/QHbuDCgr2JmOXoSsAAKK7bU3vISS4AAAAAElFTkSuQmCC",
|
|
"target": 0
|
|
}
|
|
]
|
|
}
|