Files
Dan SunandGitHub 1bead20f20 Triton V2 protocol docs (#1183)
* Bert example for triton v2

* Use kubectl wait

* v1beta1 bert triton example

* Fix triton infer output

* Move torchscript example

* Update multi model serving example

* Deploy another model

* Update to 20.10-py3 version
2020-11-17 14:48:05 -08:00

25 lines
300 B
Protocol Buffer Text Format

name: "cifar10"
platform: "pytorch_libtorch"
max_batch_size: 1
input [
{
name: "INPUT__0"
data_type: TYPE_FP32
dims: [3,32,32]
}
]
output [
{
name: "OUTPUT__0"
data_type: TYPE_FP32
dims: [10]
}
]
instance_group [
{
count: 1
kind: KIND_CPU
}
]