How to access custom torchserve metrics in kserve
So, I am using torchserve to create a handler and then using the “.mar” file for creating an inference service using kserve on kubeflow.
So, I am using torchserve to create a handler and then using the “.mar” file for creating an inference service using kserve on kubeflow.