-
Install TF ModelServer and Serving API Documentation.
-
Start a tensorflow model server.
tensorflow_model_server \
--port=8500 \
--model_name=resnet \
--model_base_path=<path> \
--saved_model_tags="serve"
- Check the port status
nmap localhost
- Send gRPC requests using the above code.