Book a Demo!
CoCalc Logo Icon
StoreFeaturesDocsShareSupportNewsAboutPoliciesSign UpSign In
codebasics
GitHub Repository: codebasics/deep-learning-keras-tf-tutorial
Path: blob/master/48_tf_serving/readme.md
1141 views

To start docker container

docker run -it -v C:\Code\deep-learning-keras-tf-tutorial\48_tf_serving:/48_tf_serving -p 8601:8601 --entrypoint /bin/bash tensorflow/serving

To serve only latest model

tensorflow_model_server --rest_api_port=8601 --model_name=email_model --model_base_path=/48_tf_serving/saved_models/

To serve models using model config file

tensorflow_model_server --rest_api_port=8601 --allow_version_labels_for_unavailable_models --model_config_file=/48_tf_serving/model.config.c

Postman commands

To call by versions

http://localhost:8601/v1/models/email_model/versions/2:predict

To call by labels

http://localhost:8601/v1/models/email_model/labels/beta:predict

Body: raw

{ "instances": [ "Let's meet for dinner tomorrow", "You are awarded a SiPix Digital Camera! call 09061221061 from landline. Delivery within 28days. T Cs Box177" ] }

TF Serving Installation Instructions & Config File Help

https://www.tensorflow.org/tfx/serving/docker https://www.tensorflow.org/tfx/serving/serving_config