Have ResNet-101 deep learning model deployed in AWS EC2 instance. During inference , there's a high latency in getting the inference of the model since for each http request through web application ,loads the model everytime. So I am exploring other deployment methods for making the inference faster. So I am analyzing the way to deploy the Tensorflow sering REST API in AWS Lambda. Kindly help me out with the possibility.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.