How Booking.com serves Deep Learning model predictions
With so many machine learning frameworks and libraries available, writing a model isn’t a bottleneck anymore while putting your models in production is still a challenge.
In this talk, you will learn how we deploy the python deep learning models in production at Booking.com.
Topics will include:
- Deep Learning model training in Docker containers
- Automated retraining of models
- Deployment of models in Kubernetes
- Serving model predictions in containerized environment
- Optimising serving predictions for latency and throughput