Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Introduction to AI Inference with Docker
- Gaining insight into AI inference workloads
- Exploring the advantages of containerized inference
- Reviewing relevant deployment scenarios and constraints
Building AI Inference Containers
- Choosing appropriate base images and frameworks
- Packaging pretrained models effectively
- Organizing inference code for seamless container execution
Securing Containerized AI Services
- Reducing the potential container attack surface
- Handling secrets and sensitive files securely
- Implementing safe networking and API exposure strategies
Portable Deployment Techniques
- Optimizing images for maximum portability
- Maintaining predictable runtime environments
- Managing dependencies consistently across platforms
Local Deployment and Testing
- Executing services locally using Docker
- Debugging inference containers efficiently
- Assessing performance and reliability
Deploying on Servers and Cloud VMs
- Tailoring containers for remote environments
- Setting up secure server access
- Launching inference APIs on cloud virtual machines
Leveraging Docker Compose for Multi-Service AI Systems
- Orchestrating inference alongside supporting components
- Managing environment variables and configurations
- Scaling microservices with Compose
Monitoring and Maintenance of AI Inference Services
- Adopting logging and observability best practices
- Identifying failures within inference pipelines
- Updating and versioning models in production environments
Summary and Next Steps
Requirements
- A foundational grasp of basic machine learning concepts
- Practical experience with Python or backend development
- Basic familiarity with containerization concepts
Target Audience
- Developers
- Backend Engineers
- Teams responsible for deploying AI services
14 Hours
Testimonials (3)
How trainer deliver knowledge so effectively
Vu Thoai Le - Reply Polska sp. z o. o.
Course - Certified Kubernetes Administrator (CKA) - exam preparation
the trainer had a lot of knowledge and patience to share with us
Bogdan Olaru
Course - Introduction to Docker
The knowledge and exchanges with Augustin