Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Foundations of Hybrid AI Deployment
- Exploring hybrid, cloud, and edge deployment models
- AI workload characteristics and infrastructure limitations
- Selecting the optimal deployment topology
Containerizing AI Workloads with Docker
- Creating GPU and CPU inference containers
- Managing secure images and registries
- Establishing reproducible environments for AI
Deploying AI Services to Cloud Environments
- Executing inference on AWS, Azure, and GCP using Docker
- Provisioning cloud compute resources for model serving
- Securing cloud-based AI endpoints
Edge and On-Prem Deployment Techniques
- Running AI on IoT devices, gateways, and microservers
- Utilizing lightweight runtimes for edge environments
- Handling intermittent connectivity and local data persistence
Hybrid Networking and Secure Connectivity
- Establishing secure tunnels between edge and cloud
- Managing certificates, secrets, and token-based access
- Tuning performance for low-latency inference
Orchestrating Distributed AI Deployments
- Leveraging K3s, K8s, or lightweight orchestration for hybrid configurations
- Implementing service discovery and workload scheduling
- Automating multi-location rollout strategies
Monitoring and Observability Across Environments
- Monitoring inference performance across multiple locations
- Implementing centralized logging for hybrid AI systems
- Detecting failures and triggering automated recovery
Scaling and Optimizing Hybrid AI Systems
- Scaling edge clusters and cloud nodes
- Optimizing bandwidth consumption and caching
- Balancing compute loads between cloud and edge
Summary and Next Steps
Requirements
- A solid grasp of containerization concepts
- Proficiency with Linux command-line operations
- Familiarity with AI model deployment processes
Target Audience
- Infrastructure architects
- Site Reliability Engineers (SREs)
- Edge and IoT developers
21 Hours
Testimonials (3)
How trainer deliver knowledge so effectively
Vu Thoai Le - Reply Polska sp. z o. o.
Course - Certified Kubernetes Administrator (CKA) - exam preparation
the trainer had a lot of knowledge and patience to share with us
Bogdan Olaru
Course - Introduction to Docker
The knowledge and exchanges with Augustin