Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Introduction to AI Inference with Docker
- Analyzing AI inference workloads.
- Evaluating the advantages of containerized inference.
- Examining relevant deployment scenarios and constraints.
Creating AI Inference Containers
- Choosing appropriate base images and frameworks.
- Efficiently packaging pretrained models.
- Organizing inference code for optimal container execution.
Hardening Containerized AI Services
- Reducing the container attack surface.
- Effectively managing secrets and sensitive data files.
- Implementing secure networking and API exposure strategies.
Techniques for Portable Deployment
- Optimizing container images for maximum portability.
- Safeguarding predictable runtime environments.
- Managing dependencies across different platforms.
Local Deployment and Validation
- Executing services locally via Docker.
- Troubleshooting inference containers.
- Assessing performance and reliability.
Deployment on Servers and Cloud VMs
- Tailoring containers for remote environments.
- Configuring secure server access protocols.
- Rolling out inference APIs on cloud virtual machines.
Leveraging Docker Compose for Multi-Service AI Systems
- Orchestrating inference alongside supporting components.
- Managing environment variables and configuration files.
- Scaling microservices using Docker Compose.
Monitoring and Maintenance of AI Inference Services
- Adopting logging and observability strategies.
- Identifying failures within inference pipelines.
- Handling model updates and versioning in production.
Summary and Future Steps
Requirements
- A foundational understanding of basic machine learning concepts.
- Practical experience with Python or backend development practices.
- Familiarity with core containerization principles.
Target Audience
- Developers
- Backend Engineers
- Teams responsible for deploying AI services
Testimonials (2)
As i said before , for a person like me (no exp. ) this was a gateway to understanding features and functions with these programs/tools & etc. .
Patrick V. Duylovski - UBB + DZI (KBC GROUP)
Course - Docker and Kubernetes
multi-tiered, structured course programme.
