Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Foundations of AI Inference with Docker
- Comprehending AI inference workloads
- Advantages of containerized inference
- Deployment use cases and limitations
Creating AI Inference Containers
- Choosing appropriate base images and frameworks
- Encapsulating pretrained models
- Organizing inference code for containerized execution
Enhancing the Security of Containerized AI Services
- Reducing the container attack surface
- Handling secrets and sensitive data
- Strategies for secure networking and API exposure
Techniques for Portable Deployment
- Optimizing images for mobility
- Maintaining predictable runtime environments
- Handling dependencies across various platforms
Local Deployment and Validation
- Executing services locally via Docker
- Troubleshooting inference containers
- Evaluating performance and stability
Deployment to Servers and Cloud VMs
- Tuning containers for remote settings
- Setting up secure server access
- Implementing inference APIs on cloud VMs
Leveraging Docker Compose for Multi-Service AI Architectures
- Coordinating inference with auxiliary components
- Controlling environment variables and configurations
- Scaling microservices using Compose
Oversight and Upkeep of AI Inference Services
- Logging and observability methods
- Identifying issues in inference pipelines
- Managing model updates and versioning in live environments
Recap and Future Directions
Requirements
- Familiarity with fundamental machine learning concepts
- Practical experience in Python or backend development
- Basic knowledge of containerization principles
Intended Audience
- Software developers
- Backend engineers
- Teams responsible for deploying AI services
Testimonials (2)
As i said before , for a person like me (no exp. ) this was a gateway to understanding features and functions with these programs/tools & etc. .
Patrick V. Duylovski - UBB + DZI (KBC GROUP)
Course - Docker and Kubernetes
multi-tiered, structured course programme.