Get in Touch
 Duration 14 hours

Course Outline

Foundations of AI Inference with Docker

  • Comprehending AI inference workloads
  • Advantages of containerized inference
  • Deployment use cases and limitations

Creating AI Inference Containers

  • Choosing appropriate base images and frameworks
  • Encapsulating pretrained models
  • Organizing inference code for containerized execution

Enhancing the Security of Containerized AI Services

  • Reducing the container attack surface
  • Handling secrets and sensitive data
  • Strategies for secure networking and API exposure

Techniques for Portable Deployment

  • Optimizing images for mobility
  • Maintaining predictable runtime environments
  • Handling dependencies across various platforms

Local Deployment and Validation

  • Executing services locally via Docker
  • Troubleshooting inference containers
  • Evaluating performance and stability

Deployment to Servers and Cloud VMs

  • Tuning containers for remote settings
  • Setting up secure server access
  • Implementing inference APIs on cloud VMs

Leveraging Docker Compose for Multi-Service AI Architectures

  • Coordinating inference with auxiliary components
  • Controlling environment variables and configurations
  • Scaling microservices using Compose

Oversight and Upkeep of AI Inference Services

  • Logging and observability methods
  • Identifying issues in inference pipelines
  • Managing model updates and versioning in live environments

Recap and Future Directions

Requirements

  • Familiarity with fundamental machine learning concepts
  • Practical experience in Python or backend development
  • Basic knowledge of containerization principles

Intended Audience

  • Software developers
  • Backend engineers
  • Teams responsible for deploying AI services

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories