Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Introduction to AI Inference with Docker
- Comprehending the nature of AI inference workloads
- Advantages of adopting containerized inference
- Key deployment scenarios and associated constraints
Creating AI Inference Containers
- Choosing appropriate base images and frameworks
- Packaging pre-trained models effectively
- Organizing inference code for seamless container execution
Hardening Containerized AI Services
- Reducing the container’s attack surface
- Properly managing secrets and sensitive data files
- Strategies for safe networking and API exposure
Techniques for Portable Deployment
- Optimizing images to enhance portability
- Guaranteeing predictable runtime environments
- Handling dependencies consistently across different platforms
Local Deployment and Testing
- Executing services locally using Docker
- Troubleshooting and debugging inference containers
- Assessing performance and reliability
Deployment on Servers and Cloud VMs
- Adapting containers to suit remote environments
- Setting up secure access for servers
- Launching inference APIs on cloud virtual machines
Leveraging Docker Compose for Multi-Service AI Systems
- Orchestrating inference alongside supporting components
- Managing environment variables and configurations
- Scaling microservices using Compose
Monitoring and Maintaining AI Inference Services
- Implementing logging and observability strategies
- Identifying failures within inference pipelines
- Updating and versioning models in production settings
Conclusion and Future Directions
Requirements
- A solid grasp of fundamental machine learning principles
- Practical experience with Python or backend development
- A working knowledge of basic container concepts
Target Audience
- Software Developers
- Backend Engineers
- Teams responsible for deploying AI services
Testimonials (2)
As i said before , for a person like me (no exp. ) this was a gateway to understanding features and functions with these programs/tools & etc. .
Patrick V. Duylovski - UBB + DZI (KBC GROUP)
Course - Docker and Kubernetes
multi-tiered, structured course programme.
