Course Outline
Foundational Architecture for AI Systems
- Defining layers, boundaries, and separation of concerns
- Applying ports and adapters pattern to AI components
- Establishing quality attribute scenarios for AI features
- Using architecture decision records for governance
Modernizing Existing Applications
- Adopting incremental modernization over complete rewrites
- Integrating AI services alongside existing monolithic structures
- Utilizing Strangler Fig and anti-corruption layer patterns
- Identifying integration points for existing APIs and data flows
Architectural Patterns for LLM Integration
- Establishing a model gateway as an abstraction boundary
- Managing synchronous, asynchronous, and streaming integrations
- Implementing fallback, degradation, and provider failover strategies
- Treating prompt and model configurations as version-controlled assets
API Contracts and Data Exchange
- Defining structured output schemas and validation rules
- Ensuring idempotency, retry mechanisms, and rate limiting
- Allocating latency budgets and orchestrating timeouts
- Considering cost-per-request as a key architectural constraint
End-to-End RAG Architecture
- Building ingestion, chunking, and embedding pipelines
- Structuring index, retrieval, reranking, and generation stages
- Positioning retrieval relative to application services
- Analyzing trade-offs and failure modes at each stage
Vector Databases and Retrieval Strategy
- Choosing between managed and self-hosted vector stores
- Implementing dense, sparse, and hybrid search techniques
- Managing metadata filtering and tenant isolation
- Planning re-embedding strategies during model transitions
Enhancing Retrieval Quality, Grounding, and Evaluation
- Constructing evaluation sets from real-world queries
- Measuring retrieval accuracy and answer quality
- Ensuring citation, grounding, and controlling hallucinations
- Implementing feedback loops to refine the index
Agent Architecture Design
- Understanding the agent loop and tool invocation mechanisms
- Comparing deterministic workflows with autonomous planners
- Identifying scenarios where agents are inappropriate
- Defining scope for agent responsibilities and state management
Multi-Agent Systems and Orchestration
- Designing supervisor and orchestrator topologies
- Establishing handoff protocols and message contracts
- Managing shared memory and context
- Comparing frameworks based on architectural merits
Service Communication and Tool Protocols
- Coordinating via event-driven and queue-based systems
- Exposing tools through standard protocols
- Managing Sagas, compensation, and long-running transactions
- Ensuring observability across service interactions
Integrating AI Agents into Development Workflows
- Deploying coding agents within the delivery pipeline
- Implementing spec-driven development and review gates
- Generating tests and running automated quality checks
- Setting guardrails to maintain architectural control
Governance and Software Quality Assurance
- Conducting design reviews for AI features
- Managing changes to models and prompts
- Incorporating regression evaluation into the pipeline
- Defining ownership, policies, and approval workflows
Security, Privacy, and Data Stewardship
- Countering prompt injection via defense in depth
- Managing secrets, access controls, and least privilege
- Addressing data residency, personal data, and retention
- Ensuring auditability and human-in-the-loop oversight
Scalability, Cost Management, and Observability
- Tracing processes across agent chains
- Monitoring token usage and cost telemetry
- Optimizing caching and latency
- Defining service levels and incident response for AI services
Capstone: Designing an AI-Powered Solution Architecture
- Developing context, component, and deployment views
- Designing retrieval and agent orchestration strategies
- Planning for security, governance, and cost efficiency
- Conducting peer reviews, critiques, and mapping migration roadmaps
Requirements
- Practical experience in designing and maintaining production-grade software systems
- Proficiency with REST APIs and service integration patterns
- Understanding of relational databases and data modeling concepts
- Familiarity with LLM-based tools or APIs
Target Audience
- Software Architects
- Technical Leads and Senior Engineers
- Engineering Managers involved in architectural decision-making
Testimonials (1)
That i gained a knowledge regarding streamlit library from python and for sure i'll try to use it to improve applications in my team which are made in R shiny