Get in Touch
 Duration 21 hours

Course Outline

Foundational Architecture for AI Systems

  • Defining layers, boundaries, and separation of concerns
  • Applying ports and adapters pattern to AI components
  • Establishing quality attribute scenarios for AI features
  • Using architecture decision records for governance

Modernizing Existing Applications

  • Adopting incremental modernization over complete rewrites
  • Integrating AI services alongside existing monolithic structures
  • Utilizing Strangler Fig and anti-corruption layer patterns
  • Identifying integration points for existing APIs and data flows

Architectural Patterns for LLM Integration

  • Establishing a model gateway as an abstraction boundary
  • Managing synchronous, asynchronous, and streaming integrations
  • Implementing fallback, degradation, and provider failover strategies
  • Treating prompt and model configurations as version-controlled assets

API Contracts and Data Exchange

  • Defining structured output schemas and validation rules
  • Ensuring idempotency, retry mechanisms, and rate limiting
  • Allocating latency budgets and orchestrating timeouts
  • Considering cost-per-request as a key architectural constraint

End-to-End RAG Architecture

  • Building ingestion, chunking, and embedding pipelines
  • Structuring index, retrieval, reranking, and generation stages
  • Positioning retrieval relative to application services
  • Analyzing trade-offs and failure modes at each stage

Vector Databases and Retrieval Strategy

  • Choosing between managed and self-hosted vector stores
  • Implementing dense, sparse, and hybrid search techniques
  • Managing metadata filtering and tenant isolation
  • Planning re-embedding strategies during model transitions

Enhancing Retrieval Quality, Grounding, and Evaluation

  • Constructing evaluation sets from real-world queries
  • Measuring retrieval accuracy and answer quality
  • Ensuring citation, grounding, and controlling hallucinations
  • Implementing feedback loops to refine the index

Agent Architecture Design

  • Understanding the agent loop and tool invocation mechanisms
  • Comparing deterministic workflows with autonomous planners
  • Identifying scenarios where agents are inappropriate
  • Defining scope for agent responsibilities and state management

Multi-Agent Systems and Orchestration

  • Designing supervisor and orchestrator topologies
  • Establishing handoff protocols and message contracts
  • Managing shared memory and context
  • Comparing frameworks based on architectural merits

Service Communication and Tool Protocols

  • Coordinating via event-driven and queue-based systems
  • Exposing tools through standard protocols
  • Managing Sagas, compensation, and long-running transactions
  • Ensuring observability across service interactions

Integrating AI Agents into Development Workflows

  • Deploying coding agents within the delivery pipeline
  • Implementing spec-driven development and review gates
  • Generating tests and running automated quality checks
  • Setting guardrails to maintain architectural control

Governance and Software Quality Assurance

  • Conducting design reviews for AI features
  • Managing changes to models and prompts
  • Incorporating regression evaluation into the pipeline
  • Defining ownership, policies, and approval workflows

Security, Privacy, and Data Stewardship

  • Countering prompt injection via defense in depth
  • Managing secrets, access controls, and least privilege
  • Addressing data residency, personal data, and retention
  • Ensuring auditability and human-in-the-loop oversight

Scalability, Cost Management, and Observability

  • Tracing processes across agent chains
  • Monitoring token usage and cost telemetry
  • Optimizing caching and latency
  • Defining service levels and incident response for AI services

Capstone: Designing an AI-Powered Solution Architecture

  • Developing context, component, and deployment views
  • Designing retrieval and agent orchestration strategies
  • Planning for security, governance, and cost efficiency
  • Conducting peer reviews, critiques, and mapping migration roadmaps

Requirements

  • Practical experience in designing and maintaining production-grade software systems
  • Proficiency with REST APIs and service integration patterns
  • Understanding of relational databases and data modeling concepts
  • Familiarity with LLM-based tools or APIs

Target Audience

  • Software Architects
  • Technical Leads and Senior Engineers
  • Engineering Managers involved in architectural decision-making

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories