Get in Touch
 Duration 21 hours

Course Outline

Foundational Architecture for AI Systems

  • Defining layers, boundaries, and separation of concerns
  • Applying ports and adapters patterns to AI components
  • Establishing quality attribute scenarios for AI features
  • Using architecture decision records for governance

Modernizing Existing Applications

  • Incremental evolution over complete rewrites
  • Positioning AI services alongside existing monoliths
  • Utilizing strangler and anti-corruption layer patterns
  • Creating integration points for existing APIs and data sources

Patterns for LLM Integration Architecture

  • Model gateways as abstraction boundaries
  • Synchronous, asynchronous, and streaming integration methods
  • Fallback mechanisms, degradation strategies, and provider failover
  • Managing prompts and model configurations as versioned assets

Contracts, APIs, and Data Exchange

  • Structured output schemas and validation logic
  • Handling idempotency, retries, and rate limiting
  • Managing latency budgets and timeout orchestration
  • Treating cost per request as a core architectural constraint

End-to-End RAG Architecture

  • Ingestion, chunking, and embedding pipelines
  • Stages for indexing, retrieval, reranking, and generation
  • Positioning retrieval relative to application services
  • Analyzing trade-offs and potential failure modes at each stage

Vector Databases and Retrieval Design

  • Comparing managed versus self-hosted vector stores
  • Dense, sparse, and hybrid search techniques
  • Implementing metadata filtering and tenant isolation
  • Strategies for re-embedding when models are updated

Retrieval Quality, Grounding, and Evaluation

  • Constructing evaluation sets from actual user queries
  • Metricing retrieval and answer quality
  • Managing citations, grounding, and containment of hallucinations
  • Establishing feedback loops to refine the index

Agent Architectures

  • The agent loop and tool invocation mechanics
  • Deterministic workflows compared to autonomous planners
  • Identifying scenarios where agents are unsuitable
  • Defining the scope of agent responsibilities and state management

Multi-Agent Systems and Orchestration

  • Supervisor and orchestrator topologies
  • Handoff protocols and message contract design
  • Shared memory and context management strategies
  • Framework comparisons based on architectural merits

Service Communication and Tool Protocols

  • Event-driven and queue-based coordination models
  • Exposing tools via standard protocols
  • Implementing sagas, compensation, and long-running transactions
  • Ensuring observability across multiple service hops

AI Agents in Development Workflows

  • Integrating coding agents into the delivery pipeline
  • Spec-driven development and review gates
  • Test generation and automated quality assurance
  • Guardrails that maintain architectural control

Governance and Software Quality

  • Design reviews specifically for AI features
  • Change management for models and prompts
  • Incorporating regression evaluation into pipeline stages
  • Defining ownership, policies, and approval pathways

Security, Privacy, and Data Governance

  • Defending against prompt injection with layered security
  • Managing secrets, access control, and least privilege principles
  • Addressing data residency, personal data, and retention policies
  • Ensuring auditability and human-in-the-loop oversight

Scalability, Cost, and Observability

  • Tracing operations across agent chains
  • Monitoring token usage and cost telemetry
  • Optimizing caching and latency
  • Defining service levels and incident response for AI services

Capstone: Architecture for an AI-Powered Solution

  • Developing context, component, and deployment views
  • Designing retrieval and agent orchestration structures
  • Planning for security, governance, and cost control
  • Conducting peer reviews, critiques, and migration roadmapping

Requirements

  • Experience in designing and maintaining production-grade software systems
  • Functional understanding of REST APIs and service integration
  • Proficiency with relational databases and data modeling concepts
  • Prior exposure to LLM-based tools or APIs

Target Audience

  • Software architects
  • Technical leads and senior engineers
  • Engineering managers with responsibility for architectural decisions

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories