Course Outline
Foundational Architecture for AI Systems
- Defining layers, boundaries, and separation of concerns
- Applying ports and adapters patterns to AI components
- Establishing quality attribute scenarios for AI features
- Using architecture decision records for governance
Modernizing Existing Applications
- Incremental evolution over complete rewrites
- Positioning AI services alongside existing monoliths
- Utilizing strangler and anti-corruption layer patterns
- Creating integration points for existing APIs and data sources
Patterns for LLM Integration Architecture
- Model gateways as abstraction boundaries
- Synchronous, asynchronous, and streaming integration methods
- Fallback mechanisms, degradation strategies, and provider failover
- Managing prompts and model configurations as versioned assets
Contracts, APIs, and Data Exchange
- Structured output schemas and validation logic
- Handling idempotency, retries, and rate limiting
- Managing latency budgets and timeout orchestration
- Treating cost per request as a core architectural constraint
End-to-End RAG Architecture
- Ingestion, chunking, and embedding pipelines
- Stages for indexing, retrieval, reranking, and generation
- Positioning retrieval relative to application services
- Analyzing trade-offs and potential failure modes at each stage
Vector Databases and Retrieval Design
- Comparing managed versus self-hosted vector stores
- Dense, sparse, and hybrid search techniques
- Implementing metadata filtering and tenant isolation
- Strategies for re-embedding when models are updated
Retrieval Quality, Grounding, and Evaluation
- Constructing evaluation sets from actual user queries
- Metricing retrieval and answer quality
- Managing citations, grounding, and containment of hallucinations
- Establishing feedback loops to refine the index
Agent Architectures
- The agent loop and tool invocation mechanics
- Deterministic workflows compared to autonomous planners
- Identifying scenarios where agents are unsuitable
- Defining the scope of agent responsibilities and state management
Multi-Agent Systems and Orchestration
- Supervisor and orchestrator topologies
- Handoff protocols and message contract design
- Shared memory and context management strategies
- Framework comparisons based on architectural merits
Service Communication and Tool Protocols
- Event-driven and queue-based coordination models
- Exposing tools via standard protocols
- Implementing sagas, compensation, and long-running transactions
- Ensuring observability across multiple service hops
AI Agents in Development Workflows
- Integrating coding agents into the delivery pipeline
- Spec-driven development and review gates
- Test generation and automated quality assurance
- Guardrails that maintain architectural control
Governance and Software Quality
- Design reviews specifically for AI features
- Change management for models and prompts
- Incorporating regression evaluation into pipeline stages
- Defining ownership, policies, and approval pathways
Security, Privacy, and Data Governance
- Defending against prompt injection with layered security
- Managing secrets, access control, and least privilege principles
- Addressing data residency, personal data, and retention policies
- Ensuring auditability and human-in-the-loop oversight
Scalability, Cost, and Observability
- Tracing operations across agent chains
- Monitoring token usage and cost telemetry
- Optimizing caching and latency
- Defining service levels and incident response for AI services
Capstone: Architecture for an AI-Powered Solution
- Developing context, component, and deployment views
- Designing retrieval and agent orchestration structures
- Planning for security, governance, and cost control
- Conducting peer reviews, critiques, and migration roadmapping
Requirements
- Experience in designing and maintaining production-grade software systems
- Functional understanding of REST APIs and service integration
- Proficiency with relational databases and data modeling concepts
- Prior exposure to LLM-based tools or APIs
Target Audience
- Software architects
- Technical leads and senior engineers
- Engineering managers with responsibility for architectural decisions
Testimonials (1)
That i gained a knowledge regarding streamlit library from python and for sure i'll try to use it to improve applications in my team which are made in R shiny