Course Outline
Foundational Architectures for AI Systems
- Layers, boundaries, and the separation of concerns
- Applying ports and adapters to AI components
- Defining quality attribute scenarios for AI features
- Using architecture decision records as a governance tool
Evolving Existing Applications
- Opting for incremental modernisation over full rewrites
- Positioning AI services alongside existing monoliths
- Utilising strangler and anti-corruption layer patterns
- Establishing integration seams for current APIs and data sources
Architectural Patterns for LLM Integration
- Using a model gateway as an abstraction boundary
- Integrating synchronously, asynchronously, and via streaming
- Implementing fallbacks, degradation, and provider failover
- Treating prompt and model configurations as version-controlled assets
Contracts, APIs, and Data Exchange
- Defining structured output schemas and validation rules
- Managing idempotency, retries, and rate limiting
- Establishing latency budgets and timeout orchestration
- Viewing cost per request as a key architectural constraint
End-to-End RAG Architecture
- Building ingestion, chunking, and embedding pipelines
- Designing index, retrieval, reranking, and generation stages
- Positioning retrieval relative to application services
- Analysing trade-offs and potential failure modes at each stage
Vector Databases and Retrieval Design
- Choosing between managed and self-hosted vector stores
- Implementing dense, sparse, and hybrid search methods
- Managing metadata filtering and tenant isolation
- Developing re-embedding strategies for model changes
Retrieval Quality, Grounding, and Evaluation
- Creating evaluation sets based on real-world queries
- Defining metrics for retrieval and answer quality
- Ensuring citation accuracy, grounding, and containment of hallucinations
- Implementing feedback loops that refine the index
Agent Architectures
- Understanding the agent loop and tool invocation mechanics
- Comparing deterministic workflows with autonomous planners
- Identifying scenarios where an agent is not the appropriate solution
- Defining the scope of agent responsibilities and state management
Multi-Agent Systems and Orchestration
- Designing supervisor and orchestrator topologies
- Establishing handoff protocols and message contracts
- Managing shared memory and context across agents
- Comparing frameworks based on architectural principles
Service Communication and Tool Protocols
- Coordinating via event-driven and queue-based systems
- Exposing tools through standardised protocols
- Handling sagas, compensation, and long-running transactions
- Ensuring observability across multiple service hops
AI Agents in the Development Workflow
- Integrating coding agents into the delivery pipeline
- Adopting spec-driven development with review gates
- Automating test generation and quality checks
- Implementing guardrails to maintain architectural control
Governance and Software Quality
- Conducting design reviews for AI features
- Managing changes to models and prompts
- Incorporating regression evaluation into the pipeline
- Defining ownership, policies, and approval workflows
Security, Privacy, and Data Governance
- Addressing prompt injection and defence in depth strategies
- Managing secrets, access controls, and least privilege principles
- Complying with data residency, personal data, and retention rules
- Ensuring auditability and implementing human-in-the-loop controls
Scalability, Cost, and Observability
- Tracing operations across agent chains
- Monitoring token usage and cost telemetry
- Optimising caching and latency
- Setting service levels and incident response protocols for AI services
Capstone: Architecture for an AI-Driven Solution
- Developing context, component, and deployment views
- Designing retrieval and agent orchestration structures
- Planning for security, governance, and cost management
- Conducting peer reviews, critiques, and migration roadmap development
Requirements
- Experience in designing and maintaining production-level software systems
- Practical understanding of REST APIs and service integration
- Familiarity with relational databases and data modelling techniques
- Basic exposure to LLM-based tools or APIs
Target Audience
- Software architects
- Technical leads and senior engineers
- Engineering managers accountable for architectural decisions
Testimonials (1)
That i gained a knowledge regarding streamlit library from python and for sure i'll try to use it to improve applications in my team which are made in R shiny