Get in Touch
 Duration 21 hours

Course Outline

Foundational Architectures for AI Systems

  • Layers, boundaries, and the separation of concerns
  • Applying ports and adapters to AI components
  • Defining quality attribute scenarios for AI features
  • Using architecture decision records as a governance tool

Evolving Existing Applications

  • Opting for incremental modernisation over full rewrites
  • Positioning AI services alongside existing monoliths
  • Utilising strangler and anti-corruption layer patterns
  • Establishing integration seams for current APIs and data sources

Architectural Patterns for LLM Integration

  • Using a model gateway as an abstraction boundary
  • Integrating synchronously, asynchronously, and via streaming
  • Implementing fallbacks, degradation, and provider failover
  • Treating prompt and model configurations as version-controlled assets

Contracts, APIs, and Data Exchange

  • Defining structured output schemas and validation rules
  • Managing idempotency, retries, and rate limiting
  • Establishing latency budgets and timeout orchestration
  • Viewing cost per request as a key architectural constraint

End-to-End RAG Architecture

  • Building ingestion, chunking, and embedding pipelines
  • Designing index, retrieval, reranking, and generation stages
  • Positioning retrieval relative to application services
  • Analysing trade-offs and potential failure modes at each stage

Vector Databases and Retrieval Design

  • Choosing between managed and self-hosted vector stores
  • Implementing dense, sparse, and hybrid search methods
  • Managing metadata filtering and tenant isolation
  • Developing re-embedding strategies for model changes

Retrieval Quality, Grounding, and Evaluation

  • Creating evaluation sets based on real-world queries
  • Defining metrics for retrieval and answer quality
  • Ensuring citation accuracy, grounding, and containment of hallucinations
  • Implementing feedback loops that refine the index

Agent Architectures

  • Understanding the agent loop and tool invocation mechanics
  • Comparing deterministic workflows with autonomous planners
  • Identifying scenarios where an agent is not the appropriate solution
  • Defining the scope of agent responsibilities and state management

Multi-Agent Systems and Orchestration

  • Designing supervisor and orchestrator topologies
  • Establishing handoff protocols and message contracts
  • Managing shared memory and context across agents
  • Comparing frameworks based on architectural principles

Service Communication and Tool Protocols

  • Coordinating via event-driven and queue-based systems
  • Exposing tools through standardised protocols
  • Handling sagas, compensation, and long-running transactions
  • Ensuring observability across multiple service hops

AI Agents in the Development Workflow

  • Integrating coding agents into the delivery pipeline
  • Adopting spec-driven development with review gates
  • Automating test generation and quality checks
  • Implementing guardrails to maintain architectural control

Governance and Software Quality

  • Conducting design reviews for AI features
  • Managing changes to models and prompts
  • Incorporating regression evaluation into the pipeline
  • Defining ownership, policies, and approval workflows

Security, Privacy, and Data Governance

  • Addressing prompt injection and defence in depth strategies
  • Managing secrets, access controls, and least privilege principles
  • Complying with data residency, personal data, and retention rules
  • Ensuring auditability and implementing human-in-the-loop controls

Scalability, Cost, and Observability

  • Tracing operations across agent chains
  • Monitoring token usage and cost telemetry
  • Optimising caching and latency
  • Setting service levels and incident response protocols for AI services

Capstone: Architecture for an AI-Driven Solution

  • Developing context, component, and deployment views
  • Designing retrieval and agent orchestration structures
  • Planning for security, governance, and cost management
  • Conducting peer reviews, critiques, and migration roadmap development

Requirements

  • Experience in designing and maintaining production-level software systems
  • Practical understanding of REST APIs and service integration
  • Familiarity with relational databases and data modelling techniques
  • Basic exposure to LLM-based tools or APIs

Target Audience

  • Software architects
  • Technical leads and senior engineers
  • Engineering managers accountable for architectural decisions

Number of participants


Price per participant

Testimonials (1)

Upcoming Courses

Related Categories