0 Introduction

1 Advanced RAG Pipeline

Sample Code

Basic RAG Pipeline

Setup

• Basic and advanced RAG Pipeline with Llamalndex
• Evaluation Benchmark with TruEra

2 RAG Triad of metrics

Sample Code

• Answer Relevance: Is the response relevant to the query?
• Context Relevance: Is the retrieved context relevant to the query?
• Groundedness: Is the response supported by the context?

3 Sentence-window retrieval

Sample Code

Evaluate & Iterate

• Start with Llamalndex Basic RAG
• Evaluate with TurLens RAG Triad
  • Failure modes related to context size