Skip to main content

Minimum-first framing: require fair A/B comparison, one quoted chunk, and one privacy/copyright boundary note before any extension work.

Day 1 ยท Block 3

Context

Use context engineering and retrieval to improve reliability over a no-context baseline with one explicit boundary disclosure.

Use arrow keys in-frame, or open full screen.

Block Write-up

Loading write-up...

Exercise overview: Retrieval A/B with local corpus

Inputs

  • exercises/03/retrieval_ab.py
  • Local corpus in exercises/03/local_docs

Deliverable

A/B run trace + one retrieval-fixed failure + one source-backed comparison note.

Target

Can you look up some services that offer RAG systems? How expensive is this?

Checklist

  • Make one explicit design decision.
  • Include one verification check.
  • State one limitation or risk.

Common failure modes

  • Baseline and retrieval runs use different prompts/settings.
  • Improvement claimed without source chunk evidence or boundary disclosure.

Extension task (optional)

Add metadata filtering and report precision difference.