Skip to course content
Free RAG fundamentals course

Introduction to RAG and Knowledge Assistants

Module 03 Activity

Scenario

The passages exist. Now you need to understand how retrieval will behave on them before anything is built on top.

What you produce

A retrieval expectations note: what your corpus makes easy, what it makes hard, and which of your fifteen questions you expect to fail.

Steps

  1. For each of the fifteen questions, write down which passage you believe should be returned. That list is your answer key.
  2. For five of them, write the words the user used and the words the document uses. Mark the pairs that share almost no vocabulary.
  3. Identify any two passages in your corpus that are about the same subject and say different things. Note what a search for meaning would do with them.
  4. Decide how many passages should be put in front of the model, and justify the number from what your answer key shows rather than from a default.
  5. Name one exact condition your questions rely on - a date, a section, an audience - that a search for meaning cannot express, and specify it as a filter instead.
  6. Predict which of the fifteen will fail and why. Keep the prediction; you will check it in Module 8.

Evidence to hand in

Review checklist