Engineers / Intermediate

LLM apps and RAG

Build an application on a language model: open-model foundations, retrieval, the Claude API and a test set that tells you if it works.

Who it is for

Engineers who want to ship a retrieval-based assistant, from first prototype to measured quality.

Steps
8
Level
Intermediate

What you can do afterwards

  • Build a retrieval pipeline with citations
  • Measure answer quality on your own questions
  • Choose between an API and a self-hosted model
  • Sit the Generative AI Engineer Associate exam

Start here

Take the NexOps course

AI agents in production. Tools, memory, evaluation, guardrails, cost and operations, with the model of your choice

8 lessons · 6 h

This path begins with our own course, with lessons, knowledge checks and labs. The external courses below are extra practice.

Open the course

Extra practice

  1. Course

  2. Course

  3. Course

  4. Course

  5. Build

    A RAG assistant with a test set

    Goal. Answer questions about a document set, with citations, and prove the quality on twenty questions you wrote first.

    What to do

    1. Choose 30 to 50 documents and write 20 questions with the answer you expect for each.
    2. Chunk, embed and index the documents. Return the three best chunks for a question.
    3. Generate the answer from those chunks only, and cite the chunk.
    4. Run the 20 questions after every change and keep a score per run.

    What good looks like. You can say which change raised or lowered the score, and the assistant says when it does not know.

  6. Read

  7. Check

  8. Certify

Course details come from each provider. Check the provider page for the latest.

Next step

Want your team to learn this together?

We give workshops to company teams and students, on-site or online. Tell us who the participants are and what they should be able to do afterwards.

Accepting projects for Q4 2026