1:05 · 2.7 MB · MP4 Download the video
Walkthrough 1
Build a knowledge base
Load the open-textbook demo corpus, see how its text becomes passages, then search it with the 2024 retriever, your own question and two other rankers. No key needed.
- 1Open the Library. The demo knowledge base is an open textbook: OpenStax Statistics, CC BY 4.0
- 219 sections become 345 passages, embedded once with the 2024 model, all-MiniLM-L6-v2
- 3Chunking preview: whole sentences packed into passages of about 900 characters, with overlap
- 4Retrieve, no key needed: a sample question returns the top passages instantly
- 5Each passage shows its section, cosine score and the query words it matches
- 6Ask your own question. The model downloads once and embeds it in your browser
- 7Switch to the hybrid ranker and widen k: dense and BM25 fused by reciprocal rank
Transcript
Silent screen recording of the “Build a knowledge base” workflow in Lecture Revision Lab, captioned step by step. A highlighted circle shows the pointer.
- 0:00Open the Library. The demo knowledge base is an open textbook: OpenStax Statistics, CC BY 4.0
- 0:0319 sections become 345 passages, embedded once with the 2024 model, all-MiniLM-L6-v2
- 0:10Chunking preview: whole sentences packed into passages of about 900 characters, with overlap
- 0:20Retrieve, no key needed: a sample question returns the top passages instantly
- 0:26Each passage shows its section, cosine score and the query words it matches
- 0:33Ask your own question. The model downloads once and embeds it in your browser
- 0:51Switch to the hybrid ranker and widen k: dense and BM25 fused by reciprocal rank