[ ABORT TO HUD ]
SEQ. 1
SEQ. 2
SEQ. 3
SEQ. 4
SEQ. 5
Advanced Retrieval
Beyond Basic Vector Search
Simple vector search fails when concepts are spread out or use completely different vocabulary. Production systems use Hybrid Search.
- Dense Search (Embeddings): Matches semantic meaning (e.g., "puppy" matches "dog").
- Sparse Search (BM25/Keyword): Matches exact keywords (e.g., "CVE-2023-4521").
Reranking
Always fetch more documents than you need (e.g., top 20), then use a dedicated Reranker model (like Cohere Rerank) to resort them. The reranker is much more accurate but too slow to run on millions of documents, so it's used as a second pass.
SYNAPSE VERIFICATION
QUERY 1 // 1
What is the benefit of a Reranker in a RAG pipeline?
It generates the final answer
It compresses text into embeddings
It acts as a highly accurate second-pass sorter for documents initially fetched by a vector search
It translates text to other languages