A · Retrieval evaluation · research
LocalRAG++
What reranking costs on a CPU, measured, and what its reported gains do and don’t show.
An offline, CPU-only retrieval pipeline and evaluation harness: sparse, dense and hybrid retrieval, cross-encoder reranking, a latency sweep, and a separate study of the document quality that comes before retrieval.
Co-author, with Dr Salaja S
Warm mean latency · CPU · reported
6 → 901 ms
BM25, then hybrid retrieval with a cross-encoder reranking 20 candidates. The 95th percentile for c=20 is 1,605 ms.