Correct answers28/28Grape
vs 24/28 Vector RAG
5 of 5 off-topic questions refused Ready after a change0.09 sGrape
vs 97.7 s Vector RAG
1,146x faster Input tokens per question1,203Grape
vs 1,307 Vector RAG
8% fewer Cost per question$0.00146Grape
vs $0.00155 Vector RAG
6% cheaper LLM calls per question1.11Grape
vs 1.0 Vector RAG
11% more Time to answer3.7 sGrape
vs 3.0 s Vector RAG
26% slower 28 questions from grape-bench run fresh-20260930-162311: Claude haiku, thinking off, Anthropic list prices, the same documents and questions for both. Every question and answer is in the full report, and the summary is on the Benchmark page.