Performance Summary

Global Average

Comparision across all questions

correctnessrouge1rougeLmeteorrouge2

Champion Metric

0.000RAGAS Correctness

Hybrid Graph RAG outperforms pure Vector search by +26.4% in factual accuracy.

Metric Breakdown

rouge1vs Vector
0.000
+5.2%
meteorvs Vector
0.000
+5.9%

Scenario Analysis

Method Comparison

4 of 4 methods
Hybrid Graph: 0.778
Legacy: 0.545
Vector Only: 0.701
Graph Only: 0.393
correctness
Hybrid Graph: 0.311
Legacy: 0.143
Vector Only: 0.282
Graph Only: 0.177
rouge1
Hybrid Graph: 0.197
Legacy: 0.084
Vector Only: 0.148
Graph Only: 0.136
rougeL
Hybrid Graph: 0.197
Legacy: 0.183
Vector Only: 0.240
Graph Only: 0.128
meteor

Score Data

MethodCorrectnessROUGE-1METEOR
Hybrid Graph
0.77850.31150.1966
Legacy
0.54510.14350.1834
Vector Only
0.70060.28190.2401
Graph Only
0.39330.17690.1282

* ROUGE scores indicate lexical overlap with expert answers. METEOR accounts for semantic similarity. RAGAS Correctness evaluates factual accuracy using LLM-as-a-judge.