Bỏ qua để đến nội dung
Search & RAG

Phụ lục — bảng công thức một trang

Success@k=1[R∩π1:k≠∅]Recall@k=∣R∩π1:k∣ / RPrecision@k=∣R∩π1:k∣ / kR-Prec=∣R∩π1:R∣ / RRR=1/min⁡{i:di∈R}AP@k=1R∑i=1k1[di∈R]⋅Precision@iDCG@k=∑i=1k(2rel(di)−1) / log⁡2(i+1)nDCG@k=DCG@k / IDCG@kERR=∑i=1k1iRi∏j<i(1−Rj),Ri=2rel(di)−12relmax⁡RBP=(1−p)∑i≥1pi−1 rel(di)\begin{aligned} \text{Success@}k &= \mathbb{1}[\mathcal{R} \cap \pi_{1:k} \neq \emptyset] \\[4pt] \text{Recall@}k &= \lvert\mathcal{R} \cap \pi_{1:k}\rvert \,/\, R \\[4pt] \text{Precision@}k &= \lvert\mathcal{R} \cap \pi_{1:k}\rvert \,/\, k \\[4pt] \text{R-Prec} &= \lvert\mathcal{R} \cap \pi_{1:R}\rvert \,/\, R \\[4pt] \text{RR} &= 1 / \min\{i : d_i \in \mathcal{R}\} \\[4pt] \text{AP@}k &= \tfrac{1}{R}\textstyle\sum_{i=1}^{k} \mathbb{1}[d_i \in \mathcal{R}] \cdot \text{Precision@}i \\[4pt] \text{DCG@}k &= \textstyle\sum_{i=1}^{k} (2^{\mathrm{rel}(d_i)}-1) \,/\, \log_2(i+1) \\[4pt] \text{nDCG@}k &= \text{DCG@}k \,/\, \text{IDCG@}k \\[4pt] \text{ERR} &= \textstyle\sum_{i=1}^{k} \tfrac{1}{i} R_i \prod_{j<i}(1-R_j), \quad R_i = \tfrac{2^{\mathrm{rel}(d_i)}-1}{2^{\mathrm{rel}_{\max}}} \\[4pt] \text{RBP} &= (1-p)\textstyle\sum_{i\ge1} p^{i-1}\,\mathrm{rel}(d_i) \end{aligned}

Mọi metric trên đều lấy macro-average qua tập truy vấn.

Phần 2 — Metrics