Bỏ qua để đến nội dung
Search & RAG

Phụ lục — bảng công thức một trang

Success@k=1[Rπ1:k]Recall@k=Rπ1:k/RPrecision@k=Rπ1:k/kR-Prec=Rπ1:R/RRR=1/min{i:diR}AP@k=1Ri=1k1[diR]Precision@iDCG@k=i=1k(2rel(di)1)/log2(i+1)nDCG@k=DCG@k/IDCG@kERR=i=1k1iRij<i(1Rj),Ri=2rel(di)12relmaxRBP=(1p)i1pi1rel(di)\begin{aligned} \text{Success@}k &= \mathbb{1}[\mathcal{R} \cap \pi_{1:k} \neq \emptyset] \\[4pt] \text{Recall@}k &= \lvert\mathcal{R} \cap \pi_{1:k}\rvert \,/\, R \\[4pt] \text{Precision@}k &= \lvert\mathcal{R} \cap \pi_{1:k}\rvert \,/\, k \\[4pt] \text{R-Prec} &= \lvert\mathcal{R} \cap \pi_{1:R}\rvert \,/\, R \\[4pt] \text{RR} &= 1 / \min\{i : d_i \in \mathcal{R}\} \\[4pt] \text{AP@}k &= \tfrac{1}{R}\textstyle\sum_{i=1}^{k} \mathbb{1}[d_i \in \mathcal{R}] \cdot \text{Precision@}i \\[4pt] \text{DCG@}k &= \textstyle\sum_{i=1}^{k} (2^{\mathrm{rel}(d_i)}-1) \,/\, \log_2(i+1) \\[4pt] \text{nDCG@}k &= \text{DCG@}k \,/\, \text{IDCG@}k \\[4pt] \text{ERR} &= \textstyle\sum_{i=1}^{k} \tfrac{1}{i} R_i \prod_{j<i}(1-R_j), \quad R_i = \tfrac{2^{\mathrm{rel}(d_i)}-1}{2^{\mathrm{rel}_{\max}}} \\[4pt] \text{RBP} &= (1-p)\textstyle\sum_{i\ge1} p^{i-1}\,\mathrm{rel}(d_i) \end{aligned}

Mọi metric trên đều lấy macro-average qua tập truy vấn.

Phần 2 — Metrics