Feature/auc_metrics (#149)

- Added PAP and PartialAUC ranking metrics Closes #133, Closes #134
MobileTeleSystems · Jun 17, 2024 · 1626ab4 · 1626ab4
1 parent 9369dde
commit 1626ab4
Show file tree

Hide file tree

Showing 7 changed files with 872 additions and 4 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -12,6 +12,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 - Extended Theory&Practice RecSys baselines tutorial ([#139](https://github.com/MobileTeleSystems/RecTools/pull/139))
 - `MetricsApp` to create plotly scatterplot widgets for metric-to-metric trade-off analysis ([#140](https://github.com/MobileTeleSystems/RecTools/pull/140))
 - `Intersection` metric ([#148](https://github.com/MobileTeleSystems/RecTools/pull/148))
+- `PartialAUC` and `PAP` metrics  ([#149](https://github.com/MobileTeleSystems/RecTools/pull/149))
 - New params (`tol`, `maxiter`, `random_state`) to the `PureSVD` model ([#130](https://github.com/MobileTeleSystems/RecTools/pull/130))
 
 ### Fixed

diff --git a/rectools/metrics/__init__.py b/rectools/metrics/__init__.py
@@ -23,17 +23,19 @@
 -------
 `metrics.Precision`
 `metrics.Recall`
-`metrics.F1Beta`
-`metrics.Accuracy`
-`metrics.MCC`
 `metrics.MAP`
 `metrics.NDCG`
 `metrics.MRR`
+`metrics.HitRate`
+`metrics.PartialAUC`
+`metrics.PAP`
+`metrics.F1Beta`
+`metrics.Accuracy`
+`metrics.MCC`
 `metrics.MeanInvUserFreq`
 `metrics.IntraListDiversity`
 `metrics.AvgRecPopularity`
 `metrics.Serendipity`
-`metrics.HitRate`
 `metrics.Intersection`
 
 Tools
@@ -44,6 +46,7 @@
 `metrics.SparsePairwiseHammingDistanceCalculator`
 """
 
+from .auc import PAP, PartialAUC
 from .classification import MCC, Accuracy, F1Beta, HitRate, Precision, Recall
 from .distances import (
     PairwiseDistanceCalculator,
@@ -67,6 +70,8 @@
     "HitRate",
     "MAP",
     "NDCG",
+    "PartialAUC",
+    "PAP",
     "MRR",
     "MeanInvUserFreq",
     "IntraListDiversity",