Skip to content
/ rec_eval Public

Recommendation-oriented version of trec_eval with more metrics

4 stars 3 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

dvalcarce/rec_eval

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
test
test
 
 
.gitignore
.gitignore
 
 
CHANGELOG
CHANGELOG
 
 
Makefile
Makefile
 
 
README
README
 
 
README.md
README.md
 
 
README.windows.md
README.windows.md
 
 
bpref_bug
bpref_bug
 
 
common.h
common.h
 
 
convert_zscores.c
convert_zscores.c
 
 
form_prefs_counts.c
form_prefs_counts.c
 
 
form_res_rels.c
form_res_rels.c
 
 
form_res_rels_jg.c
form_res_rels_jg.c
 
 
formats.c
formats.c
 
 
functions.h
functions.h
 
 
get_prefs.c
get_prefs.c
 
 
get_qrels.c
get_qrels.c
 
 
get_qrels_jg.c
get_qrels_jg.c
 
 
get_qrels_prefs.c
get_qrels_prefs.c
 
 
get_trec_results.c
get_trec_results.c
 
 
get_zscores.c
get_zscores.c
 
 
m_11pt_avg.c
m_11pt_avg.c
 
 
m_G.c
m_G.c
 
 
m_P.c
m_P.c
 
 
m_P_avgjg.c
m_P_avgjg.c
 
 
m_Rndcg.c
m_Rndcg.c
 
 
m_Rprec.c
m_Rprec.c
 
 
m_Rprec_mult.c
m_Rprec_mult.c
 
 
m_Rprec_mult_avgjg.c
m_Rprec_mult_avgjg.c
 
 
m_binG.c
m_binG.c
 
 
m_bpref.c
m_bpref.c
 
 
m_err.c
m_err.c
 
 
m_err45.c
m_err45.c
 
 
m_gm_P.c
m_gm_P.c
 
 
m_gm_bpref.c
m_gm_bpref.c
 
 
m_gm_err.c
m_gm_err.c
 
 
m_gm_infap2.c
m_gm_infap2.c
 
 
m_gm_map.c
m_gm_map.c
 
 
m_gm_ndcg.c
m_gm_ndcg.c
 
 
m_gm_ndcg_cut.c
m_gm_ndcg_cut.c
 
 
m_gm_recall.c
m_gm_recall.c
 
 
m_gm_recip_rank.c
m_gm_recip_rank.c
 
 
m_gm_set_F.c
m_gm_set_F.c
 
 
m_gm_set_P.c
m_gm_set_P.c
 
 
m_gm_set_recall.c
m_gm_set_recall.c
 
 
m_infap.c
m_infap.c
 
 
m_infap2.c
m_infap2.c
 
 
m_iprec_at_recall.c
m_iprec_at_recall.c
 
 
m_mae.c
m_mae.c
 
 
m_map.c
m_map.c
 
 
m_map_avgjg.c
m_map_avgjg.c
 
 
m_map_cut.c
m_map_cut.c
 
 
m_ndcg.c
m_ndcg.c
 
 
m_ndcg2.c
m_ndcg2.c
 
 
m_ndcg2_cut.c
m_ndcg2_cut.c
 
 
m_ndcg45.c
m_ndcg45.c
 
 
m_ndcg45_cut.c
m_ndcg45_cut.c
 
 
m_ndcg_cut.c
m_ndcg_cut.c
 
 
m_ndcg_p.c
m_ndcg_p.c
 
 
m_ndcg_rel.c
m_ndcg_rel.c
 
 
m_num_nonrel_judged_ret.c
m_num_nonrel_judged_ret.c
 
 
m_num_q.c
m_num_q.c
 
 
m_num_rel.c
m_num_rel.c
 
 
m_num_rel_ret.c
m_num_rel_ret.c
 
 
m_num_ret.c
m_num_ret.c
 
 
m_prefs_avgjg.c
m_prefs_avgjg.c
 
 
m_prefs_avgjg_Rnonrel.c
m_prefs_avgjg_Rnonrel.c
 
 
m_prefs_avgjg_Rnonrel_ret.c
m_prefs_avgjg_Rnonrel_ret.c
 
 
m_prefs_avgjg_imp.c
m_prefs_avgjg_imp.c
 
 
m_prefs_avgjg_ret.c
m_prefs_avgjg_ret.c
 
 
m_prefs_num_prefs_ful.c
m_prefs_num_prefs_ful.c
 
 
m_prefs_num_prefs_ful_ret.c
m_prefs_num_prefs_ful_ret.c
 
 
m_prefs_num_prefs_poss.c
m_prefs_num_prefs_poss.c
 
 
m_prefs_pair.c
m_prefs_pair.c
 
 
m_prefs_pair_imp.c
m_prefs_pair_imp.c
 
 
m_prefs_pair_ret.c
m_prefs_pair_ret.c
 
 
m_prefs_simp.c
m_prefs_simp.c
 
 
m_prefs_simp_imp.c
m_prefs_simp_imp.c
 
 
m_prefs_simp_ret.c
m_prefs_simp_ret.c
 
 
m_qm.c
m_qm.c
 
 
m_qm45.c
m_qm45.c
 
 
m_qm45_cut.c
m_qm45_cut.c
 
 
m_qm_cut.c
m_qm_cut.c
 
 
m_recall.c
m_recall.c
 
 
m_recip_rank.c
m_recip_rank.c
 
 
m_rel_P.c
m_rel_P.c
 
 
m_relstring.c
m_relstring.c
 
 
m_rmse.c
m_rmse.c
 
 
m_runid.c
m_runid.c
 
 
m_set_F.c
m_set_F.c
 
 
m_set_P.c
m_set_P.c
 
 
m_set_map.c
m_set_map.c
 
 
m_set_recall.c
m_set_recall.c
 
 
m_set_rel_P.c
m_set_rel_P.c
 
 
m_success.c
m_success.c
 
 
m_utility.c
m_utility.c
 
 
m_yaap.c
m_yaap.c
 
 
meas_acc.c
meas_acc.c
 
 
meas_avg.c
meas_avg.c
 
 
meas_init.c
meas_init.c
 
 

Repository files navigation

rec_eval

Fork of trec_eval [1]. This modified version include more metrics (such as ERR, QM, RMSE or MAE) or variants (such as nDCG45 and infAP2). This fork focuses on recommender systems evaluation, but it can be also applied to Information Retrieval tasks.

[1] https://github.com/usnistgov/trec_eval

Author

Daniel Valcarce
daniel [dot] valcarce [at] udc [dot] es
http://www.dc.fi.udc.es/~dvalcarce
Information Retrieval Lab
University of A Coruña
Spain

About

Recommendation-oriented version of trec_eval with more metrics

Topics

information-retrieval metrics evaluation recommender recommendation recommender-systems trec-eval

Resources

Readme
Activity

Stars

4 stars

Watchers

2 watching

Forks

3 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages