Alpha release of metrics 2.0
Pre-release
Pre-release
ancadumitrache
released this
12 Jun 15:15
·
169 commits
to master
since this release
Experimental release of the CrowdTruth metrics 2.0, attempting continuous way of integrating the 3 components of the crowdsourcing disagreement triangle (workers, annotations and media units). The quality scores of the workers and annotations are used to calculate the quality scores of the media units, and vice versa, in a continuous loop, until the scores are stabilized.