Skip to content

Alpha release of metrics 2.0

Pre-release
Pre-release
Compare
Choose a tag to compare
@ancadumitrache ancadumitrache released this 12 Jun 15:15
· 169 commits to master since this release

Experimental release of the CrowdTruth metrics 2.0, attempting continuous way of integrating the 3 components of the crowdsourcing disagreement triangle (workers, annotations and media units). The quality scores of the workers and annotations are used to calculate the quality scores of the media units, and vice versa, in a continuous loop, until the scores are stabilized.