evalci: A Python Library for Statistically Rigorous Comparison of Language Model Evaluations
It makes statistical comparisons easier to compute, but its illustrative leaderboard case reconstructs item vectors from aggregate accuracies rather than using original paired logs.
Verify byline in the original ↗