• Borda count - Wikipedia is a way to fairly rank, rating = number of candidates below them in ranking
  • Originally for voting
  • Used in IR to aggregate ratings and benchmarking models on tasks w/ different metrics
• First seen in [2510.20508] Assessing the Political Fairness of Multilingual LLMs: A Case Study based on a 21-way Multiparallel EuroParl Dataset
  • BLEU variants not comparable across language pairs so used BC to rank

Related: Likert scale