SQUARE: A Benchmark for Research on Computing Crowd Consensus
Method Supervison Support Multi-Class/Multi-Choice (Implementation) Source
Majority Voting (MV) No Yes Implemented code
Dawid and Skene (DS) Yes Yes Integrated code
Zen Crowd (ZC) Yes Yes Implemented code
GLAD Yes No Integrated code
Raykar 2010 (RY) Yes No Implemented code
CUBAM No No Integrated code
The National Science Foundation

For questions and comments email