Designing a Tool to Measure Perceptions of AI Fairness 

Abstract: Understanding the impact of AI on society requires understanding how people feel about their impact and what people, outside those building them, think AI should do. However, while performance of algorithms is measured in terms of a now field-standard set of performance metrics, these metrics and their interpretation are not standard knowledge for most people who are impacted by these systems. To express their thoughts reliably, non-expert study participants need to understand what they are being asked. Read more >