Standardized tests and questionnaires are used in a variety of contexts such as university admissions, certification, accreditation, or hiring. Fairness, validity and reliability are objectives that every testing organization strives to address, especially in these contexts. Cultures and societies are dynamic. So is awareness of social justice issues (#BlackLivesMatter, #MeToo, broader acceptance of non-binary gender identity). Theoretical and practical approaches to fairness in testing need to evolve. The cApStAn core team consists of 24 people from diverse backgrounds, totalling 15 nationalities, who can identify potential sources of bias that more homogeneous teams are less likely to detect. And when cApStAn does not know the answer, we know whom to ask.