FairStress: A deeper evaluation of fairness in LLM decision-making
AllenAI introduces FairStress, a benchmark revealing that LLMs exhibit 'anti-stereotypical over-correction'—abandoning correct decisions more readily when favoring minority candidates—through adversarial prefix testing across 15 models and 13M test cases.