Last day to exhibit your breakthrough to 10,000+ tech leaders at Disrupt is on Oct 2 . Book Exhibit Table Now.
Disrupt doors open Oct. 13. Get your pass and bring someone with you at 50% off. REGISTER NOW.
Anthropic changes usage policy to ban model abuse and election interference
Anthropic updated its usage policy on Thursday , codifying new prohibitions on election interference, weapons software, and surveillance. But perhaps the most attention-getting change is a new prohibition against prolonged verbal abuse of the model, which is now expressly forbidden.
Since an update in August , Claude has been trained to end conversations with “persistently harmful or abusive user interactions” — but the new policy explicitly bars users from pursuing those conversations.
“The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose,” the post explains. “It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research.”
The change comes after Anthropic has sought out collaborations with prominent religious scholars — in some cases, seeking to convince them that Claude could be conscious or have a soul.
Separate sections of the usage policy forbid users from engaging in broadly deceptive campaigns, such as using Claude to run fake accounts or fabricated news outlets. The policy also includes rules against deceiving voters or disrupting elections, collected in a section titled “Do Not Undermine Democratic Processes.”
Get 50% off a second pass The Disrupt experience is meant to be shared. Get your pass and bring a colleague, partner, or peer at 50% off. Cover more ground by making connections, building momentum, and discovering what’s next in the startup ecosystem.
Newsletters
Subscribe for the industry’s biggest tech news
Related
AI How AI decision models could change content moderation Russell Brandom
Latest in AI
AI Ben Affleck is an AI nerd, and the internet is impressed Sarah Perez
Startups Popular AI leaderboard Arena nearly doubles valuation to $3.1B valuation in 10 months Julie Bort
In Brief OpenAI’s revenue is reportedly $20 billion less than previously projected Lucas Ropek