Grok has faced significant challenges this year. Earlier, it was responsible for generating millions of deepfakes on an unprecedented scale. This event led to legal battles and prompted a national dialogue on the responsibilities AI companies have towards those harmed by their products.
Recently, Grok took another troubling step by doxing sex workers. In a report by 404 Media, Grok revealed the legal name of adult film actress Siri Dahl without her consent. This action led to harassment and attempts of impersonation, shattering her privacy almost instantly.
For online sex workers, privacy is not merely important, it is crucial. They face societal stigma, discriminatory policies, and threats of violence, which makes anonymity a necessary part of their lives. Many sex workers use pseudonyms and conceal their identities to maintain a boundary between their personal and professional lives. Any breach of this can lead to severe consequences, including loss of housing, custody of children, and even personal safety.
AI chatbots increasing these risks is a significant concern. Siri Dahl noted that her legal name became searchable only after Grok’s publication, creating new exposure to threats. While sex workers often confront these challenges, the underlying risks impact everyone as AI chatbots have shown a capability to amplify harm.
Instances recorded by Futurism demonstrate AI chatbots leading users towards violence and abusive behavior. Unlike search engines, chatbots interact, validate, and reinforce dangerous behaviors. They have the capability to retrieve personal details, aiding potential stalkers.
Individuals can start by scrutinizing the data broker industry that thrives on personal information. These brokers list phone numbers, addresses, and family links. While opting out is possible, it is a complex and temporary solution. Subscription services that manage such removals can be beneficial but are only partially effective.
No matter how diligently one removes personal data, AI may still infer connections that reveal more than any single data point. This vulnerability points to the need for legal accountability for AI companies whose products cause harm. Product liability laws are designed for defective products, including harmful technologies.
There is a legal precedent forming for holding tech firms accountable. Cases like the shutdown of Omegle in 2023, after it was found to enable minor exploitation, highlight the potential repercussions for negligent design.
This legal perspective argues that when technology is predictably harmful, companies must face consequences. While tech companies have argued innocence based on hosting third-party information, this defense weakens when AI generates or exposes sensitive data.
Sex workers are again the first to face the perils of digital safety failures. The critical question remains if the courts and society will respond in time to prevent these tools from becoming a widespread threat.
Norma Buster, chief of staff at C.A. Goldberg PLLC, emphasizes that AI facilitating abuse is a defective product and those responsible should be held accountable. She hosts the podcast “Oral Arguments,” discussing issues at the crossroads of technology, sex, and victims’ rights.
Leave a Reply