HARRISBURG – In an effort to further provide safeguards minors from harmful technology, PA Senate Communications and Technology Chair Senator Tracy Pennycuick (R-24) is introducing legislation to establish clear, age-appropriate standards centered on child safety and prevention for minors interacting with AI chatbots.
Specifically, the measure will require robust safeguards to prevent content generation that encourages self-harm, suicide or violence against others; and directs users to appropriate self-harm crisis resources whenever high-risk language is detected.
“As these tools become more common in classrooms, on smartphones and across social platforms, our laws must keep pace to prevent avoidable tragedies. Recent heartbreaking stories have come to light of vulnerable individuals, including minors, who have used AI chatbots to cope with trauma, mental health, depression, and anxiety,” said Sen. Pennycuick. “Unfortunately, some of the responses they received have contributed to reported incidents of self-harm or even suicide.”
Multiple families have alleged in recent lawsuits that AI chatbots contributed to their teen’s death by suicide, involving interactions with popular AI companions. These tragic cases underscore the urgent need for safeguards to protect children from unsafe and unvetted AI systems.
A recent risk assessment warns that AI “companion” bots can exacerbate mental health problems for kids, including risks related to self-harm. Clinical commentators have likewise flagged the dangers posed by unrestricted use of chatbots, where the tool itself can worsen a user’s condition, and called for stronger guardrails.
CONTACT: Lidia Di Fiore (215) 541-2388