Illinois has passed legislation that will restrict the use of artificial intelligence in therapy services with the aim of protecting patients and preserving mental health care jobs.
Gov. JB Pritzker signed the Wellness and Oversight for Psychological Resources Act on Aug. 4 to prohibit the use of AI for therapy or psychotherapy decision-making, while allowing AI for administrative and supplemental tasks to support licensed behavioral health professionals.
“The people of Illinois deserve quality healthcare from real, qualified professionals and not computer programs that pull information from all corners of the internet to generate responses that harm patients,” said Mario Treto, secretary of the Illinois Department of Financial and Professional Regulation (IDFPR), in a statement.
Officials said that the legislation will protect patients from “unregulated and unqualified AI products” that will also protect “vulnerable children amid the rising concerns over AI chatbot use in youth mental health services.”
The measure follows warnings from experts about the dangers of AI in mental health services, including testimony that “AI algorithms are only as good as the data they are trained on” and concerns that some chatbots provide harmful or dangerous advice.
“We are going to put a stop to those trying to prey on our most vulnerable in need of true mental health services,” Rep. Bob Morgan, D-Deerfield, said.
Sen. Ram Villivalam, D-Chicago, added that the law “sets guidelines for the use of AI in mental health treatment and invests in the well-being of communities, the quality of care they receive, and the standards we hold our mental health care professionals to.”
The act, passed unanimously by the Illinois General Assembly, gives the IDFPR authority to investigate suspected violations and issue fines of up to $10,000. It took effect immediately upon Gov. Pritzker’s signature.