In the fall of 2024, California Governor Newsom signed into law Senate Bill 1120. With that action, California became one of the first states to enact a law that regulates the use of artificial intelligence by health and disability insurance plans. This bill is also known as the Physicians Make Decisions Act.
The new law regulates California health and disability insurers who use artificial intelligence, algorithms, or other similar software (AI tools) for analyzing medical necessity as part of utilization reviews or other utilization management functions. The law does not prohibit the use of AI by health and disability insurers; rather, it regulates it when used.
The law states that AI tools may not supplant a human healthcare provider in making decisions for analyzing medical necessity. Specifically, insurance carriers may not deny, delay, or modify health care services based on a medical necessity determination made by an AI-based decision-making tool.
The plain purpose of the law is to safeguard patient access to treatments by mandating a certain level of health care provider oversight when payors use AI tools to assess the medical necessity of a requested service.
This law is directed toward health and disability insurers. However, employers should be aware of the impact on the claims administration practices of their plans.
Health plans are increasingly relying on AI tools to streamline internal operations, including automating prior authorizations and utilization management processes. These AI tools have been marketed with the promise of both reducing costs and increasing efficiency. However, since their implementation, concerns have been raised about the stringent application of algorithms resulting in delays or incorrect denials of claims. Additionally, there are concerns about the lack of oversight by healthcare professionals whose experience and training would recognize nuances and complexities that AI tools might miss.
SB 1120 does not prohibit insurers from using AI tools. It prohibits sole dependence on it for medical decisions and aims to correct the lack of oversight by healthcare professionals. The law mandates that determinations of medical necessity under health plans be made by a licensed healthcare professional. A licensed healthcare professional is defined as a physician or other licensed healthcare professional who is competent to evaluate the specific clinical issues involved in the healthcare services requested by the provider. In short, AI cannot supplant the role of a healthcare provider in decision-making.
In addition to prohibiting AI tools from replacing physicians in the decision-making process, the new law incorporates specific requirements to regulate the use of AI tools that are employed to analyze medical necessity. These include:
Insurance carriers are mandated by the law to disclose the methodologies used by utilization review or utilization management contractors. This information must be provided to the insurance commissioner and made available to policyholders upon request.
The criteria employed by an insurer or contractor for utilization review or utilization management purposes, to decide whether to authorize, modify, delay, or deny healthcare services, must adhere to all of the following requirements:
The required upon request must be accompanied by the following notice: “The materials provided to you are guidelines used by this insurer to authorize, modify, or deny health care benefits for persons with similar illnesses or conditions. Specific care and treatment may vary depending on individual need and the benefits covered under your insurance contract.”
The law applies to health plans and disability insurers, both in-state and out-of-state, that use AI tools to analyze medical necessity affecting California enrollees. Applicability is not conditioned on whether the contract is written or filed in California. It applies to California enrollees in plans written in any jurisdiction.
The swift adoption of artificial intelligence tools is being met with both enthusiasm and concern across various industries. Insurance carriers have been among the early adopters of this technology. This bill reflects California’s initiative to safeguard patients amidst the rapid adoption of this evolving technology.