July 2023

AI in HR: Comparing the EU AI Act and NYC Local Law 144

The HR industry is facing challenges in ensuring consistent compliance with an expanding and fluctuating set of regulations, particularly in relation to the use of AI and automated decision-making tools. Two key pieces of legislation are New York City's Local Law 144 and the EU AI Act, which both aim to ensure fairness, transparency and accountability in their respective jurisdictions. Local Law 144 applies specifically to employers or employment agencies using automated employment decision tools, while the AI Act covers a broad range of AI systems and will apply to providers of AI systems established within the European Union or used within it. Both laws have associated penalties for non-compliance, including financial penalties and reputational and operational risks. Holistic AI offers expertise in AI auditing to help organisations navigate these complexities. Applicants should note that this blog article does not offer legal advice or opinion.

What happens if you don't comply with the NYC Bias Audit Law?

New York City Local Law 144 (NYC Bias Audit Law) now requires every employer or employment agency that uses automated employment decision tools (AEDTs) to obtain an independent bias audit of these systems. The audit must be repeated at least annually, and organizations must post a summary of the results on their official website or in a written policy or procedure for promotion candidates. The law imposes legal penalties on those who fail to comply, including significant fines, potential litigation, and human rights claims. AEDTs are defined as systems that rely on machine learning, statistical modeling, artificial intelligence, or data analytics. Non-compliance penalties range from $500 for the first default and each additional default on the same day to $500 to $1,500 for each subsequent default, with each day an AEDT without having been audited counting as a separate default. The law also allows for potential lawsuits and human rights actions. Holistic AI can help with Local Law 144 compliance and other AI legislation.

AI and Lawsuits: The Need for AI Risk Management

The use of Artificial Intelligence (AI) in high-risk applications is raising legal and ethical questions, leading to legal battles and class actions. The consequences of AI misuse can be severe, including job loss, asset seizure, and wrongful placement of children, prompting the need for AI Risk Management. Several industries have faced legal action due to discriminatory outcomes resulting from AI use, such as HR Tech Lawsuits and Insurance Tech Lawsuits. To avoid such outcomes, due diligence is crucial when outsourcing AI systems, and it is vital to measure and mitigate bias and understand additional risks, such as explainability, robustness, security, and privacy.

What is the EU AI Act?

The EU AI Act is proposed legislation aimed at creating a global standard for protecting users of AI systems from preventable harm. The Act outlines a risk-based approach, establishing obligations for AI systems based on their level of risk. High-risk systems are subject to more stringent requirements, including continuous risk management, data governance practices, technical documentation, and transparency provisions. The Act also prohibits certain practices deemed to pose too high of a risk, such as the use of subliminal techniques or exploitative practices. Non-compliance with the regulation can result in steep penalties of up to €40 million or 7% of global turnover, whichever is higher. The Act will have far-reaching implications and affect entities that interact with the EU market, even if they are based outside of the EU. The enforcement date of the EU AI Act is dependent on several stages of the EU legislative process.

Assembly Bill A07859: New York’s Steps Towards Transparency in HR Tech

New York is leading the way in regulating HR Tech, with Local Law 144 requiring bias audits of automated employment decision tools (AEDTs) and two assembly bills proposed to increase transparency. Assembly Bill A07859 has similar notification requirements to Local Law 144 and requires employers to notify candidates if an AEDT will be used to evaluate them and provide information about the tool. AB A07859 will come into effect on 1 January of the year following its approval. Holistic AI can help companies prepare for new laws and regulations.