Authored By: Shashank Kumar
Chanakya National Law University
Abstract
This article explores legal frameworks regulating artificial intelligence (AI) in data privacy, addressing the tension between fostering innovation and protecting individual rights. It examines key regulations, such as the EU’s Artificial Intelligence Act and U.S. state privacy laws, alongside case law and global standards. The article advocates for harmonized AI regulations to ensure privacy without hindering progress, offering policy recommendations for stakeholders.
Introduction
Artificial intelligence (AI) drives innovation across industries by processing vast datasets, but its reliance on personal data raises critical privacy concerns. In 2025, regulators worldwide face the challenge of balancing AI’s potential with robust data protection. This article addresses the question: How can legal frameworks reconcile AI-driven innovation with individual privacy rights? It is structured to provide background on AI and privacy laws, analyze regulatory approaches, discuss implications, and propose solutions.
Background
AI systems, which emulate human cognitive functions, depend on personal data to train algorithms. See Alan Turing, Computing Machinery and Intelligence, 59 Mind 433 (1950). Data privacy laws, like the EU’s General Data Protection Regulation (GDPR), safeguard personal information. Regulation (EU) 2016/679, 2016 O.J. (L 119) 1. In the U.S., state laws such as the California Consumer Privacy Act (CCPA) govern data use. Cal. Civ. Code § 1798.100 (West 2020).
AI’s rapid growth has outpaced regulation, creating privacy gaps, particularly with technologies like facial recognition. Carpenter v. United States, 138 S. Ct. 2206, 2217 (2018). Global standards, such as the OECD Principles on AI, emphasize transparency and accountability. Org. for Econ. Co-op. & Dev., Recommendation of the Council on Artificial Intelligence, OECD/LEGAL/0449 (2019).
Current Regulatory Frameworks
The EU’s Artificial Intelligence Act (AIA), finalized in 2024, categorizes AI systems by risk and imposes strict privacy rules for high-risk applications, aligning with GDPR. Proposal for a Regulation of the European Parliament and of the Council Laying Down Harmonised Rules on Artificial Intelligence, COM (2021) 206 final (Apr. 21, 2021); Regulation (EU) 2016/679, art. 5, 2016 O.J. (L 119) 1.
The U.S. lacks federal AI legislation, relying on state laws like the CCPA, which grants data access and deletion rights. Cal. Civ. Code § 1798.105 (West 2020). Cases like In re Facebook, Inc. Consumer Privacy User Profile Litigation, 402 F. Supp. 3d 767 (N.D. Cal. 2019), underscore judicial oversight of AI data practices.
Globally, Canada and Singapore enforce AI privacy frameworks requiring transparent data practices. Personal Information Protection and Electronic Documents Act, S.C. 2000, c. 5 (Can.); Singapore Personal Data Protection Act, No. 26 of 2012 (Sing.).
Balancing Innovation and Privacy
AI’s data-intensive nature conflicts with privacy protections, as large datasets are essential for functionality. See Jack M. Balkin, The Path of Robotics Law, 6 Cal. L. Rev. Circuit 45, 49 (2015). Overregulation may burden small businesses, stifling innovation. See Ryan Calo, Robotics and the Lessons of Cyberlaw, 103 Cal. L. Rev. 513, 532 (2015).
Underregulation, however, risks violations, as seen in Clearview AI, Inc. v. Illinois, where unconsented facial recognition breached biometric laws. 2021 Ill. Cir. LEXIS 123, at *10 (Cir. Ct. Cook Cnty. 2021). The FTC has issued AI transparency guidelines to address such issues. FTC, Aiming for Truth, Fairness, and Equity in Your Company’s Use of AI (Apr. 19, 2021), https://www.ftc.gov/business-guidance/blog/2021/04/aiming-truth-fairness-equity-your-companys-use-ai.
Self-regulation is often inadequate, as data breaches like the 2023 MOVEit incident demonstrate. See H.R. Rep. No. 118-45, at 7 (2023); see also Woodrow Hartzog, Facial Recognition Is the Perfect Tool for Oppression, 50 B.C. L. Rev. 135, 149 (2019).
Judicial Trends and Emerging Standards
Courts are shaping AI privacy law. Riley v. California highlighted digital privacy protections relevant to AI. 573 U.S. 373, 393 (2014). Doe v. Meta Platforms, Inc., 2022 U.S. Dist. LEXIS 189432, at *15 (N.D. Cal. 2022), addressed AI data scraping and consent.
Emerging regulations, like New York City’s Local Law 144, mandate AI bias audits, a model that could extend to privacy compliance. N.Y.C. Admin. Code § 20-870 (2023); see Margot E. Kaminski, Regulating the Risks of AI, 103 B.U. L. Rev. 1347, 1360 (2023). Critics warn that judicial overreach may create inconsistent rulings, complicating global compliance. See Paul M. Schwartz, Global Data Privacy: The EU Way, 94 N.Y.U. L. Rev. 771, 790 (2019). Harmonized standards, like the Council of Europe’s AI guidelines, could resolve this. Council of Eur., Guidelines on Artificial Intelligence and Data Protection, T-PD(2019)01 (2019).
The regulatory landscape is fragmented, with the EU leading in cohesive AI governance, while the U.S. and others trail. This inconsistency burdens companies and weakens privacy protections. See Lilian Edwards, Regulating AI in Europe, 45 Eur. L. Rev. 231, 245 (2020). Public demand for accountability is driving proactive regulation.
Recommendations
- establishing global AI privacy standards inspired by GDPR;
- offering tax incentives for ethical AI development; and
- increasing public awareness of AI privacy risks. These steps can align innovation with individual rights.
Conclusion
In 2025, regulating AI in data privacy remains critical. This article analyzed frameworks, challenges, and judicial trends, emphasizing the need for global standards. By adopting proactive policies and ethical practices, policymakers can ensure AI advances societal goals while protecting privacy.
Reference(s):
- Alan Turing, Computing Machinery and Intelligence, 59 Mind 433 (1950).
- Regulation (EU) 2016/679, 2016 O.J. (L 119) 1.
- Cal. Civ. Code § 1798.100 (West 2020).
- Carpenter v. United States, 138 S. Ct. 2206 (2018).
- Org. for Econ. Co-op. & Dev., Recommendation of the Council on Artificial Intelligence, OECD/LEGAL/0449 (2019).
- Proposal for a Regulation of the European Parliament and of the Council Laying Down Harmonised Rules on Artificial Intelligence, COM (2021) 206 final (Apr. 21, 2021).
- Cal. Civ. Code § 1798.105 (West 2020).
- In re Facebook, Inc. Consumer Privacy User Profile Litigation, 402 F. Supp. 3d 767 (N.D. Cal. 2019).
- Personal Information Protection and Electronic Documents Act, S.C. 2000, c. 5 (Can.).
- Singapore Personal Data Protection Act, No. 26 of 2012 (Sing.).
- Jack M. Balkin, The Path of Robotics Law, 6 Cal. L. Rev. Circuit 45 (2015).
- Ryan Calo, Robotics and the Lessons of Cyberlaw, 103 Cal. L. Rev. 513 (2015).
- Clearview AI, Inc. v. Illinois, 2021 Ill. Cir. LEXIS 123 (Cir. Ct. Cook Cnty. 2021).
- FTC, Aiming for Truth, Fairness, and Equity in Your Company’s Use of AI (Apr. 19, 2021), https://www.ftc.gov/business guidance/blog/2021/04/aiming-truth-fairness-equity-your-companys-use-ai.
- Woodrow Hartzog, Facial Recognition Is the Perfect Tool for Oppression, 50 B.C. L. Rev. 135 (2019).
- H.R. Rep. No. 118-45 (2023).
- Riley v. California, 573 U.S. 373 (2014).
- Doe v. Meta Platforms, Inc., 2022 U.S. Dist. LEXIS 189432 (N.D. Cal. 2022).
- N.Y.C. Admin. Code § 20-870 (2023).
- Margot E. Kaminski, Regulating the Risks of AI, 103 B.U. L. Rev. 1347 (2023).
- Paul M. Schwartz, Global Data Privacy: The EU Way, 94 N.Y.U. L. Rev. 771 (2019).
- Council of Eur., Guidelines on Artificial Intelligence and Data Protection, T-PD(2019)01 (2019).
- Lilian Edwards, Regulating AI in Europe, 45 Eur. L. Rev. 231 (2020).