Authored By: Sujana B Urs
Bharati Vidhyapeeth New Law College
Introduction
With the advancement of digital technology, there has been revolutionary changes in the ways of communication, entertainment, and collecting information all around the globe. One of the major technological advancements in recent times is the advent of deepfake technology. Deepfake technology refers to the creation of digital imagery through the use of artificial intelligence and deep learning in order to manipulate any kind of visual content in a realistic manner.
While deepfake technology has some legitimate applications in fields such as entertainment, education, movies, and accessibility, the improper use of this technology has led to several legal and moral problems associated with deepfake technology. The improper use of deepfake technology has resulted in spreading misinformation, defamation, monetary scams, electoral interference, and creation of explicit material without consent. The misuse of deepfake technology has posed serious threats in the context of privacy, cybercrimes, freedom of speech, and individual dignity in India.
However, the legal issues surrounding deepfakes have gotten more complex as a result of fast spreading of material via social networking websites. There are various provisions in place under laws like the Information Technology Act ,2000, The Bharatiya Nyaya Sanhita 2023, and the Digital Personal Data Protection Act ,2023 provide certain remedies against cyber offences and privacy violations. However, these laws do not specifically regulate deepfake technology or address the unique harms caused by AI-generated synthetic media.
There needs to be a special legislation enacted which can effectively strike the right balance between technological advancement and privacy concerns. The purpose of this paper is to examine the phenomenon of deepfakes, study the legal issues arising out of the use of deepfake technology, assess the sufficiency of Indian legislations dealing with the problem, review international regulations regarding deepfakes, and propose reforms where necessary.
Understanding Deepfake Technology
The term deepfake is derived from the combination of the two words; “deep learning” and “fake”. The deepfake technology uses Artificial Intelligence in the creation of video, audio or images that can be realistic but not real. It involves using a computer system to analyze large databases of photos, videos and voice clips to mimic human expressions, movements and speech.
Deepfakes are created using methods like Generative Adversarial Networks (GANs) where one artificial intelligence software generates deepfake while the other one evaluates the generated one’s legitimacy. This leads to an improvement in the level of realism over time.
This technology is not entirely harmful . In the entertainment industry, it has been used in special effects, dubbing and historical simulations. Educational bodies may use deepfake in learning and simulation. Accessibility technologies may use AI- generated voices to aid disabled people.
However, the misuse of deepfake technology has overshadowed all its positive uses. Deepfakes nowadays are widely used for manipulating public opinion, spreading wrong information, tarnishing someone’s reputation, or even creating non-consensual sexually explicit content. The victim could suffer both psychologically, socially, and financially due to this misleading information as it often appears to be authentic.
Another issue is the growing availability of deepfake software. The individual no longer needs to have highly advanced technical skills to create fake images. There are a number of web-based applications available nowadays that could help anyone create deepfakes.
Legal Issues Created By Deepfakes
Privacy Violations
One of the major issues related to deepfake technology is violations of privacy. Deepfakes make use of someone’s face, voice, or identity without prior permission. This kind of use can adversely affect the privacy and dignity of an individual.
The Supreme Court of India held that the Right to Privacy as a fundamental right in the case of “Justice K.S. Puttaswamy (Retd.) vs. Union of India”.
The judgement observed that the Right to Privacy is an integral part of Article 21 of the Constitution of India. The use of deepfakes through exploitation of personal identities can be considered a direct attack on the constitutional guarantee.
As an illustration, AI-based videos can create images of people engaging in acts which they have not done. People can lose their reputation or respect before others; moreover, the mental trauma faced by the victim cannot be ignored. Non-consensual deepfake pornography involving women is another aspect of deepfake technology posing serious concerns.
India does recognize some privacy rights under its laws; however, the absence of any specific legal measure specifically dealing with deepfake misuse creates uncertainty regarding enforcement and victim protection.
Defamation and Reputational Harm
Through the production of deepfake content which looks real, the reputation of an individual may suffer immensely. In most cases, the affected individuals may include politicians, celebrities, journalists, and common people who become victims of manipulated information meant to deceive others.
Bharatiya Nyaya Sanhita, 2023 laws can help address defamation cases brought forth in relation to deepfake content. The issue, however, is that deepfake content spreads rapidly across digital platforms, making it difficult to identify the original creator or remove the content effectively.
Contrary to conventional defamations, deepfakes are highly convincing because of their vividness. Even upon legal intervention, such manipulated content will still propagate through cyberspace.
It becomes very hard for those involved to track the originator of the deepfake especially when the content is anonymous and generated beyond India’s territory. Existing legal remedies often fail to provide timely relief to victims.
Deepfake Pornography and Women’s Rights
Among the most concerning aspects of using deepfakes is the creation of pornography in the absence of consent, especially in relation to women. There have been increasing incidences of explicit content created by using Artificial Intelligence featuring both celebrities, public and even private persons.
This practice compromises one’s privacy, dignity, and body. Victims commonly suffer from mental and emotional distress, harassment, and reputation loss.
There may be sections in the Information Technology Act, 2000 that could provide limited protection in cases of cyber obscenity and online publishing of pornographic content. However, since such acts were formulated prior to the emergence of high-end AI-generated media, they have no specific provision addressing the use of deepfakes for creating pornography.
The absence of an instant mechanism to delete the video in question further compounds the problem. Due to the rapid spread of content across different platforms, there arises difficulty in restoring the victim’s personal image on digital platforms.
Deepfake pornography also raises broader concerns regarding gender-based cyber violence and the need for stronger legal safeguards protecting women in digital spaces.
Political Misinformation and Danger to Democracy
Deepfake technology poses serious risks to democratic institutions and electoral processes. Manipulated videos or speeches may be used to spread false political information, influence voters, or incite social unrest.
During the times of elections, the manipulated videos may affect political leadership negatively by creating communal problems or misleading voters. As a result, many people would believe in these without verifying authenticity.
Social media is the fastest-growing platform for the dissemination of information. Consequently, fake news could reach many people before appropriate measures are taken.
While Article 19(1)(a) of the Indian Constitution guarantees “freedom of speech and expression”, any misinformation or manipulated content may necessitate the imposition of a restriction under Article 19(2).
It is one of the most challenging tasks to strike the balance between free speech and prevention of digital misinformation.
Financial Fraud and Cybercrime
The use of deepfake technology in committing acts such as financial fraud and cybercrime is rapidly increasing. The criminals of such fraud can make use of an AI voice cloning application to act in the capacity of business executives, family members, and government officials.
There have been many instances reported from across the world where deepfake audio has been effectively used to convince employees to transfer huge sums of money to fraudsters. In India, similar problems could surface as digital financial services continue to grow.
Deepfake technology may also be employed for identity theft, extortion, blackmail, and phishing attacks. While laws governing cybercrime offer some protection against such acts, the sophisticated nature of deepfake technology could undermine those efforts.
Existing Legal Framework in India
Information Technology Act, 2000
The Information Technology Act, 2000 serves as India’s primary legislation governing cyber offences and digital activities. Certain provisions of the Act may indirectly apply to deepfake-related offences.
These sections include Section 66D concerning cheating by personation through the use of computer resources and Sections 67 and 67A covering the publication and distribution of obscene and sexually explicit material.
Even though these sections may be applicable where there are cases of deepfake offences, they do not mention anything specific about synthetic media. This results in challenges for authorities in enforcing cyber laws against modern deepfake offences.
Bharatiya Nyaya Sanhita, 2023
The Bharatiya Nyaya Sanhita, 2023 includes provisions regarding defamation, forgery, impersonation, and the publication of offensive material. Such provisions might find relevance in deepfake cases involving malice in the production of the videos.
However, the legislation was not specifically designed to address synthetic media technologies. Traditional criminal law frameworks may struggle to respond effectively to the speed, anonymity, and cross-border nature of deepfake propagation.
Moreover, criminal investigations involving deepfake technology require technical expertise and digital forensic capabilities that may not always be readily available.
Digital Personal Data Protection Act, 2023
The Digital Personal Data Protection Act, 2023 is intended to enhance privacy regulations and the processing of personal data in India.
Since deepfake technologies often depend on personal photos, video recordings, and audio recordings, the misuse of such personal data might be in violation of privacy laws outlined in the Act.
Nevertheless, the Act does not address synthetic media manipulation; rather, its main emphasis is on data processing and obtaining consent.
Thus, even though the Act contributes to enhancing privacy laws, it does not sufficiently cover the full spectrum of negative effects that may result from the use of deepfake technologies.
Regulation of Deepfake Technology in Other Nations
Various nations have started taking steps in the direction of regulating deepfake technology.
The European Union has stressed on transparency and accountability through digital governance models. There are specific provisions under the EU Artificial Intelligence Act and the Digital Services Act which focus on AI generated content and the duties of platforms.
In the United States , some states have implemented regulations in response to deepfake pornography and misleading political information during elections. Nevertheless, the lack of a comprehensive framework at the federal level continues to cause problems.
China has adopted stricter regulatory measures requiring synthetic media content to be clearly labelled. Service providers must also verify user identities and prevent misuse of AI-generated content.
This highlights the increased global awareness regarding the risks involved with deepfake technology. India can take inspiration from these regulatory structures when implementing their laws.
Challenges in Regulating Deepfakes in India
The main challenge associated with deepfakes regulation is linked to difficulties in locating the creator and tracing the origin of the altered content. Such videos could be posted and spread anonymously across various online platforms.
Another challenge is related to striking a balance between regulation and freedom of speech as well as technological advancement. The creation of too strict rules may inhibit creativity, including the art of satire.
The international dimension presents an additional challenge because of cross-border dissemination of such fake content. This could affect India despite its development being done outside of its territory.
Another issue is linked to inadequate technical capabilities of authorities for detecting and investigating artificial intelligence-produced media.
Finally, technological advancement requires legal solutions that would not become out-of-date too quickly.
Recommendations
India needs to bring in dedicated laws governing the use of deepfake technology. This will eliminate any uncertainties and enable better enforcement of law.
The Indian government should impose labeling requirements on artificial intelligence generated materials in order to ensure transparency.
Social media platforms and digital intermediaries should also be required to develop quicker takedown processes for deepfake content that poses a risk to society.
Public education programs are also necessary. People should be made aware of the dangers of deepfakes and how to spot manipulated content.
India also needs to improve its digital forensics capabilities along with investing in AI detection technology.
Finally, international cooperation will play a crucial role in addressing cross-border deepfake offences and developing global standards for responsible AI governance.
Conclusion
The development of deepfake technology is considered one of the major threats of the modern technological era. While synthetic media technology has numerous advantages in terms of its application in entertainment, education, and innovations, there are several concerns associated with the use of such technologies for defamatory, criminal, and illegal purposes that may involve privacy, defamation, cybercrimes, spreading misinformation, and online harassment based on gender.
While India currently has provisions of law that can address some forms of cybercrimes and violations of personal privacy, it lacks adequate legal measures for controlling deepfake technology or regulating any specific harms posed by it.
Given the increasing developments in this area of technology, India needs an effective legal framework that would protect individuals’ rights and promote innovation.
Reference(S):
Cases
Justice K.S. Puttaswamy (Retd.) v. Union of India, (2017) 10 SCC 1.
Shreya Singhal v. Union of India, (2015) 5 SCC 1.
Statutes
Bharatiya Nyaya Sanhita, No. 45 of 2023, INDIA CODE (2023).
Digital Personal Data Protection Act, No. 22 of 2023, INDIA CODE (2023).
Information Technology Act, No. 21 of 2000, INDIA CODE (2000).
The Constitution of India.
Books
FRANK PASQUALE, THE BLACK BOX SOCIETY: THE SECRET ALGORITHMS THAT CONTROL MONEY AND INFORMATION (2015).
Journal Articles
Ryan Calo, Artificial Intelligence Policy: A Primer and Roadmap, 51 U.C. DAVIS L. REV. 399 (2017).
Government and Institutional Reports
NITI Aayog, National Strategy for Artificial Intelligence #AIForAll (2018).
Proposal for a Regulation Laying Down Harmonized Rules on Artificial Intelligence (Artificial Intelligence Act), COM (2021) 206 final (Apr. 21, 2021).
