Deepfake technology: A growing threat in Pakistan

Artificial intelligence has revolutionized industries from healthcare to entertainment, but its darker applications pose significant challenges. One such innovation is deepfake technology, which uses advanced artificial intelligence algorithms to process images, audio and video, producing highly realistic but completely fabricated content.

Originally intended for creative purposes, deepfake tools have been used by malicious actors to create deceptive and harmful material, often targeting celebrities, politicians and public figures. This abuse has gone global and the situation in Pakistan is particularly worrying; with an increase in the creation and circulation of fake, obscene and profane videos.

Deepfake technology is recognized worldwide as one of the most serious threats to digital privacy and online security. Research shows that 96 percent of online deepfake content is pornographic, primarily targeting women, and the creation of this content has become alarmingly accessible. The psychological, emotional and social repercussions of deepfake abuse in Pakistan are profound. Victims, especially celebrities and high-profile individuals, are often subjected to public outrage, severe emotional distress and, in extreme cases, physical violence.

Law enforcement and legal experts in the country are sounding the alarm about the increasing weaponization of deepfake content, which not only endangers individual lives but also poses a broader threat to social harmony and trust. Overcoming this crisis requires urgent legal reforms, public awareness campaigns, and technological innovations to prevent the misuse of AI-powered tools.

Deepfake technology is becoming increasingly common around the world, especially with the rise of platforms and tools to simplify its creation and distribution. According to recent reports, more than 96 percent of deepfake videos circulating on the internet are pornographic; The most common victims are celebrities. By 2023, the number of deepfake creation communities had grown to exceed 609,000, each contributing to the spread of harmful content.

The accessibility of deepfake technology is an important factor in its widespread use. Tools like DeepNude, which generates explicit content from basic facial images, have gained significant traction around the world, making it easier for anyone to create fake, damaging material. As a result, deepfake technology has become a weapon for cybercriminals, disgruntled former partners, and others looking to exploit others for personal or political gain.

Creating a deepfake video is surprisingly simple. A 60-second fake video can be created with a single image of the target and takes only 25 minutes to make. The technology has become so accessible that minimal technical expertise is needed to create convincing deepfakes using free or low-cost software. This democratization of technology has resulted in the rapid spread of technology and more people participating in the creation and distribution of fake videos, often without considering the harm they may cause to others.

While deepfake technology poses a threat globally, its impact in Pakistan has been particularly damaging due to the rise in cases of fake sexually explicit content and blasphemous videos circulating online. The Federal Investigation Agency reported receiving 1,180 complaints about deepfakes and non-consensual intimate images in 2023. But these figures likely represent only a fraction of the true number of cases, as social taboos surrounding digital harassment prevent many victims from coming forward. The lack of public awareness and support systems for victims means that many people cannot access justice or protection.

While the challenges posed by deepfake technology are significant, they are not insurmountable. Through proactive legal reforms, public education, technological advancement and unwavering support for victims, Pakistan can serve as an example in solving this complex problem. By addressing deepfake at its root, the country has the opportunity to protect the integrity of its digital environment and protect the fundamental rights and dignity of its people. Only with a united front both locally and globally can the dangers of deepfake technology be effectively mitigated, ensuring a safer and more secure future for all.

Women, especially those in the public eye, are disproportionately affected by deepfake attacks. Well-known female celebrities, influencers, and social media personalities are often primary targets of made-up sexually explicit content. In one high-profile case, a well-known actress in Pakistan found herself at the center of a scandal when a deepfake video featuring her was shared across multiple social media platforms. The video, which showed her in a compromising situation, sparked public outrage and led to the actress temporarily withdrawing from the media spotlight to escape vicious online attacks. The fear of being the target of deepfake harassment has created an atmosphere of uneasiness, especially among women who feel increasingly vulnerable in the digital age.

The use of deepfake technology for blasphemous content is also a worrying trend in Pakistan. In a country where religion plays a central role in daily life, any content that offends religious sensitivities can lead to violence. Deepfake videos depicting religious figures in compromising or aggressive situations are a tool used by extremists and miscreants to create social unrest. These videos are often shared on platforms such as WhatsApp, Twitter and Facebook. The ease with which such content is created and shared poses a direct threat to social harmony and peace in Pakistan.

High-profile incidents have occurred around the world where celebrities, politicians and even ordinary individuals have been at the center of malicious deepfake campaigns.

International cases highlight that the misuse of deepfake technology is a global problem that transcends geographical boundaries. From damaging reputations to influencing elections, facilitating fraud, and inciting civil unrest, deepfake technology continues to pose a multifaceted threat to individuals, organizations, and governments around the world.

Pakistan faces many significant challenges. One of the most pressing problems is the lack of resources and technological infrastructure. The FIA ​​Cyber ​​Crime Wing, although dedicated to online crime, is woefully under-resourced and staffed. Law enforcement agencies lack the necessary AI-powered detection tools that could help them identify and track down the creators of deepfake videos. Therefore, many perpetrators act with relative impunity.

Another major challenge is social stigma, especially when it comes to explicit content. In Pakistan’s conservative society, topics related to online harassment are often seen as taboo, and victims, especially women, are often blamed for the abuse they experience. This social attitude prevents many victims from coming forward to report deepfake incidents.

Moreover, the lack of digital literacy and social awareness makes it difficult for individuals to protect themselves. Many people are unaware of how deepfakes are created or how to verify the authenticity of videos and images they encounter online. This ignorance empowers the perpetrators.

A multifaceted approach is required to tackle the growing problem. First of all, a joint effort needs to be made to strengthen the legal framework. Pakistan’s Prevention of Electronic Crimes Act 2016 provides a legal basis to combat online crimes but does not specifically address deepfake technology. To fill this gap, lawmakers need to amend PECA to explicitly criminalize the creation, distribution and consumption of deepfake content, especially where it contains explicit non-consensual material, libel or blasphemy. Additionally, Pakistan should establish clear legal guidelines to prosecute criminals and provide justice to victims.

Public awareness campaigns are also very important. The public needs to be educated about the dangers of deepfake technology and how to recognize and report it. Digital literacy programs should be introduced in schools, colleges and communities. These should also focus on changing social attitudes towards victims, particularly women, so that they feel empowered to report incidents without fear of stigma or embarrassment.

International cooperation will also play an important role. Pakistan should work closely with organizations such as INTERPOL and the UN to share best practices, access advanced tools to detect deepfakes, and collaborate on international legal frameworks to combat proliferation. Additionally, Pakistan should invest in AI-powered tools to detect manipulated content, allowing for more effective law enforcement and faster removal of harmful materials.

While the challenges posed by deepfake technology are significant, they are not insurmountable. Through proactive legal reforms, public education, technological advancement and unwavering support for victims, Pakistan can serve as an example in solving this complex problem. By addressing deepfake at its root, the country has the opportunity to protect the integrity of its digital environment and protect the fundamental rights and dignity of its people. Only with a united front both locally and globally can the dangers of deepfake technology be effectively mitigated, ensuring a safer and more secure future for all.