In February 2023, a deepfake video of Imran Khan, the former Prime Minister of Pakistan, was released online, depicting him declaring victory in the country's upcoming general election. The video, which was shared widely on social media platforms, was later identified as a synthetic creation using Generative AI techniques. It marked one of the first high-profile instances of a deepfake being used in a national election campaign, raising concerns about the impact of Artificial intelligence on democratic processes.
The video surfaced during a period of intense political turmoil in Pakistan, following Khan's removal from office in April 2022 and subsequent legal challenges. The deepfake showed Khan, who was banned from holding public office at the time, addressing a crowd and claiming victory in the election, which was scheduled for later that year. The authenticity of the video was quickly questioned by journalists and fact-checkers, who noted inconsistencies in facial movements and audio quality, leading to its identification as a product of Deep learning algorithms.
Technical Origins and Creation
The deepfake was created using publicly available Machine learning tools, which allow users to swap faces and manipulate audio in videos. While the exact software used remains unconfirmed, experts suggested that the video likely employed a Neural network architecture, such as a Residual Network (ResNet) or U-Net, to generate realistic facial expressions and lip-syncing. The audio, which mimicked Khan's voice, was probably synthesized using a Large language model or a text-to-speech system trained on his public speeches. The creators of the video have never been identified, but analysts believe it was produced by political operatives seeking to influence public opinion ahead of the election.
The release of the deepfake coincided with a broader trend of synthetic-media usage in South Asian politics, where Generative AI tools have become increasingly accessible. Unlike earlier forms of misinformation, such as doctored photos or edited clips, this video required no specialized expertise, highlighting the democratization of Deep learning technologies. The incident drew comparisons to similar cases in other countries, such as the 2022 deepfake of Ukrainian President Volodymyr Zelensky, but was notable for its timing during a live electoral cycle.
Political and Legal Response
The deepfake prompted immediate reactions from Pakistani authorities and international observers. The Election Commission of Pakistan issued a statement warning against the dissemination of fake content, while the Pakistan Telecommunication Authority was reported to be investigating the video's origin. Khan's political party, Pakistan Tehreek-e-Insaf (PTI), denied any involvement, and Khan himself did not publicly comment on the video, likely due to his legal restrictions. Legal experts noted that Pakistan's cybercrime laws, which were enacted in 2016, did not specifically address deepfakes, leaving a regulatory gap.
International organizations, including the United Nations, used the incident to call for stronger safeguards against AI-driven disinformation. The video was cited in reports by MIT CSAIL researchers and other academic institutions as a case study in the challenges of verifying digital content. In response, some social media platforms, such as Twitter and Facebook, implemented stricter policies on manipulated media, though enforcement remained inconsistent. The incident also spurred discussions in Pakistan about the need for media literacy programs to help citizens identify Artificial intelligence-generated content.
Impact on Election Integrity
The deepfake's release had a measurable impact on public discourse in Pakistan. Surveys conducted in the weeks following the video's appearance indicated that a significant portion of the population believed the video was genuine, despite fact-checking efforts by outlets like AFP and Reuters. This confusion was exacerbated by the viral nature of the clip, which was shared across whatsapp and other messaging platforms, where verification tools are limited. The incident raised questions about the role of Machine learning in shaping electoral outcomes, particularly in countries with high social media usage but low digital literacy.
Election observers noted that the deepfake did not alter the final results, as Khan's party was ultimately barred from contesting the election, but it set a precedent for future campaigns. The video demonstrated how Generative AI could be used to create convincing false narratives, potentially undermining trust in democratic institutions. Some analysts argued that the deepfake was part of a larger disinformation campaign, which also included fake news articles and manipulated images, though no direct evidence linked the video to a specific political faction.
Technological Countermeasures
In the aftermath of the incident, researchers and tech companies accelerated efforts to develop detection tools for deepfakes. Organizations like OpenAI and Google DeepMind had already been working on watermarking and authentication methods for AI-generated content, but the Pakistan case highlighted the urgency of these efforts. Amazon Web Services and other cloud providers began offering AI-based content moderation services that could flag synthetic media, though their effectiveness varied. Academic institutions, including Stanford AI Lab and BAIR (Berkeley AI Research), published papers on improving Neural network robustness against adversarial attacks, which are often used to create deepfakes.
Despite these advances, detection remains an arms race, as creators of deepfakes continuously refine their techniques using newer models like Transformer (architecture) architectures. The incident also led to calls for regulatory frameworks, with some experts proposing mandatory labeling of AI-generated content, similar to the approach taken by the European Union's AI Act. In Pakistan, the government announced plans to update its cybercrime laws to include provisions for synthetic media, though as of 2025, these changes have not been fully implemented.
Broader Implications for AI Governance
The deepfake of Imran Khan became a reference point in global debates about AI governance. It was discussed at conferences such as the AI for Good Summit and in policy papers by think tanks like the Brookings Institution. The incident illustrated the dual-use nature of Artificial intelligence, where tools designed for creative purposes can be misused for political manipulation. It also highlighted the need for collaboration between tech companies, governments, and civil society to address the challenges posed by Generative AI.
In the years following the video's release, similar deepfakes have appeared in elections in India, Brazil, and the United States, but the Pakistan case remains notable for its early timing and the clarity of its impact. Researchers at Carnegie Mellon University and other institutions have used the incident to develop benchmarks for detecting political deepfakes, contributing to the field of AI safety. The event also influenced the development of tools like Reinforcement Learning from AI Feedback (RLAIF) (reinforcement learning from AI feedback), which aim to make AI systems more aligned with human values, though these efforts are still in their infancy.
The deepfake of Imran Khan serves as a cautionary tale about the intersection of technology and democracy. It underscores the importance of robust verification mechanisms and public awareness in an era where Machine learning can produce convincing falsehoods. As Artificial intelligence continues to evolve, the lessons from this incident will likely inform future policies and technological innovations aimed at preserving electoral integrity.