Council for Countering Online Disinformation Research, public affairs, thought leadership, consulting and media literacy

What Does the Burnham Premiership Mean For Disinformation Policy?

?

With all eyes on the former Greater Manchester mayor’s Cabinet appointments and policy agenda, the CCOD takes a look at how disinformation policy should be shaped in a new era of British politics.

Today, Andy Burnham was sworn in as the new Prime Minister at a time when the safety of the British people is more under threat than ever. The CCOD welcomes his diagnosis of the darkening national security picture, where threats abroad are impacting British people and business at home.

As outlined in his op-ed in The Times, the nature of warfare is changing. Our adversaries seek to attack the very fabric of society. In other words, we are facing hybrid warfare. Its most lethal arm, disinformation, has been consistently listed as a top global risk for the past three years by the World Economic Forum (WEF), which also assessed that it is the only one acting as a catalyst for ‘‘all other risks”, including societal polarisation.

Burnham recognises that social media platforms provide the infrastructure for these risks to spread, having expressed support for a ban. Acknowledging the reality of hybrid warfare and how platforms enable it is a good first step. But to build a Britain that is more ‘’resilient’’ to it and fulfil Burnham’s ‘’first priority’’ of keeping the British people safe, this government must be proactive in tackling disinformation. It has inherited two critical pieces of legislation that, if enforced correctly, will build a society that is better equipped to deal with the ‘’changing nature of war’’ and stifle the infrastructure that online threats, such as disinformation, rely on.

The Defence Investment Plan (DIP) seeks to mobilise Britain for this end, whilst the proposed social media ban for under-16s, and the conversation around online safety more generally, seek to protect our young people and society from online threats. The CCOD makes the case that they present the largest window of opportunity for this new government to achieve its aims. Both issues pose a challenge, but CCOD’s proposals for piecemeal amendments to the inherited legislation offer cost-effective, research-backed solutions and provide good early optics for a new government seen as tackling a critical societal issue. Whilst this same approach should be taken to amend existing pieces of legislation, in the long term, new statutory powers should be brought in.

Our Proposals

Tackling Hybrid Warfare

It is now commonly accepted that conflict has moved beyond traditional borders. State actors such as Russia have relished a new age of technological advancement, launching campaigns such as Doppelgänger to incite political tensions and reduce Western support for Ukraine as part of a multi-pronged cyber strategy. The same can also be said for Iran, with research consistently noting a decline in pro-independence Scottish accounts in correlation with Tehran’s restrictions on internet access, whilst original CCOD research identified a large cohort of low-authenticity accounts amplifying misinformation that sparked riots on the streets of Epsom only recently.

Support British AI

In response to these threats, it is imperative that Britain leverages the speed of AI development for innovation-led solutions. Real-time detection tools developed by several British startups should be supported and integrated into government contracts, providing a cost-effective line of defence and a rapid response where traditional procurement falls short.

The Sovereign AI Fund, set up by DSIT (whose very future has reportedly come under question), should be used as a blueprint and replicated to provide government funding for British AI startups. These companies are innovating LLM detection technology to detect and defend against false narratives. Public funds can harness this existing ecosystem.

Ban Bots and Fake Accounts

Bot farms are used by state actors to rapidly spread disinformation and capitalise on public order crises. Currently, they benefit from the same human rights provisions, such as freedom of speech, that human users possess. Social media companies must enforce their own terms of service, remove bot accounts that amplify disinformation, and end the practice of monetising false content produced by bots.

A policy to end the monetisation of bot content should be pursued to remove the incentive for opportunists to amplify discontent. For foreign campaigns, SIM farms allow organisations such as the Social Design Agency to produce huge quantities of bots who, with SMS verification, can bypass bot detection systems and create legitimate-looking accounts. Currently, the UK is one of the cheapest countries to buy SIM cards; telecommunications companies must be mandated to carry out effective “know-your-customer” checks to counter this.

Mandatory AI Watermarking

AI-watermarking can also be deployed to protect our electoral integrity, which is a crucial aspect of a resilient Britain. Many MPs have been subject to deepfake attacks, such as George Freeman, who had to make a statement disavowing an AI video in which he defects to Reform UK. The Representation of the People Bill already seeks to protect our elections, and this policy would be an effective addition with broad parliamentary support from concerned MPs. Much like in California and the EU, this Government should implement it to nullify a weapon of divisive disinformation campaigns whilst protecting our democracy and our politicians from deepfakes.

Mandatory Media Literacy Training for Workforces

Initiatives must be deployed in the corporate space as the economy increasingly becomes a target of digital danger. Burnham has already acknowledged that hybrid warfare targets our economy and critical industries, citing the Jaguar Land Rover cyber attack that put British jobs at risk and cost our economy £1.9 billion. AI lowers the barrier of entry for launching attacks such as this on British business.

Say No To Disinfo and Fennimore Harper Communications revealed in a simulation that for every £10 spent on false adverts to encourage a bank run, as much as £1 million could be moved. These campaigns can also include deepfake content of CEOs to manipulate markets; Arrup lost £20 million as deepfakes impersonated officials to encourage an employee to move funds. As a result, jobs can be lost, the shares and pensions of British workers hit, and the economy hurt; all issues that bring warfare closer to home.

Currently, the Government’s digital and media literacy training is directed at school curricula; an approach that, whilst worthwhile, doesn’t address the immediacy of the threat. Burnham pledges to ‘’back British workers and businesses’’, who are currently underequipped to recognise and respond to disinformation. If this Government is serious about protecting the people it pledges to, it must train the citizens of today as well as of the future, and utilise the workforce as a means to access the adult population with training materials. Detection software, literacy training, and AI watermarking will build our resilience and an ‘‘all-of-country approach to defence’’, as the SDR’s Lord Robertson demands.

Online Safety

Use the Social Media Ban to Incentivise Safety-by-Design

The Starmer premiership was right to capitalise on the national conversation around online safety. However, it remains the case that an arbitrary cliff edge at 16 shifts the responsibility of avoiding online harms onto the user, allowing social media companies to continue to enable disinformation and broader online harms to exist. Equally, parliamentarians and ministers have expressed concern over how effective a ban will be in achieving its aims. Evidence from the Australian case study has shown that 61% of 12-15-year-olds retained access to platforms, as their own age-verification systems are inadequate and VPNs provide a simple workaround, leaving children exposed to harmful content, such as disinformation. For the 39% who are protected, the inclusion of a threshold age means they will encounter the same harms that have now been allowed to remain on the platforms, simply at a later stage.

As a result, any ban should be accompanied by measures to incentivise platforms to introduce safety-by-design features, utilising the Canadian approach. An incentive-based framework where companies must prove that they have implemented measures to combat online threats in order to have an age restriction lifted.

Mandate User Empowerment and PSBs Through the Online Safety Act

To ensure a resilient Britain, our society must be equipped to navigate the online world. Social and video networks are now used by 54% of people to consume their news, whilst TikTok, YouTube, and Instagram are the leading sources for 12-15 year olds. This acts as a backdoor for disinformation, where bad actors funnel users to cloned sites of legitimate news sources, providing ‘sources’ for their false narratives, and legitimising disinformation with bots amplifying claims across platforms.

Here, there is an opportunity to use the inherited legislation of the Online Safety Act to incentivise platforms to introduce safety-by-design measures, such as factual accuracy toggles, and PSB promotion to tackle the online harms that the government prioritises, as well as disinformation that is enabled by the platforms’ designs. Equally, when a disinformation crisis is detected, either by proposed AI disinformation detection software or existing monitoring, PSBs can provide a solution. Algorithms should promote PSB content during these events; CCOD research revealed that during the Epsom riots, X’s trending feature promoted the Epsom narrative two days after police stated no crime had occurred.

Andy Burnham has made good initial signals on adapting Britain’s defences to the threats of hybrid warfare and protecting our children in the online world. However, if this government is to be successful on these critical issues and protect the adult population as well, disinformation must finally be addressed with the gravity it deserves. The new premiership is inheriting serious challenges, but also a political moment where the momentum is on its side. A national conversation around defensive readiness and online safety is occurring in tandem, providing an opportunity to effectively tackle disinformation in both of these spaces, as well as Burnham’s wider aims of making Britain resilient to the shocks it may face in an increasingly uncertain world.

Related

All news