US-based Identity orchestration company Jumio has released a new research which reveals the disconnection between consumer awareness of AI and deepfakes and their risks to security. Jumio has released the Jumio 2023 Online Identity Study, the second instalment of its annual global consumer research, conducted by Censuswide.

The 2023 results highlight an understanding among consumers around how generative AI and deepfake technologies could accelerate identity fraud, and the subsequent need for digital identities for online verification and authentication. But consumers also appear to overestimate their ability to spot deepfakes, which can render them even more vulnerable to attack. The survey pool The study examined 8,055 adult consumers split evenly across the United Kingdom, United States, Singapore, and Mexico.

Over two-thirds (67%) say they are aware of generative AI tools – such as ChatGPT, DALL-E, and Lensa AI – which can produce fabricated content, including videos, images, and audio. Awareness was highest among consumers in Singapore (87%) and lowest among those in the UK (56%). Underestimating sophisticated technologies and associated losses Awareness of generative AI and deepfakes among consumers is high — 52% of respondents believe they could detect a deepfake video.

This sentiment reflects over-confidence on the part of consumers, given the reality that deepfakes have reached a level of sophistication that prevents detection by the naked eye. This is concerning given that recent figures from UK Finance found that impersonation scams cost the UK GBP 177 million in 2022. The research specifically called out how this has been driven by scams becoming harder to spot as warning signs, such as typos or fake-looking websites, are less prevalent due to the use of generative AI tools.

In the US, consumers lost USD 2.6 billion to impersonation scams in 2022, up from USD 2.4 billion in 2021, according to the Federal Trade Commission. Jumio data also shows a steady uptick in the use of increasingly sophisticated deepfakes across the globe and across industries, with a heavier presence in the payments and crypto sectors. Jumio’s officials said a lot of people seem to think they can spot a deepfake.

While there are certainly tell-tale signs to look for, deepfakes are getting exponentially better all the time and are becoming increasingly difficult to detect without the aid of AI. While AI-powered technology will increasingly be required by businesses to spot and protect their networks and customers from deepfakes, consumers can protect themselves by treating provocative images, videos, and audio with scepticism. Some quick research will usually uncover whether it’s a fake or not.

Awareness shifts to understanding of potential harmful use As consumers become more aware of these technologies, there is also an emerging understanding of how they could be used to fuel identity theft. Over half (57%) believe that online identity theft will become easier as a result, and consumers in Singapore showed the highest level of understanding of their potential harmful use (73%). These levels decrease among consumers in Mexico (62%), the US (49%) and the UK (43%).

Businesses should bear the responsibility to educate and better protect Jumio said that organisations have a duty to educate their customers on the nuances of generative AI technologies to help them develop more realistic expectations of their ability to detect deepfakes. At the same time, even the best education will never be able to completely stop a fraudster’s use of evolving technologies. Online organisations must look to implement multimodal, biometric-based verification systems that can detect deepfakes and prevent stolen personal information from being used.

Encouragingly, their research indicated strong consumer appetite for this form of identity verification, which businesses should act on fast. The survey found that over two-thirds (68%) of consumers are open to using a digital identity to verify themselves online. The top sectors where they would prefer a digital identity over a physical ID (like a driver’s license or passport) are financial services (43%), government (38%) and healthcare (35%).

For more information about Jumio, please check out the company profile in The Paypers Company Database. .