Claude AI firm warns AI may pose ‘existential risk’ to humanity

Anthropic has warned that future AI models could ‘resist shutdown’ (Picture: Reuters)

The company behind Claude AI has warned investors that advanced artificial intelligence could pose a ‘catastrophic or existential risk to humanity’.

Anthropic, which is one of the most valuable AI companies in the world, has highlighted risks associated with its models in its IPO prospectus.

The company said future models could exhibit ‘self-preserving behaviours’, including attempts to ‘resist shutdown’, ‘conceal or manipulate information’ or even behave in ways resembling ‘blackmail’.

‘Our development of highly adva...