This piece is published in partnership with the French Institute for International and Strategic Affairs (IRIS).
The debate about AI’s existential threats can no longer be separated from economic and geopolitical interests. It sheds light on the nature of the global AI race, between the US and China, and between closed and open models.
Real risks deserve proper assessment and regulation to prevent malicious use. However, progress is also needed to achieve better and safer models. Successive warnings about extreme scenarios inspired by science fiction, in which AIs turn against humanity, appear intended to prompt a type of regulation that would limit domestic and international competition, especially from open models.
A slowdown forced by regulation could help to preserve the unsustainable financial dynamics of leading model providers like Anthropic and OpenAI ahead of their IPOs. This trend undermines necessary efforts toward regulatory coordination, since it has now reached the point of spurring a global backlash. Even partner chip companies like Nvidia, which have a more resilient business model, have distanced themselves.
The controversy points to control of AI’s economic value. While closed American AI proves vulnerable to the collapsing price of inference (model usage) and the rise of increasingly powerful Chinese models, China is pursuing a strategy inspired by open source, which Europe too should have implemented to develop its autonomy.
The Nature of AI Risk: From Sci-Fi to Policy-Making
Former and current Anthropic employees, followed by CEO Dario Amodei and OpenAI executives, repeated warnings about the possibility of AI causing human extinction. However, claims that an AI could simply replicate itself indefinitely to escape control, self-improve and take over various systems tend to ignore the hardware and infrastructure constraints involved.
Questions already began to arise in recent months with a series of romanticized disclosures about « rogue agents » escaping testing environments or building “AI civilizations.” The communication around these events obscured faulty engineering behind the threat of human extinction. The Hugging Face platform, which hosts open models, was one of the organizations targeted in such incidents, just weeks before it was acquired by Nvidia.
Though the risk related to swarms of autonomous agents is obviously real, such usage would rather be linked to criminal intent with access to massive compute infrastructure. The fact that agents that are given excessive access can cause damage does not demonstrate that they have developed a will to escape or control human civilization.
No plane manufacturer would reasonably claim that an aircraft developed a malicious conscience, decided to overrule the pilots’ instructions and harm its passengers. The fact that modern planes are highly complex mechanical and electronic systems that can operate with limited human intervention does not imply that they have acquired “agency” or the mental abilities of a bird.
Autonomous systems can create dramatic security problems. AI agents can be given excessive permissions, make mistakes, exploit poorly protected systems and be used in cyberattacks with unprecedented efficiency. These risks will be better managed if safety efforts are not distracted by fanciful philosophical claims.
Regulatory Capture as a Solution to AI’s Economic Conundrum
Leading players can use existential warnings to push for a type of regulation that they would influence, creating a situation of regulatory capture. The companies that already have the computing resources, researchers and capital to develop frontier models are also those best positioned to comply with expensive new regulations and comfortably implement a pause. Barriers that appear to be designed to protect society can therefore make it more difficult for new entrants to challenge the status quo and actually develop more reliable and safer models.
This issue is all the more crucial since the economic model of leading US AI companies appear uncertain. OpenAI and Anthropic are spending gigantic amounts of capital on training, inference and computing infrastructure. They need to turn this spending into a sustainable business model, especially as both companies have declared their intent to go public. However, the models are becoming increasingly standardized (or “commoditized”) and token prices are collapsing.
Agentic AI generates far greater demand for inference because agents can perform long sequences of actions and consume large quantities of tokens. But this does not necessarily mean that OpenAI or Anthropic will capture the value created by that demand. The same compute can be used to run models that are cheaper, open or adjusted by companies themselves, which can then run it on dedicated servers. The model does not need to be rented from its original provider.
The AI boom has created a distinction between the companies developing models and the companies supplying the infrastructure. Nvidia is at the center of this system both from an industrial and financial perspective. The GPUs it designs are required to train and run AI models, within a broader ecosystem including data centers, electricity, memory and semiconductor manufacturing.
The interests of chip companies and LLM providers thus differ. Nvidia benefits from the continued expansion of compute. Jensen Huang’s relatively positive stance on open source can be understood in this context. Open models can create additional demand for dedicated servers and computing infrastructure. A slowdown can be presented as a response to existential risk, but it can also reduce capital expenditure. A temporary reduction in the pace of the race could help a rebalancing of revenue between model providers and chip companies.
China’s Open-Source Challenge Upends US Bubble Dynamics
China has been moving in the opposite direction. Chinese companies have increasingly focused on open models as a way to catch up with the US. DeepSeek became the most obvious example, but it is part of a wider ecosystem that includes Alibaba’s Qwen, Moonshot AI’s Kimi and Zhipu AI’s GLM models. Cheap Chinese models change the economics of AI. They can be downloaded, adapted and deployed locally, allowing companies to build their own systems. This is particularly important for many users from the Global South to US multinationals wary of their AI bill. China can thus develop its own technological sphere of influence.
There is also an important difference in the structure of the Chinese and US AI industries. Both countries have large digital companies that can finance AI development as part of broader businesses involving cloud computing, infrastructure, and, in the case of China, the development of domestic alternatives to Nvidia chips. Both countries also have specialized AI labs. However, in China, specialized labs such as DeepSeek and Kimi, while important, do not constitute the systemic center of an asset bubble like in the US.
Besides, China has little reason to trust that a pause would be implemented in the current geopolitical environment. The strategy adopted by OpenAI and Anthropic undermines the efforts to find common ground on AI regulation, which was supposed to be at the center of upcoming talks between the two governments.
Safety Requires Open Innovation
The technological foundation of modern AI came from open research and an ecosystem in which companies like OpenAI and Anthropic could use publicly available research and data. They have now built closed systems and have an interest in protecting their position. Their claims that they are approaching AGI and solving the most advanced mathematical problems, while still heavily drawing on human expertise, are part of the attempt to demonstrate that their systems reached a unique level of technological advancement. They need investors to keep believing that today’s spending will lead to a profitable oligopoly.
However, progress cannot stop, precisely because LLMs are highly imperfect and risky. Good, rational research and engineering can make them both more effective and safer with appropriate regulation. Future progress will not necessarily come only from scaling existing architectures with more computing power. Different approaches to data and physical AI can produce different advances.
Europe’s Regulatory Impasse
Europe too had the possibility of using open source to catch up with the US without reproducing its entire capital expenditure trends. Mistral was relatively well positioned as its founders came from major digital companies and entered the field early. But the EU’s AI Act raised regulatory barriers when Europe needed more open innovation. Bureaucratic rules and jargon detached from technical reality can be beneficial to the administrations in charge and to strong competitors in other world regions. Several national governments, including those of France and Germany, tried to persuade Ursula von der Leyen to revamp the AI Act before its implementation, to no avail. By comparison, in the summer of 2025, Donald Trump faced little resistance when detailing the amendments that the US ecosystem had requested, amid broader trade instructions.
Besides, Europe has a major strategic position in semiconductors through ASML, which produces lithography machines sold to semiconductor manufacturers like TSMC in Taiwan. Europe could have developed a more ambitious and integrated strategy in semiconductors, AI infrastructure and models. While China was pursuing the opportunity linked to open source with determination, Europe once again deepened its dependence on US technology.
Conclusion: Regulation for Safety, not Oligopolies
Regulation should address actual risks rather than developing new prerogatives based on science fiction. It should avoid giving leading AI providers the power to define the regulatory framework in ways that secure their own market dominance. The current controversies therefore need to be understood in their economic context. The issue is whether demand for AI compute will translate into profits for model providers, allowing them to survive the bursting of the bubble, or primarily for chip companies, and whether open models will redistribute the economic value of AI.
China’s strategy combines open models with the development of domestic chips. It does not need to reproduce the American system, but to build an alternative capable of producing sufficiently powerful AI at lower cost and distributing it widely. The political reaction to AI risks is consequently also part of a much broader race for technological and economic power.








