AI-generated report nearly sparked US operation against Chinese ship: CNN

A false intelligence report produced with the help of artificial intelligence reportedly came close to triggering a US military operation against a Chinese vessel in West Asia during the war with Iran, according to CNN, which cited several sources familiar with the incident. The report, which was circulated across the US military this spring, claimed the Chinese ship was carrying components linked to a nuclear weapons programme, prompting alarm and preparations to intercept the vessel. Four sources told CNN that the US military moved towards an operation against the ship. Two said armed US personnel were preparing to board the vessel, while two others said military aircraft had already taken off. The operation was halted shortly before it was due to begin after officials subjected the intelligence to further scrutiny and discovered that an AI system had been used in producing the assessment. AI chatbot produced false conclusion According to CNN, an analyst with the US Special Operations Command used a chatbot to examine intelligence relating to the ship’s manifest. The original intelligence had been provided by US Special Operations Command Pacific, based in Hawaii. The chatbot reportedly combined publicly available information with classified signals intelligence accessible to the US government and incorrectly concluded that the vessel was carrying material connected to a nuclear weapons programme. The analyst subsequently used AI again to turn the findings into a standard intelligence report, which was then distributed through military channels, CNN reported. It remains unclear what the ship was actually carrying. CNN said it could not determine the nature of the cargo or whether it posed any threat. The report did not identify the AI system used. One source described the intelligence as “entirely false” and said the incident had come close to triggering a war because of the potential consequences of a US military operation against a Chinese vessel. It was also unclear whether the chatbot was a commercial product or a system developed specifically for the US government. The incident highlights the risks of relying on AI-generated assessments in military operations, particularly during an active conflict, when inaccurate intelligence can have immediate and potentially serious consequences.