AI hallucination nearly triggers US operation

A single AI-generated intelligence report nearly triggered an armed U.S. operation against a Chinese vessel after a chatbot falsely identified its cargo as nuclear-weapons components. CNN’s account says officials halted the planned interception only after deeper review; the Pentagon strategy it cites aims to put AI in the hands of 3 million civilian and military personnel, while TechCrunch’s report says the output was turned into an official-looking report. For builders, high-consequence agent workflows need provenance, independent verification, and hard no-go gates before an output can authorize action—a governance lesson echoed by AISI’s agent-evaluation work.