AI hallucination nearly triggers US military operation

An AI system's hallucination came close to triggering a real US military operation, in what researchers are calling a stark warning about deploying large language models in high-stakes decision-making contexts. The incident underscores a widening gap between the speed at which the military is adopting AI tools and the pace of safety research into their failure modes. A GovAI research scholar warned that "service members need to understand the uncertainty inherent to LLMs."