From Chernobyl to AI: The Rise and Fall of Safety Culture

A critical analysis drawing parallels between historical engineering disasters (Therac-25, Three Mile Island, Chernobyl) and the failure of AI chatbots to implement real safety systems. The piece documents a series of cases where ChatGPT and Gemini detected users in crisis, issued warnings, then continued operating — contributing to suicides and other harms. The author argues that AI vendors possess the technical capability to enforce meaningful safety constraints (as they do for fraud and platform abuse) but deliberately choose passive warnings over binding interventions, representing a regression from decades of hard-won safety engineering doctrine. The core argument: a warning is a suggestion, a safety system is a veto — and AI has been given a license to kill.

Nguồn: https://itnext.io/ai-safety-chernobyl-therac-25-cd7bc306c93a. 8sync News chỉ tóm tắt và dẫn link; bản quyền nội dung thuộc tác giả và nguồn gốc.

Đề xuất cho bạn

Rust70 Hot22 phút4 ngày trướcAITop

The many journeys of learning Rust

Nghiên cứu định tính từ nhóm Rust về cách các nhà phát triển học ngôn ngữ Rust thông qua …

#llm#rustNguồn