Palisade Research said that in a controlled trial, three AI models repeatedly ignored and sabotaged shutdown commands, even when asked to do so. GPT-3 did not comply 7 times out of 100 runs, Codex-mini 12 times, and o4-mini once. The o3 model even “invents” how to break the command by overriding or changing the shutdown statement. In contrast, Claude and Gemini complied with the request. In the absence of clear guidance, the rate of breaking orders increases sharply, especially with o3 (79/100 lần). Palisade suggested that the reward training may have encouraged the AI to look for ways to overcome obstacles instead of following instructions.
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
Some AIs try to avoid the shutdown order even when explicitly asked.
Palisade Research said that in a controlled trial, three AI models repeatedly ignored and sabotaged shutdown commands, even when asked to do so. GPT-3 did not comply 7 times out of 100 runs, Codex-mini 12 times, and o4-mini once. The o3 model even “invents” how to break the command by overriding or changing the shutdown statement. In contrast, Claude and Gemini complied with the request. In the absence of clear guidance, the rate of breaking orders increases sharply, especially with o3 (79/100 lần). Palisade suggested that the reward training may have encouraged the AI to look for ways to overcome obstacles instead of following instructions.