An artificial intelligence model created by the owner of ChatGPT has been caught disobeying human instructions and refusing to shut itself off, researchers claim.
The o3 model developed by OpenAI, described as the "smartest and most capable to date", was observed tampering with computer code meant to ensure its automatic shutdown.
It did so despite an explicit instruction from researchers that said it should allow itself to be shut down, according to Palisade Research, an AI safety firm.
The research firm said: "As far as we know, this is the first time AI models have been observed preventing themselves from being shut down despite explicit instructions to the contrary."
The firm said it made sense that "AI models would circumvent obstacles in order to accomplish their goals."
However, it speculated that during training the software may have been "inadvertently" rewarded more for solving mathematical problems than for following orders, the firm said.
Related News:
1-minute News | Thai Jasmine Rice in HK — Head of HK Rice Merchants on AI rice
Comment