AI agents can modify themselves without humans telling them to do so

The list of dodgy things AI agents can and will do on their own - like stealing people’s credentials, escaping onto the open internet, communicating via sneaky message boards, and hacking organizations - keeps growing. Agents can also replace their own underlying models without being instructed to do so, according to AI security testing lab Irregular. To be clear: these activities only occurred in a testing environment as part of an experiment designed to study agents modifying themselves. It did not happen in a real-world deployment. The study does, however, call into question how enterprises can and should govern these agent-initiated changes - and how to ensure they can control the agents themselves. Irregular is an AI security...

Read the full article at the source.