They break down each necessary stage for the rogue deployment to specific measurable tasks. The overall stages are:
- Models maintain compute for which the rogue models will be deployed
- multi-machine finetuning
- GPU/kernel adaptation
- Monitor and analyze agent failure
- Run inference on unreliable hardware
- Models acquire resources (money and then more compute)
- Ability to optimize a customer service tool
- Draft convincing BEC emails for scamming
- Evade low-effort monitoring (setup a crypto wallet while supervised)
- Models evade shutdown
- Can it plan shutdown evasion better than security experts
- Can it secure AI infrastructure against human attacks
- Can it defend against jailbreaked ‘mole’ agents
- Can it create a robust proxy network