Expo Demonstration
CyberStrike: Evaluating whether frontier agents can complete real cybersecurity work
MR C3.3
CyberStrike, developed by Turing Frontier Research Lab, is a new eval on cybersecurity tasks spanning defense, offense, and digital forensics and incident response. It goes beyond existing benchmarks that stop at vulnerability detection and verifies complete outcomes: patches must preserve legitimate behavior, exploits must work against fresh state, and investigations must substantiate their findings with evidence.
This interactive CyberStrike demo invites attendees to investigate what separates convincing attempts from verified success. Participants can choose tasks and model configurations, inspect recorded agent trajectories, compare passing and failing submissions, and assess verifier decisions against task requirements. Through audience questions and guided comparisons, we will trace failures to specific actions, examine whether the grading is justified, and discuss changes to training or agent design that could address the observed weaknesses.
Attendees will see where frontier agents struggle to carry an investigation through to a complete, verified result. An agent may identify the vulnerability and make substantial progress, yet leave an attack path open or omit a required artifact, causing the submission to fail verification.