TROPT: An Open Framework for Unifying and Advancing Discrete Text Optimization
Abstract
Discrete text-trigger optimization—searching for text sequences that, when ingested by a model, steer it toward a specified objective—underpins model red-teaming (e.g., LLM jailbreaks), as well as auditing and interpretability. However, the current state of discrete optimizers hinders their adoption and progress. First, existing optimizers, when open-sourced at all, are scattered across research codebases tied to specific problem domains. Second, optimizer variants proliferate, each requiring engineering overhead to use or extend, and hard to compare head-to-head. Together, these raise the bar to adopting optimizers in existing or new domains, and to advancing them via new strategies. We address these gaps with TROPT, the first open-source framework that unifies discrete optimizers' execution and standardizes their development under a single interface. TROPT currently ships with 30+ end-to-end optimization recipes—covering applications such as jailbreaking and probing model internals—built from 15+ optimizers (spanning white-box to black-box access) and 15+ losses, from foundational to state-of-the-art methods. Beyond democratizing established methods, TROPT makes it easy to customize optimization recipes by swapping any component—models, objectives, and optimizers—extending its reach across domains and new applications. Demonstrating its utility, we leverage TROPT in several controlled studies: (i) novel large-scale experiments comparing and enhancing optimization strategies for LLM jailbreaks, revealing potent-yet-underadopted techniques; and (ii) cross-domain demonstrations (e.g., benign prompt recovery and corpus poisoning). In all, TROPT significantly lowers the barrier to adopting and advancing discrete text optimization.