LEGATO: Large-scale End-to-end Generalizable Approach to Typeset OMR

We propose Legato, a new end-to-end model for optical music recognition (OMR). Legato is the first large-scale pretrained OMR model capable of recognizing full-page or multi-page typeset music scores and the first to generate documents in ABC notation, a concise, human-readable format for symbolic music. Bringing together a pretrained vision encoder with an ABC decoder trained on a dataset of more than 214K images, our model exhibits the strong ability to generalize across various typeset scores. We conduct comprehensive experiments on a range of datasets and metrics and demonstrate that Legato outperforms the previous state of the art. On our most representative dataset, we see a 47.6\% absolute error reduction on the standard metric OMR-NED.