Claire Monteleoni
What Abundance Hides: Lessons from Building AI Under Constraint
Modern Artificial intelligence has progressed under extraordinary abundance: substantial capital, energy and compute, massive model architectures and datasets. These conditions have shaped the systems we have built but have also defined how we measure success. Impressive models that are meant to generalise fail in low resource environments, so what is there to do about it?
At Lelapa AI, we develop speech recognition technology for multilingual environments where people routinely mix languages within a single conversation, training data is scarce and compute is constrained. This work exposes two important questions: how well do conventional metrics such as word error rate reflect human judgements of transcription quality? And when can smaller, more efficient models, trained on the right data, outperform larger general-purpose systems on real-world tasks?
These questions challenge assumptions about both how we evaluate AI and what it takes to build capable systems. Constraints are not simply obstacles to overcome; they can reveal weaknesses in established methods and open new directions for model development. As AI cannot establish on its own what counts as good. As capabilities and access to compute continue to evolve, the lessons from building under constraint remain valuable: they help us distinguish genuine progress from progress measured by imperfect proxies, and identify what it will truly take to scale.
| NeurIPS uses cookies for essential functions only. We do not sell your personal information. Our Privacy Policy » |