Read the paper ◆ NeurIPS 2026 Oral
We’re excited to share Bonbon, a vertical foundation model for biology with emergent biological capabilities. AI models have learned to write, code, and reason, developing abilities beyond what they were explicitly trained to do. Emergent abilities have appeared in models trained on individual types of biological data, such as protein or DNA sequences. But to our knowledge, no previous multimodal model for biology has demonstrated these emergent capabilities in molecular interactions, learning biological properties beyond its explicit training objective without task-specific supervision.
But biology works through interactions. What a molecule does depends on what it interacts with, and those relationships determine biological outcomes. Yet AI for molecular interactions remains fragmented into narrow, task-specific models, often trained with explicit labels and focused on the geometry of how molecules fit together.
Biology is a complex system. How a cell behaves comes from many relationships operating together, most of them still unknown to us. Understanding that system requires understanding what interactions do and how they influence one another, beyond whether two molecules bind or geometrically fit. We built Bonbon to learn these hidden relationships, so we could expand what is possible to understand and design.
Models for molecular interactions have not yet demonstrated this kind of emergence beyond their training objective. Co-folding models learn to predict three-dimensional structures, but adding a capability such as affinity prediction requires additional supervised training on affinity measurements. The new capability is explicitly taught rather than emerging from the original training.
Our hypothesis was that the relationships governing molecular biology are encoded in the sequences of interacting molecules, and that with the right architecture, data, and training, they could be revealed. As we scaled Bonbon, we saw capabilities emerging across the hierarchy of biology. Bonbon independently learned to answer biological questions without structural coordinates, physics-based calculations, or task-specific supervision.
Training for the relationships in biology
Training a model for multimodal biology brings different challenges from those encountered in language and vision. An image contains dense information about objects, their positions, textures, and lighting. A biological interaction example carries a much sparser signal, and not every example contains information relevant to every biological property. The patterns that distinguish activation from inhibition, or covalent from non-covalent engagement, become visible only across many combinations.
Molecular relationships are also many-to-many. One protein can interact with many molecules, and one molecule can interact with many proteins. The model needs to learn how the relationship changes with each combination.
We designed Bonbon’s architecture and training objective for these relationships and trained it on approximately 3.2 trillion tokens of molecular sequences. The dataset spans proteins, small molecules, peptides, and protein–protein interactions. We did not provide structural coordinates, affinity measurements, or physics-based calculations during pretraining, or labels for the emergent capabilities described below.
To account for the sparsity of biological data, we used an unusually large amount of training data relative to model size: approximately 2,000 tokens per parameter. We then scaled Bonbon across six model sizes, from 42 million to 1.6 billion parameters, to examine what it learned.