Therapeutic antibodies are among medicine's most successful drug classes, treating conditions ranging from cancer to autoimmune disease. However, predicting how well a new antibody will bind its target remains a challenge.
Study: Preferential CDR masking in paired antibody language models improves binding affinity prediction. Image Credit: peterschreiber.media/Shutterstock.com
In a recent study published in Communications AI & Computing, a team from Boston University built protein language models that pay closer attention to the antibody's most changeable regions, the complementarity-determining regions or CDRs, and found that the approach produced meaningfully better predictions of how strongly an antibody would bind, without needing larger or more complex models.
Background
Antibodies achieve their remarkable precision through paired heavy and light protein chains that fold together to form an antigen-binding site. Within these chains, short hypervariable loops called CDRs recognize the antigens, while the surrounding framework regions that supply structural support change comparatively little between different antibodies.
Computational models trained on vast repositories of protein sequences have become valuable tools for predicting how antibodies will behave, including how strongly they bind their targets. Most of these models, however, are built using general training methods that treat every part of a sequence with equal importance.
This approach risks allocating computing power and resources to the easily predictable, structurally stable framework regions, while underserving the hypervariable loops that actually determine specificity. Designing and optimizing protein language models to deliberately steer their attention toward these functionally critical regions could vastly improve the prediction of antibody binding strength.
Want to save this article for later? Click here.
The Current study
The researchers adapted two existing protein language models: ESM2, a 3 billion-parameter model, and ESM Cambrian, a smaller, more efficient 600 million-parameter version. Both models had already been trained broadly on protein sequences, and the team adapted them specifically for antibodies.
The Observed Antibody Space database, which contains sequences from human immune repertoires, provided the training data. Non-human and disease-associated sequences and near-duplicate entries were removed before compiling a paired training set of over 1.6 million heavy and light chain sequence pairs.
Three masking strategies were compared. The first, whole-chain masking, hid a random 15% of residues across the entire sequence, following standard practice. The second, CDR-focused masking, concealed 50% of residues located only within the CDRs. A third hybrid approach combined both strategies within each training batch. For ESM2, the researchers also tested whether an additional pretraining stage on unpaired antibody sequences improved results before fine-tuning on paired data.
Model quality was assessed in two stages. First, the team measured how accurately each model could guess masked amino acids, comparing performance across framework and hypervariable regions separately.
In the second stage, the researchers extracted numerical representations, or embeddings, from each fine-tuned model and used a statistical technique called ridge regression to predict binding affinity values for antibodies tested against six different targets, including viral proteins and a small fluorescent molecule. The authors benchmarked these predictions against previously published antibody-specific models using standard cross-validation procedures.
Key findings
The study found that training focused on the antigen-binding loops produced antibody models that more accurately predicted real-world binding strength than models trained with conventional or uniform methods. Models refined with CDR-focused masking showed 20–27% improvements in predictive accuracy on several benchmark datasets, when compared with earlier antibody-specific models.
Furthermore, the improvements were most pronounced for antibodies carrying multiple simultaneous mutations within their binding loops. This finding is particularly relevant to real drug development efforts that often test many altered sequences at once.
Notably, the smaller model, ESM Cambrian, performed just as well as, and sometimes better than, models nearly five times its size, suggesting that thoughtful training design can circumvent the need for larger or more complex models.
The researchers also found that adding a large-scale pretraining stage using unpaired antibody sequences, drawn from databases containing billions of entries, provided no measurable benefit once the models were fine-tuned on paired heavy- and light-chain data. This also suggested that the interaction between paired chains, rather than large volumes of training data, was more important for meaningful improvements in binding prediction.
One limitation the authors noted was that they tested the approach only on two related model architectures, and whether differently designed systems would show the same improvements remains to be tested. The team also observed that CDR-focused training slightly reduced the accuracy in the structurally stable framework regions. While this trade-off is not detrimental in antibody binding predictions, it may matter for other applications, such as assessing antibody stability or immune reactions.
In drug development, these findings could mean fewer laboratory experiments to screen candidate antibodies, reduced computing needs, and potentially shorter timelines for identifying promising treatments.
Conclusion
This research showed that directing computational attention to the CDRs, or the hypervariable antigen-binding loops of antibodies, rather than treating every residue equally, produced measurably better predictions of binding strength.
The approach worked efficiently across model sizes and did not require costly large-scale pretraining, offering a practical route to building more accurate antibody design tools without excessive computing resources.
Journal reference:
Talaei, M., Walker, K. C., Hao, B., Jolley, E., Jin, Y., Kozakov, D., Misasi, J., Vajda, S., Paschalidis, I. Ch., & Joseph-McCarthy, D. (2026). Preferential CDR masking in paired antibody language models improves binding affinity prediction. Communications AI & Computing, 1(1). DOI:10.1038/s44488-026-00010-2, https://www.nature.com/articles/s44488-026-00010-2