PoseBusters: AI-based docking methods fail to generate physically valid poses or generalise to novel sequences
By M. Buttenschoen, Garrett M. Morris, Charlotte M. Deane. 2023
343 citations recorded by the source corpus.
The last few years have seen the development of numerous deep learning-based protein–ligand docking methods. They offer huge promise in terms of speed and accuracy. However, despite claims of state-of-the-art performance in terms of crystallographic root-mean-square deviation (RMSD), upon closer inspection, it has become apparent that they often produce physically implausible molecular structures. It is therefore not sufficient to evaluate these methods solely by RMSD to a native binding mode. It is vital, particularly for deep learning-based methods, that they are also evaluated on steric and energetic criteria. We present PoseBusters, a Python package that performs a series of standard quality checks using the well-established cheminformatics toolkit RDKit. The PoseBusters test suite validates chemical and geometric consistency of a ligand including its stereochemistry, and the physical plausibility of intra- and intermolecular measurements such as the planarity of aromatic rings, standard bond lengths, and protein–ligand clashes. Only methods that both pass these checks and predict native-like binding modes should be classed as having “state-of-the-art” performance. We use PoseBusters to compare five deep learning-based docking methods (DeepDock, DiffDock, EquiBind, TankBind, and Uni-Mol) and two well-established standard docking methods (AutoDock Vina and CCDC Gold) with and without an additional post-prediction energy minimisation step using a molecular mechanics force field. We show that both in terms of physical plausibility and the ability to generalise to examples that are distinct from the training data, no deep learning-based method yet outperforms classical docking tools. In addition, we find that molecular mechanics force fields contain docking-relevant physics missing from deep-learning methods. PoseBusters allows practitioners to assess docking and molecular generation methods and may inspire new inductive biases still required to improve deep learning-based methods, which will help drive the development of more accurate and more realistic predictions.
Subfields: Computational Theory and Mathematics, Materials Chemistry, Molecular Biology, Computational Chemistry & Drug Discovery
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Computational Theory and Mathematics
- Pushmeet Kohli
- Alexander Pritzel
- Frank DiMaio
- Ivan V. Anishchenko
- Minkyung Baek
- Michael Figurnov
- Sergey Levine
- Pieter Abbeel
In Materials Chemistry
- Minkyung Baek
- Ivan V. Anishchenko
- Pushmeet Kohli
- A. Kang
- Frank DiMaio
- David Baker
- Sergey Ovchinnikov
- Hahnbeom Park
In Molecular Biology
- Minkyung Baek
- Ivan V. Anishchenko
- Frank DiMaio
- Pushmeet Kohli
- Alexander Pritzel
- A. Kang
- Jue Wang
- Ryan McHugh
In Computational Chemistry & Drug Discovery
Citations in the corpus
- Accurate structure prediction of biomolecular interactions with AlphaFold 3 (2024, methodology): “A wide range of predictors for various specific interaction types has been developed 16–28 , as well as one generalist method developed concurrently with the present work 29 , but the accuracy of such deep-learning attempts has been mixed and often below that of physics-inspired methods 30,31 .”
- Generalized Biomolecular Modeling and Design with RoseTTAFold All-Atom (2023, methodology): “We compared RFAA to other deep learning based docking tools when they are provided with more privileged information on a set of recent PDBs curated in (30) (the test structures are outside of the training sets of all the methods; the other methods were not enrolled in CAMEO, so we could not carry ou”
- Boltz-1 Democratizing Biomolecular Interaction Modeling (2024, unknown): “Moreover, like previous machine learning-based structure prediction methods [Buttenschoen et al., 2024], we observe some non-physical structures predicted by the model.”