Using Rule-Based Labels for Weak Supervised Learning: A ChemNet for Transferable Chemical Property Prediction
By Garrett B. Goh, Charles Siegel, Abhinav Vishnu, Nathan Oken Hodas. 2017
100 citations recorded by the source corpus.
With access to large datasets, deep neural networks (DNN) have achieved human-level accuracy in image and speech recognition tasks. However, in chemistry data is inherently small and fragmented. In this work, we develop an approach of using rule-based knowledge for training ChemNet, a transferable and generalizable deep neural network for chemical property prediction that learns in a weak-supervised manner from large unlabeled chemical databases. When coupled with transfer learning approaches to predict other smaller datasets for chemical properties that it was not originally trained on, we show that ChemNet's accuracy outperforms contemporary DNN models that were trained using conventional supervised learning. Furthermore, we demonstrate that the ChemNet pre-training approach is equally effective on both CNN (Chemception) and RNN (SMILES2vec) models, indicating that this approach is network architecture agnostic and is effective across multiple data modalities. Our results indicate a pre-trained ChemNet that incorporates chemistry domain knowledge and enables the development of generalizable neural networks for more accurate prediction of novel chemical properties.
Subfields: Computational Chemistry & Drug Discovery
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Computational Chemistry & Drug Discovery
Citations in the corpus
- GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoders (2018, methodology): “Our autoencoder might also be used to pre-train graph encoders for fine-tuning on small datasets (Goh et al., 2017).”
- Learning from Rules Generalizing Labeled Exemplars (2020, background): “However, clean task-specific instance labels continue to be critical for reliable results (Goh et al., 2018; Bach et al., 2019) in spite of easy availability of pre-trained models (Sun et al.”
- SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discovery (2019, methodology): “Second, ST will be even stronger when trained in a multi-task fashion as done in ChemNet (Goh et al. 2018): predicting automatically-calculated molecular descriptors (e.g., molecular weight, LogP) as well as decoding the input SMILES.”