ncfrey/ChemGPT-1.2B
# ChemGPT 1.2B ChemGPT is based on the GPT-Neo model and was introduced in the paper Neural Scaling of Deep Chemical Models.
README
tags: chemistry ChemGPT 1.2B ChemGPT is based on the GPT-Neo model and was introduced in the paper Neural Scaling of Deep Chemical Models. Model description ChemGPT is a transformers model for generative molecular modeling, which was pretrained on the PubChem10M dataset. Intended uses & limitations How to use You can use this model directly from the 🤗/transformers library. Limitations and bias This model was trained on a subset of molecules from PubChem. You can use this model to generate…
- HuggingFace
- https://huggingface.co/ncfrey/ChemGPT-1.2B
Source attribution
- HuggingFace — ncfrey/ChemGPT-1.2B
Related resources
# ChemGPT 19M ChemGPT is based on the GPT-Neo model and was introduced in the paper Neural Scaling of Deep Chemical Models.
# ChemGPT 4.7M ChemGPT is based on the GPT-Neo model and was introduced in the paper Neural Scaling of Deep Chemical Models.
Deep learning for chemistry and materials science remains a novel field with lots of potiential. However, the popularity of transfer learning based methods in areas such as NLP and computer vision have not yet been effectively developed in computational chemistry + machine learning.
zhihan1996/DNA_bert_3
by zhihan1996Dr-BERT/DrBERT-7GB
by Dr-BERTIn recent years, pre-trained language models (PLMs) achieve the best performance on a wide range of natural language processing (NLP) tasks. While the first models were trained on general domain data, specialized ones have emerged to more effectively treat specific domains.
ChemFIE-SA is a BERT-like sequence classifier for predicting synthesis accessibility given a SELFIES string of a compound, fine-tuned from gbyuvd/chemselfies-base-bertmlm on DeepSA's expanded dataset from Wang et al. 2023.