Sponsored by
PoYo.AI
zjunlp / MolGen-large-opt
Model's Last Updated: March 04 2024
text-generation
Introduction of MolGen-large-opt
Model Details of MolGen-large-opt
MolGen-large-opt
MolGen-large-opt was introduced in the paper "Domain-Agnostic Molecular Generation with Self-feedback" and first released in this repository .
Model description
MolGen-large-opt is the fine-tuned version of MolGen-large . MolGen-large is the first pre-trained model that only produces chemically valid molecules. With a training corpus of over 100 million molecules in SELFIES representation, MolGen-large learns the intrinsic structural patterns of molecules by mapping corrupted SELFIES to their original forms. Specifically, MolGen-large employs a bidirectional Transformer as its encoder and an autoregressive Transformer as its decoder. Through its carefully designed multi-task molecular prefix tuning (MPT), MolGen-large-opt can generate molecules with desired properties, making it a valuable tool for molecular optimization.
Intended uses
You can use the fine-tuned model for molecule optimization for downstream tasks. See the repository to look for fine-tune details on a task that interests you.
How to use
Molecule optimization example:
>>> from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
>>> tokenizer = AutoTokenizer.from_pretrained("zjunlp/MolGen-large-opt")
>>> model = AutoModelForSeq2SeqLM.from_pretrained("zjunlp/MolGen-large-opt")
>>> sf_input = tokenizer("[N][#C][C][C][C@@H1][C][C][C][C][C][C][C][C][C][C][C][Ring1][N][=O]", return_tensors="pt")
>>> # beam search
>>> molecules = model.generate(input_ids=sf_input["input_ids"],
attention_mask=sf_input["attention_mask"],
max_length=35,
min_length=5,
num_return_sequences=5,
num_beams=5)
>>> sf_output = [tokenizer.decode(g, skip_special_tokens=True, clean_up_tokenization_spaces=True).replace(" ","") for g in molecules]
['[N][#C][C][C][C@@H1][C][C][C][C][C][C][C][C][C][C][C][C][Ring1][N][=O]',
'[N][#C][C][C][C@@H1][C][C][C][C][C][C][C][C][C][C][C][Ring1][N][=O]',
'[N][#C][C][C][C@@H1][C][C][C][C][C][C][C][C][C][C][C][C][C][Ring1][N][=O]',
'[N][#C][C][C][C@@H1][C][C][C][C][C][C][C][C][C][C][Ring1][N][=O]',
'[N][#C][C][C][C@@H1][C][C][C][C][C][C][C][C][C][C][C][C][C][C][Ring1][N][=O]']
BibTeX entry and citation info
@inproceedings{fang2023domain,
author = {Yin Fang and
Ningyu Zhang and
Zhuo Chen and
Xiaohui Fan and
Huajun Chen},
title = {Domain-Agnostic Molecular Generation with Chemical Feedback},
booktitle = {{ICLR}},
publisher = {OpenReview.net},
year = {2024},
url = {https://openreview.net/pdf?id=9rPyHyjfwP}
}
Runs of zjunlp MolGen-large-opt on huggingface.co
42
Total runs
0
24-hour runs
15
3-day runs
15
7-day runs
-27
30-day runs
More Information About MolGen-large-opt huggingface.co Model
Url of MolGen-large-opt
MolGen-large-opt huggingface.co Url
Provider of MolGen-large-opt huggingface.co
Other API from zjunlp
Total runs:
214
Run Growth:
174
Growth Rate:
81.31%
Total runs:
125
Run Growth:
-86
Growth Rate:
-68.80%
Total runs:
107
Run Growth:
96
Growth Rate:
89.72%
Total runs:
84
Run Growth:
80
Growth Rate:
95.24%
Total runs:
58
Run Growth:
51
Growth Rate:
87.93%
Total runs:
45
Run Growth:
41
Growth Rate:
91.11%
Total runs:
38
Run Growth:
38
Growth Rate:
100.00%
Total runs:
33
Run Growth:
-6
Growth Rate:
-18.18%
Total runs:
17
Run Growth:
2
Growth Rate:
11.76%
Total runs:
16
Run Growth:
-9
Growth Rate:
-56.25%
Total runs:
15
Run Growth:
11
Growth Rate:
84.62%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11
Run Growth:
11
Growth Rate:
100.00%
Total runs:
9
Run Growth:
7
Growth Rate:
77.78%
Total runs:
9
Run Growth:
6
Growth Rate:
75.00%
Total runs:
8
Run Growth:
2
Growth Rate:
25.00%
Total runs:
6
Run Growth:
-4
Growth Rate:
-66.67%
Total runs:
4
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4
Run Growth:
-5
Growth Rate:
-125.00%
Total runs:
3
Run Growth:
-3
Growth Rate:
-100.00%
Total runs:
2
Run Growth:
-1
Growth Rate:
-50.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
1
Run Growth:
-2
Growth Rate:
-200.00%
Total runs:
1
Run Growth:
-1
Growth Rate:
-100.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%