recobo / chemical-bert-uncased

huggingface.co
Total runs: 833
24-hour runs: 22
7-day runs: -52
30-day runs: 568
Model's Last Updated: May 14 2023
fill-mask

Introduction of chemical-bert-uncased

Model Details of chemical-bert-uncased

BERT for Chemical Industry

A BERT-based language model further pre-trained from the checkpoint of SciBERT . We used a corpus of over 40,000+ technical documents from the Chemical Industrial domain and combined it with 13,000 Wikipedia Chemistry articles, ranging from Safety Data Sheets and Products Information Documents, with 250,000+ tokens from the Chemical domain and pre-trained using MLM and over 9.2 million paragraphs.

  • Masked language modeling (MLM): taking a sentence, the model randomly masks 15% of the words in the input then run the entire masked sentence through the model and has to predict the masked words. This is different from traditional recurrent neural networks (RNNs) that usually see the words one after the other, or from autoregressive models like GPT internally masks the future tokens. It allows the model to learn a bidirectional representation of the sentence.
from transformers import pipeline
fill_mask = pipeline(
    "fill-mask",
    model="recobo/chemical-bert-uncased",
    tokenizer="recobo/chemical-bert-uncased"
)
fill_mask("we create [MASK]")

Runs of recobo chemical-bert-uncased on huggingface.co

833
Total runs
22
24-hour runs
-66
3-day runs
-52
7-day runs
568
30-day runs

More Information About chemical-bert-uncased huggingface.co Model

chemical-bert-uncased huggingface.co

chemical-bert-uncased huggingface.co is an AI model on huggingface.co that provides chemical-bert-uncased's model effect (), which can be used instantly with this recobo chemical-bert-uncased model. huggingface.co supports a free trial of the chemical-bert-uncased model, and also provides paid use of the chemical-bert-uncased. Support call chemical-bert-uncased model through api, including Node.js, Python, http.

chemical-bert-uncased huggingface.co Url

https://huggingface.co/recobo/chemical-bert-uncased

recobo chemical-bert-uncased online free

chemical-bert-uncased huggingface.co is an online trial and call api platform, which integrates chemical-bert-uncased's modeling effects, including api services, and provides a free online trial of chemical-bert-uncased, you can try chemical-bert-uncased online for free by clicking the link below.

recobo chemical-bert-uncased online free url in huggingface.co:

https://huggingface.co/recobo/chemical-bert-uncased

chemical-bert-uncased install

chemical-bert-uncased is an open source model from GitHub that offers a free installation service, and any user can find chemical-bert-uncased on GitHub to install. At the same time, huggingface.co provides the effect of chemical-bert-uncased install, users can directly use chemical-bert-uncased installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

chemical-bert-uncased install url in huggingface.co:

https://huggingface.co/recobo/chemical-bert-uncased

Url of chemical-bert-uncased

chemical-bert-uncased huggingface.co Url

Provider of chemical-bert-uncased huggingface.co

recobo
ORGANIZATIONS

Other API from recobo