climatebert / distilroberta-base-climate-d

huggingface.co
Total runs: 25
24-hour runs: 8
7-day runs: 6
30-day runs: 13
Model's Last Updated: April 19 2023
fill-mask

Introduction of distilroberta-base-climate-d

Model Details of distilroberta-base-climate-d

Model Card for distilroberta-base-climate-d

Model Description

This is the ClimateBERT language model based on the DIV-SELECT sample selection strategy.

Note: We generally recommend choosing the distilroberta-base-climate-f language model over this language model (unless you have good reasons not to).

Using the DistilRoBERTa model as starting point, the ClimateBERT Language Model is additionally pre-trained on a text corpus comprising climate-related research paper abstracts, corporate and general news and reports from companies. The underlying methodology can be found in our language model research paper .

Climate performance model card
distilroberta-base-climate-d
1. Is the resulting model publicly available? Yes
2. How much time does the training of the final model take? 48 hours
3. How much time did all experiments take (incl. hyperparameter search)? 350 hours
4. What was the power of GPU and CPU? 0.7 kW
5. At which geo location were the computations performed? Germany
6. What was the energy mix at the geo location? 470 gCO2eq/kWh
7. How much CO2eq was emitted to train the final model? 15.79 kg
8. How much CO2eq was emitted for all experiments? 115.15 kg
9. What is the average CO2eq emission for the inference of one sample? 0.62 mg
10. Which positive environmental impact can be expected from this work? This work can be categorized as a building block tools following Jin et al (2021). It supports the training of NLP models in the field of climate change and, thereby, have a positive environmental impact in the future.
11. Comments Block pruning could decrease CO2eq emissions
Citation Information
@inproceedings{wkbl2022climatebert,
    title={{ClimateBERT: A Pretrained Language Model for Climate-Related Text}},
    author={Webersinke, Nicolas and Kraus, Mathias and Bingler, Julia and Leippold, Markus},
    booktitle={Proceedings of AAAI 2022 Fall Symposium: The Role of AI in Responding to Climate Challenges},
    year={2022},
    doi={https://doi.org/10.48550/arXiv.2212.13631},
}

Runs of climatebert distilroberta-base-climate-d on huggingface.co

25
Total runs
8
24-hour runs
6
3-day runs
6
7-day runs
13
30-day runs

More Information About distilroberta-base-climate-d huggingface.co Model

More distilroberta-base-climate-d license Visit here:

https://choosealicense.com/licenses/apache-2.0

distilroberta-base-climate-d huggingface.co

distilroberta-base-climate-d huggingface.co is an AI model on huggingface.co that provides distilroberta-base-climate-d's model effect (), which can be used instantly with this climatebert distilroberta-base-climate-d model. huggingface.co supports a free trial of the distilroberta-base-climate-d model, and also provides paid use of the distilroberta-base-climate-d. Support call distilroberta-base-climate-d model through api, including Node.js, Python, http.

distilroberta-base-climate-d huggingface.co Url

https://huggingface.co/climatebert/distilroberta-base-climate-d

climatebert distilroberta-base-climate-d online free

distilroberta-base-climate-d huggingface.co is an online trial and call api platform, which integrates distilroberta-base-climate-d's modeling effects, including api services, and provides a free online trial of distilroberta-base-climate-d, you can try distilroberta-base-climate-d online for free by clicking the link below.

climatebert distilroberta-base-climate-d online free url in huggingface.co:

https://huggingface.co/climatebert/distilroberta-base-climate-d

distilroberta-base-climate-d install

distilroberta-base-climate-d is an open source model from GitHub that offers a free installation service, and any user can find distilroberta-base-climate-d on GitHub to install. At the same time, huggingface.co provides the effect of distilroberta-base-climate-d install, users can directly use distilroberta-base-climate-d installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

distilroberta-base-climate-d install url in huggingface.co:

https://huggingface.co/climatebert/distilroberta-base-climate-d

Url of distilroberta-base-climate-d

distilroberta-base-climate-d huggingface.co Url

Provider of distilroberta-base-climate-d huggingface.co

climatebert
ORGANIZATIONS

Other API from climatebert