Flamenco43 / NanoBERT-V1

huggingface.co
Total runs: 21
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: November 20 2024

Introduction of NanoBERT-V1

Model Details of NanoBERT-V1

NanoBERT-V1

This model is further pre-trained from google-bert/bert-base-uncased using a corpus consisting of 200,000 Nanoscience and Nanotechnology papers.

For practical applications, please use https://huggingface.co/Flamenco43/NanoBERT-V2

Intended uses & limitations

Intended for training on downstream tasks using Nanoscience datasets. Can be used directly to create dense vector representations for information retrieval.

Training and evaluation data

Trained using 2 nodes on Polaris: https://docs.alcf.anl.gov/polaris/hardware-overview/machine-overview/

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 32
  • eval_batch_size: 32
  • seed: 42
  • distributed_type: multi-GPU
  • num_devices: 8
  • total_train_batch_size: 256
  • total_eval_batch_size: 256
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • training_steps: 1000000
Framework versions
  • Transformers 4.41.2
  • Pytorch 2.3.0
  • Datasets 2.20.0
  • Tokenizers 0.19.1

Runs of Flamenco43 NanoBERT-V1 on huggingface.co

21
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About NanoBERT-V1 huggingface.co Model

More NanoBERT-V1 license Visit here:

https://choosealicense.com/licenses/apache-2.0

NanoBERT-V1 huggingface.co

NanoBERT-V1 huggingface.co is an AI model on huggingface.co that provides NanoBERT-V1's model effect (), which can be used instantly with this Flamenco43 NanoBERT-V1 model. huggingface.co supports a free trial of the NanoBERT-V1 model, and also provides paid use of the NanoBERT-V1. Support call NanoBERT-V1 model through api, including Node.js, Python, http.

Flamenco43 NanoBERT-V1 online free

NanoBERT-V1 huggingface.co is an online trial and call api platform, which integrates NanoBERT-V1's modeling effects, including api services, and provides a free online trial of NanoBERT-V1, you can try NanoBERT-V1 online for free by clicking the link below.

Flamenco43 NanoBERT-V1 online free url in huggingface.co:

https://huggingface.co/Flamenco43/NanoBERT-V1

NanoBERT-V1 install

NanoBERT-V1 is an open source model from GitHub that offers a free installation service, and any user can find NanoBERT-V1 on GitHub to install. At the same time, huggingface.co provides the effect of NanoBERT-V1 install, users can directly use NanoBERT-V1 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

NanoBERT-V1 install url in huggingface.co:

https://huggingface.co/Flamenco43/NanoBERT-V1

Url of NanoBERT-V1

Provider of NanoBERT-V1 huggingface.co

Flamenco43
ORGANIZATIONS

Other API from Flamenco43

huggingface.co

Total runs: 101
Run Growth: 0
Growth Rate: 0.00%
Updated:September 10 2024
huggingface.co

Total runs: 24
Run Growth: 0
Growth Rate: 0.00%
Updated:September 12 2024
huggingface.co

Total runs: 7
Run Growth: 0
Growth Rate: 0.00%
Updated:September 11 2024
huggingface.co

Total runs: 6
Run Growth: 0
Growth Rate: 0.00%
Updated:June 27 2024
huggingface.co

Total runs: 3
Run Growth: 0
Growth Rate: 0.00%
Updated:June 27 2024
huggingface.co

Total runs: 2
Run Growth: 0
Growth Rate: 0.00%
Updated:June 26 2024
huggingface.co

Total runs: 1
Run Growth: 0
Growth Rate: 0.00%
Updated:May 06 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:June 08 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:June 26 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:July 31 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:June 07 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:June 08 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:June 13 2024