allenai / longformer-base-4096

huggingface.co
Total runs: 754.6K
24-hour runs: -20.7K
7-day runs: -97.4K
30-day runs: -269.3K
Model's Last Updated: April 06 2023

Introduction of longformer-base-4096

Model Details of longformer-base-4096

longformer-base-4096

Longformer is a transformer model for long documents.

longformer-base-4096 is a BERT-like model started from the RoBERTa checkpoint and pretrained for MLM on long documents. It supports sequences of length up to 4,096.

Longformer uses a combination of a sliding window (local) attention and global attention. Global attention is user-configured based on the task to allow the model to learn task-specific representations. Please refer to the examples in modeling_longformer.py and the paper for more details on how to set global attention.

Citing

If you use Longformer in your research, please cite Longformer: The Long-Document Transformer .

@article{Beltagy2020Longformer,
  title={Longformer: The Long-Document Transformer},
  author={Iz Beltagy and Matthew E. Peters and Arman Cohan},
  journal={arXiv:2004.05150},
  year={2020},
}

Longformer is an open-source project developed by the Allen Institute for Artificial Intelligence (AI2) . AI2 is a non-profit institute with the mission to contribute to humanity through high-impact AI research and engineering.

Runs of allenai longformer-base-4096 on huggingface.co

754.6K
Total runs
-20.7K
24-hour runs
-59.5K
3-day runs
-97.4K
7-day runs
-269.3K
30-day runs

More Information About longformer-base-4096 huggingface.co Model

More longformer-base-4096 license Visit here:

https://choosealicense.com/licenses/apache-2.0

longformer-base-4096 huggingface.co

longformer-base-4096 huggingface.co is an AI model on huggingface.co that provides longformer-base-4096's model effect (), which can be used instantly with this allenai longformer-base-4096 model. huggingface.co supports a free trial of the longformer-base-4096 model, and also provides paid use of the longformer-base-4096. Support call longformer-base-4096 model through api, including Node.js, Python, http.

longformer-base-4096 huggingface.co Url

https://huggingface.co/allenai/longformer-base-4096

allenai longformer-base-4096 online free

longformer-base-4096 huggingface.co is an online trial and call api platform, which integrates longformer-base-4096's modeling effects, including api services, and provides a free online trial of longformer-base-4096, you can try longformer-base-4096 online for free by clicking the link below.

allenai longformer-base-4096 online free url in huggingface.co:

https://huggingface.co/allenai/longformer-base-4096

longformer-base-4096 install

longformer-base-4096 is an open source model from GitHub that offers a free installation service, and any user can find longformer-base-4096 on GitHub to install. At the same time, huggingface.co provides the effect of longformer-base-4096 install, users can directly use longformer-base-4096 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

longformer-base-4096 install url in huggingface.co:

https://huggingface.co/allenai/longformer-base-4096

Url of longformer-base-4096

longformer-base-4096 huggingface.co Url

Provider of longformer-base-4096 huggingface.co

allenai
ORGANIZATIONS

Other API from allenai

huggingface.co

Total runs: 970.7K
Run Growth: -86.4K
Growth Rate: -8.84%
Updated:December 04 2024
huggingface.co

Total runs: 361.0K
Run Growth: -430.6K
Growth Rate: -119.28%
Updated:May 29 2025
huggingface.co

Total runs: 143.5K
Run Growth: -8.2K
Growth Rate: -5.71%
Updated:July 28 2025
huggingface.co

Total runs: 136.2K
Run Growth: -2.6K
Growth Rate: -1.93%
Updated:January 23 2026
huggingface.co

Total runs: 100.0K
Run Growth: 37.8K
Growth Rate: 37.79%
Updated:January 23 2026
huggingface.co

Total runs: 49.7K
Run Growth: -43.7K
Growth Rate: -87.44%
Updated:January 23 2026
huggingface.co

Total runs: 38.2K
Run Growth: 10.4K
Growth Rate: 27.18%
Updated:August 15 2024
huggingface.co

Total runs: 23.6K
Run Growth: -3.3K
Growth Rate: -127.96%
Updated:May 21 2026
huggingface.co

Total runs: 20.2K
Run Growth: 8.8K
Growth Rate: 43.21%
Updated:May 23 2026
huggingface.co

Total runs: 15.7K
Run Growth: -6.5K
Growth Rate: -42.39%
Updated:October 18 2023
huggingface.co

Total runs: 8.2K
Run Growth: -788
Growth Rate: -20.07%
Updated:March 19 2026
huggingface.co

Total runs: 7.2K
Run Growth: 1.3K
Growth Rate: 18.08%
Updated:April 11 2026
huggingface.co

Total runs: 4.4K
Run Growth: -1.2K
Growth Rate: -27.97%
Updated:July 17 2024
huggingface.co

Total runs: 3.9K
Run Growth: -1.2K
Growth Rate: -31.02%
Updated:December 04 2024
huggingface.co

Total runs: 3.9K
Run Growth: -341
Growth Rate: -8.79%
Updated:June 23 2026
huggingface.co

Total runs: 3.7K
Run Growth: -1.3K
Growth Rate: -36.05%
Updated:June 23 2026
huggingface.co

Total runs: 3.0K
Run Growth: 3.0K
Growth Rate: 100.00%
Updated:June 23 2026
huggingface.co

Total runs: 2.0K
Run Growth: -2.4K
Growth Rate: -119.11%
Updated:October 09 2025
huggingface.co

Total runs: 1.9K
Run Growth: -248
Growth Rate: -12.99%
Updated:July 17 2024
huggingface.co

Total runs: 1.9K
Run Growth: 663
Growth Rate: 38.48%
Updated:January 25 2023
huggingface.co

Total runs: 1.9K
Run Growth: 1.6K
Growth Rate: 90.46%
Updated:October 04 2026
huggingface.co

Total runs: 1.8K
Run Growth: 1.1K
Growth Rate: 61.29%
Updated:October 07 2026
huggingface.co

Total runs: 1.7K
Run Growth: -390
Growth Rate: -22.47%
Updated:April 11 2026
huggingface.co

Total runs: 1.5K
Run Growth: -2.2K
Growth Rate: -144.05%
Updated:October 10 2025