facebook / blt-entropy

huggingface.co
Total runs: 484
24-hour runs: -85
7-day runs: -585
30-day runs: -148
Model's Last Updated: May 01 2025

Introduction of blt-entropy

Model Details of blt-entropy

Byte Latent Transformer (BLT)

This repository contains the entropy model weights for our paper: "Byte Latent Transformer: Patches Scale Better Than Tokens"

Abstract

We introduce the Byte Latent Transformer architecture (BLTs), a new byte-level LLM architecture that for the first time, matches tokenization-based LLM performance at scale, with significant improvements in inference efficiency and robustness. BLT encodes bytes into dynamically sized patches, which serve as the primary units of computation. Patches are segmented dynamically based on the entropy of the next byte, allocating more compute and model capacity where there is more data complexity. The BLT architecture includes new attention mechanisms to maximize the information flow between byte and patch hidden representations and a new type of byte-sequence memory. We present the first scaling study of byte-level models up to 8B parameters and 8T training bytes, showing for the first time that we can train a model end-to-end at scale from bytes with no tokenization or other preprocessing. Scaling trends reveal training and inference efficiency benefits from dynamically selecting very long patches on average, along with qualitative improvements with reasoning and long tail generalization from modeling byte-sequences.

To run the model, see the readme here: https://github.com/facebookresearch/blt

Links

Runs of facebook blt-entropy on huggingface.co

484
Total runs
-85
24-hour runs
-304
3-day runs
-585
7-day runs
-148
30-day runs

More Information About blt-entropy huggingface.co Model

blt-entropy huggingface.co

blt-entropy huggingface.co is an AI model on huggingface.co that provides blt-entropy's model effect (), which can be used instantly with this facebook blt-entropy model. huggingface.co supports a free trial of the blt-entropy model, and also provides paid use of the blt-entropy. Support call blt-entropy model through api, including Node.js, Python, http.

blt-entropy huggingface.co Url

https://huggingface.co/facebook/blt-entropy

facebook blt-entropy online free

blt-entropy huggingface.co is an online trial and call api platform, which integrates blt-entropy's modeling effects, including api services, and provides a free online trial of blt-entropy, you can try blt-entropy online for free by clicking the link below.

facebook blt-entropy online free url in huggingface.co:

https://huggingface.co/facebook/blt-entropy

blt-entropy install

blt-entropy is an open source model from GitHub that offers a free installation service, and any user can find blt-entropy on GitHub to install. At the same time, huggingface.co provides the effect of blt-entropy install, users can directly use blt-entropy installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

blt-entropy install url in huggingface.co:

https://huggingface.co/facebook/blt-entropy

Url of blt-entropy

blt-entropy huggingface.co Url

Provider of blt-entropy huggingface.co

facebook
ORGANIZATIONS

Other API from facebook

huggingface.co

Total runs: 8.2M
Run Growth: 92.0K
Growth Rate: 1.13%
Updated:January 20 2022
huggingface.co

Total runs: 5.8M
Run Growth: -1.6M
Growth Rate: -27.58%
Updated:September 15 2023
huggingface.co

Total runs: 3.1M
Run Growth: -286.0K
Growth Rate: -9.29%
Updated:January 17 2024
huggingface.co

Total runs: 2.8M
Run Growth: -455.3K
Growth Rate: -16.35%
Updated:September 06 2023
huggingface.co

Total runs: 2.1M
Run Growth: -722.2K
Growth Rate: -35.15%
Updated:December 28 2021
huggingface.co

Total runs: 2.0M
Run Growth: 47.2K
Growth Rate: 2.35%
Updated:November 21 2025
huggingface.co

Total runs: 1.5M
Run Growth: -758.6K
Growth Rate: -50.79%
Updated:March 23 2023
huggingface.co

Total runs: 1.1M
Run Growth: -1.1M
Growth Rate: -95.46%
Updated:January 25 2024
huggingface.co

Total runs: 904.4K
Run Growth: 85.1K
Growth Rate: 9.26%
Updated:September 06 2023
huggingface.co

Total runs: 531.7K
Run Growth: 64.1K
Growth Rate: 12.08%
Updated:May 22 2023
huggingface.co

Total runs: 528.0K
Run Growth: 98.0K
Growth Rate: 18.56%
Updated:March 17 2025
huggingface.co

Total runs: 371.9K
Run Growth: 259.2K
Growth Rate: 70.54%
Updated:June 13 2023
huggingface.co

Total runs: 370.5K
Run Growth: -89.6K
Growth Rate: -23.43%
Updated:February 29 2024
huggingface.co

Total runs: 333.0K
Run Growth: -27.8K
Growth Rate: -8.50%
Updated:January 12 2024
huggingface.co

Total runs: 279.4K
Run Growth: -9.9K
Growth Rate: -3.57%
Updated:June 15 2023
huggingface.co

Total runs: 259.8K
Run Growth: -52.1K
Growth Rate: -20.24%
Updated:January 12 2024
huggingface.co

Total runs: 252.2K
Run Growth: -32.4K
Growth Rate: -12.58%
Updated:November 17 2022
huggingface.co

Total runs: 236.9K
Run Growth: 14.3K
Growth Rate: 6.02%
Updated:July 23 2024
huggingface.co

Total runs: 225.4K
Run Growth: 36.0K
Growth Rate: 16.35%
Updated:February 12 2023
huggingface.co

Total runs: 188.0K
Run Growth: -133.3K
Growth Rate: -70.82%
Updated:September 06 2023
huggingface.co

Total runs: 173.0K
Run Growth: -139.7K
Growth Rate: -81.33%
Updated:September 15 2023
huggingface.co

Total runs: 148.7K
Run Growth: 29.0K
Growth Rate: 19.39%
Updated:June 03 2022
huggingface.co

Total runs: 121.4K
Run Growth: -21.3K
Growth Rate: -17.67%
Updated:November 16 2023
huggingface.co

Total runs: 109.2K
Run Growth: -122.2K
Growth Rate: -111.76%
Updated:May 22 2023
huggingface.co

Total runs: 95.3K
Run Growth: 35.0K
Growth Rate: 36.69%
Updated:March 28 2026
huggingface.co

Total runs: 90.3K
Run Growth: 44.0K
Growth Rate: 51.48%
Updated:December 09 2025
huggingface.co

Total runs: 83.4K
Run Growth: -123.5K
Growth Rate: -143.15%
Updated:July 25 2023
huggingface.co

Total runs: 69.0K
Run Growth: -32.7K
Growth Rate: -46.60%
Updated:September 15 2023
huggingface.co

Total runs: 61.9K
Run Growth: -96.4K
Growth Rate: -143.42%
Updated:September 01 2023
huggingface.co

Total runs: 57.2K
Run Growth: 46.0K
Growth Rate: 80.54%
Updated:March 27 2026
huggingface.co

Total runs: 55.8K
Run Growth: -123.4K
Growth Rate: -201.99%
Updated:September 06 2023
huggingface.co

Total runs: 47.7K
Run Growth: -44.2K
Growth Rate: -93.05%
Updated:February 12 2023
huggingface.co

Total runs: 40.5K
Run Growth: 26.9K
Growth Rate: 67.73%
Updated:October 16 2024
huggingface.co

Total runs: 39.7K
Run Growth: -3.9K
Growth Rate: -9.91%
Updated:September 05 2023
huggingface.co

Total runs: 38.5K
Run Growth: -7.4K
Growth Rate: -19.17%
Updated:January 21 2026
huggingface.co

Total runs: 37.2K
Run Growth: -4.5K
Growth Rate: -13.96%
Updated:June 13 2023
huggingface.co

Total runs: 35.9K
Run Growth: 15.6K
Growth Rate: 42.81%
Updated:February 23 2024