Public experimental causal language model with approximately 1.04B parameters. It uses the open 32k Mistral tokenizer, byte-derived initialization from Cascade-1B-Logic, four local token layers, entropy-guided token patches, and one active eight-layer core path out of three per batch.
Training streams FineWeb-Edu, FineMath, Cosmopedia v2, OpenR1-Math, and decontaminated Codeforces CoT. Hidden matrices use Muon; embeddings, normalization parameters, and vocabulary heads use AdamW. Checkpoints are uploaded every 5000 steps and lightweight state every 1000 steps. Hub failures are asynchronous and never terminate training.
This is an early base model, not an instruction-tuned assistant. Checkpoints may produce incoherent or unsafe text.
Tokenizer source:
mistralai/Mistral-7B-v0.1
.
Runs of Asilarkness cascade-1b-bpe-logic on huggingface.co
56
Total runs
-2
24-hour runs
-2
3-day runs
1
7-day runs
-543
30-day runs
More Information About cascade-1b-bpe-logic huggingface.co Model
cascade-1b-bpe-logic huggingface.co is an AI model on huggingface.co that provides cascade-1b-bpe-logic's model effect (), which can be used instantly with this Asilarkness cascade-1b-bpe-logic model. huggingface.co supports a free trial of the cascade-1b-bpe-logic model, and also provides paid use of the cascade-1b-bpe-logic. Support call cascade-1b-bpe-logic model through api, including Node.js, Python, http.
cascade-1b-bpe-logic huggingface.co is an online trial and call api platform, which integrates cascade-1b-bpe-logic's modeling effects, including api services, and provides a free online trial of cascade-1b-bpe-logic, you can try cascade-1b-bpe-logic online for free by clicking the link below.
Asilarkness cascade-1b-bpe-logic online free url in huggingface.co:
cascade-1b-bpe-logic is an open source model from GitHub that offers a free installation service, and any user can find cascade-1b-bpe-logic on GitHub to install. At the same time, huggingface.co provides the effect of cascade-1b-bpe-logic install, users can directly use cascade-1b-bpe-logic installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
cascade-1b-bpe-logic install url in huggingface.co: