thoughtworks / arithmetic-sorl

huggingface.co
Total runs: 0
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: April 16 2026

Introduction of arithmetic-sorl

Model Details of arithmetic-sorl

Arithmetic SoRL Models

Model checkpoints for the SoRL Arithmetic Interpretability Study .

Small Qwen3 transformers (3L/4H/512d, ~168M params) trained from scratch on integer addition and subtraction, with and without SoRL abstraction tokens.

Goal

Show that SoRL externalizes arithmetic reasoning mechanisms (carry, borrow circuits) as explicit abstraction tokens — observable and intervenable without activation-level tooling.

Architecture

Tiny Qwen3 from random init via SorlModelWrapper.from_scratch :

hidden_size=512, num_hidden_layers=3, num_attention_heads=4
intermediate_size=2048, vocab_size=151936
Experiment subfolders

Each subfolder contains a trained model + train_config.json + metrics.json .

Subfolder Task Mode Abstract Vocab
add_baseline addition SFT baseline 0
add_sorl_abs4 addition SoRL v6 4
add_sorl_abs8 addition SoRL v6 8
...
Related

Runs of thoughtworks arithmetic-sorl on huggingface.co

0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About arithmetic-sorl huggingface.co Model

More arithmetic-sorl license Visit here:

https://choosealicense.com/licenses/apache-2.0

arithmetic-sorl huggingface.co

arithmetic-sorl huggingface.co is an AI model on huggingface.co that provides arithmetic-sorl's model effect (), which can be used instantly with this thoughtworks arithmetic-sorl model. huggingface.co supports a free trial of the arithmetic-sorl model, and also provides paid use of the arithmetic-sorl. Support call arithmetic-sorl model through api, including Node.js, Python, http.

thoughtworks arithmetic-sorl online free

arithmetic-sorl huggingface.co is an online trial and call api platform, which integrates arithmetic-sorl's modeling effects, including api services, and provides a free online trial of arithmetic-sorl, you can try arithmetic-sorl online for free by clicking the link below.

thoughtworks arithmetic-sorl online free url in huggingface.co:

https://huggingface.co/thoughtworks/arithmetic-sorl

arithmetic-sorl install

arithmetic-sorl is an open source model from GitHub that offers a free installation service, and any user can find arithmetic-sorl on GitHub to install. At the same time, huggingface.co provides the effect of arithmetic-sorl install, users can directly use arithmetic-sorl installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

arithmetic-sorl install url in huggingface.co:

https://huggingface.co/thoughtworks/arithmetic-sorl

Url of arithmetic-sorl

Provider of arithmetic-sorl huggingface.co

thoughtworks
ORGANIZATIONS

Other API from thoughtworks