Sponsored by Raccoon AI
Toolify Toolify logo
AI Models
single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev

torchao-testing / single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev

Run on huggingface.co
huggingface.co
Total runs: 0
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: August 21 2025

Introduction of single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev

Model Details of single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev

model: single_linear
config: Float8DynamicActivationFloat8WeightConfig
config version: 1
torchao version: 0.13.dev

import torch
import io

model = torch.nn.Sequential(torch.nn.Linear(32, 256, dtype=torch.bfloat16, device="cuda"))

from torchao.quantization import quantize_, Float8DynamicActivationFloat8WeightConfig, PerRow
quant_config = Float8DynamicActivationFloat8WeightConfig(granularity=PerRow(), version=1)
quantize_(model, quant_config)
example_inputs = (torch.randn(2, 32, dtype=torch.bfloat16, device="cuda"),)
output = model(*example_inputs)

# Push to hub
USER_ID = "torchao-testing"
MODEL_NAME = "single-linear"
save_to = f"{USER_ID}/{MODEL_NAME}-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev"

from huggingface_hub import HfApi
api = HfApi()

buf = io.BytesIO()
torch.save(model.state_dict(), buf)
api.create_repo(save_to, repo_type="model", exist_ok=True)
api.upload_file(
    path_or_fileobj=buf,
    path_in_repo="model.pt",
    repo_id=save_to,
)

buf = io.BytesIO()
torch.save(example_inputs, buf)
api.upload_file(
    path_or_fileobj=buf,
    path_in_repo="model_inputs.pt",
    repo_id=save_to,
)

buf = io.BytesIO()
torch.save(output, buf)
api.upload_file(
    path_or_fileobj=buf,
    path_in_repo="model_output.pt",
    repo_id=save_to,
)

Runs of torchao-testing single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev on huggingface.co

0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev huggingface.co Model

single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev huggingface.co

single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev huggingface.co is an AI model on huggingface.co that provides single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev's model effect (), which can be used instantly with this torchao-testing single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev model. huggingface.co supports a free trial of the single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev model, and also provides paid use of the single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev. Support call single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev model through api, including Node.js, Python, http.

single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev huggingface.co Url

https://huggingface.co/torchao-testing/single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev

torchao-testing single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev online free

single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev huggingface.co is an online trial and call api platform, which integrates single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev's modeling effects, including api services, and provides a free online trial of single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev, you can try single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev online for free by clicking the link below.

torchao-testing single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev online free url in huggingface.co:

https://huggingface.co/torchao-testing/single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev

single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev install

single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev is an open source model from GitHub that offers a free installation service, and any user can find single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev on GitHub to install. At the same time, huggingface.co provides the effect of single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev install, users can directly use single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev install url in huggingface.co:

https://huggingface.co/torchao-testing/single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev

Url of single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev

single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev huggingface.co Url

Provider of single-linear-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev huggingface.co

torchao-testing
ORGANIZATIONS
huggingface.co

Other API from torchao-testing