amd / Llama-2-70b-chat-hf_FP8_MLPerf_V2

huggingface.co
Total runs: 5.0K
24-hour runs: -42
7-day runs: -33
30-day runs: 4.9K
Model's Last Updated: June 19 2026

Introduction of Llama-2-70b-chat-hf_FP8_MLPerf_V2

Model Details of Llama-2-70b-chat-hf_FP8_MLPerf_V2

Quark Team FP8 Llama-2-70b-chat-hf Model Overview

Model Information For MLPerf
  • Model Name : Llama-2-70b-chat-hf
  • Version : MLPerf v5.0
  • Commit : Close Division Commit
Calibration Dataset

The calibration dataset consists of 1000 OpenOcra samples provided by MLPerf

Quantized Tensors

The following tensors are quantized in each decoder:

  • MLP Layer inputs and weights
  • Linear (including QKVO linear) layer inputs and weights
  • KV Cache Entries
Ignored Layers

The following layers are ignored during quantization:

  • lm_head

Model Performance Comparison

Metric Baseline Accuracy Target (%) FP8 Quant Accuracy (%)
Open Orca (Chat)
- Rouge1 44.4312 44.6369
- Rouge2 22.0352 22.1798
- RougeL 28.6162 28.8249
License

Modifications copyright(c) 2024 Advanced Micro Devices,Inc. All rights reserved.

Runs of amd Llama-2-70b-chat-hf_FP8_MLPerf_V2 on huggingface.co

5.0K
Total runs
-42
24-hour runs
-30
3-day runs
-33
7-day runs
4.9K
30-day runs

More Information About Llama-2-70b-chat-hf_FP8_MLPerf_V2 huggingface.co Model

More Llama-2-70b-chat-hf_FP8_MLPerf_V2 license Visit here:

https://choosealicense.com/licenses/llama2

Llama-2-70b-chat-hf_FP8_MLPerf_V2 huggingface.co

Llama-2-70b-chat-hf_FP8_MLPerf_V2 huggingface.co is an AI model on huggingface.co that provides Llama-2-70b-chat-hf_FP8_MLPerf_V2's model effect (), which can be used instantly with this amd Llama-2-70b-chat-hf_FP8_MLPerf_V2 model. huggingface.co supports a free trial of the Llama-2-70b-chat-hf_FP8_MLPerf_V2 model, and also provides paid use of the Llama-2-70b-chat-hf_FP8_MLPerf_V2. Support call Llama-2-70b-chat-hf_FP8_MLPerf_V2 model through api, including Node.js, Python, http.

Llama-2-70b-chat-hf_FP8_MLPerf_V2 huggingface.co Url

https://huggingface.co/amd/Llama-2-70b-chat-hf_FP8_MLPerf_V2

amd Llama-2-70b-chat-hf_FP8_MLPerf_V2 online free

Llama-2-70b-chat-hf_FP8_MLPerf_V2 huggingface.co is an online trial and call api platform, which integrates Llama-2-70b-chat-hf_FP8_MLPerf_V2's modeling effects, including api services, and provides a free online trial of Llama-2-70b-chat-hf_FP8_MLPerf_V2, you can try Llama-2-70b-chat-hf_FP8_MLPerf_V2 online for free by clicking the link below.

amd Llama-2-70b-chat-hf_FP8_MLPerf_V2 online free url in huggingface.co:

https://huggingface.co/amd/Llama-2-70b-chat-hf_FP8_MLPerf_V2

Llama-2-70b-chat-hf_FP8_MLPerf_V2 install

Llama-2-70b-chat-hf_FP8_MLPerf_V2 is an open source model from GitHub that offers a free installation service, and any user can find Llama-2-70b-chat-hf_FP8_MLPerf_V2 on GitHub to install. At the same time, huggingface.co provides the effect of Llama-2-70b-chat-hf_FP8_MLPerf_V2 install, users can directly use Llama-2-70b-chat-hf_FP8_MLPerf_V2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Llama-2-70b-chat-hf_FP8_MLPerf_V2 install url in huggingface.co:

https://huggingface.co/amd/Llama-2-70b-chat-hf_FP8_MLPerf_V2

Url of Llama-2-70b-chat-hf_FP8_MLPerf_V2

Llama-2-70b-chat-hf_FP8_MLPerf_V2 huggingface.co Url

Provider of Llama-2-70b-chat-hf_FP8_MLPerf_V2 huggingface.co

amd
ORGANIZATIONS

Other API from amd

huggingface.co

Total runs: 184.5K
Run Growth: 87.8K
Growth Rate: 49.05%
Updated:April 14 2026
huggingface.co

Total runs: 114.2K
Run Growth: 12.1K
Growth Rate: 10.28%
Updated:July 17 2026
huggingface.co

Total runs: 104.0K
Run Growth: 16.2K
Growth Rate: 15.28%
Updated:June 19 2026
huggingface.co

Total runs: 52.6K
Run Growth: 71
Growth Rate: 0.14%
Updated:July 01 2026
huggingface.co

Total runs: 24.6K
Run Growth: 12.3K
Growth Rate: 47.76%
Updated:July 27 2026
huggingface.co

Total runs: 12.4K
Run Growth: 5.9K
Growth Rate: 47.68%
Updated:October 09 2024
huggingface.co

Total runs: 11.2K
Run Growth: 1.3K
Growth Rate: 11.53%
Updated:August 12 2025
huggingface.co

Total runs: 2.5K
Run Growth: -533
Growth Rate: -19.83%
Updated:June 19 2026
huggingface.co

Total runs: 1.3K
Run Growth: -38.8K
Growth Rate: -2876.00%
Updated:June 19 2026
huggingface.co

Total runs: 948
Run Growth: -2.7K
Growth Rate: -290.47%
Updated:May 27 2026
huggingface.co

Total runs: 547
Run Growth: -4.8K
Growth Rate: -880.26%
Updated:June 19 2026
huggingface.co

Total runs: 512
Run Growth: -350
Growth Rate: -67.70%
Updated:November 15 2025