The following is an example model and its evaluation.
git clone https://github.com/EleutherAI/lm-evaluation-harness
cd lm-evaluation-harness
pip install -e .
from dmx.compressor.modeling import DmxModel
import lm_eval
model_args = "pretrained=d-matrix/Mistral,trust_remote_code=True"
lm = lm_eval.api.registry.get_model("hf").create_from_arg_string(model_args, {"batch_size": 1})
# Transform the model with DMX
lm._model = DmxModel.from_torch(lm._model)
eval_results = lm_eval.evaluate(lm, lm_eval.tasks.get_task_dict(["wikitext"])) # Assign desired task, i.e. "wikitext"
Runs of d-matrix Mistral-7B on huggingface.co
20
Total runs
-2
24-hour runs
-5
3-day runs
-3
7-day runs
8
30-day runs
More Information About Mistral-7B huggingface.co Model
Mistral-7B huggingface.co
Mistral-7B huggingface.co is an AI model on huggingface.co that provides Mistral-7B's model effect (), which can be used instantly with this d-matrix Mistral-7B model. huggingface.co supports a free trial of the Mistral-7B model, and also provides paid use of the Mistral-7B. Support call Mistral-7B model through api, including Node.js, Python, http.
Mistral-7B huggingface.co is an online trial and call api platform, which integrates Mistral-7B's modeling effects, including api services, and provides a free online trial of Mistral-7B, you can try Mistral-7B online for free by clicking the link below.
d-matrix Mistral-7B online free url in huggingface.co:
Mistral-7B is an open source model from GitHub that offers a free installation service, and any user can find Mistral-7B on GitHub to install. At the same time, huggingface.co provides the effect of Mistral-7B install, users can directly use Mistral-7B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.