This is a 4x34b MOE model. I have been expirementing with various gate settings and models. This is yet another run with a different set of models on the same gate definitions.
I am using mixtral tooling.
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
Developed by:
[More Information Needed]
Funded by [optional]:
ibivibiv
sadly alone and out of my pocket for now :D lol
Model type:
MOE of 4 35B models (mistral/yi/llamma)
Language(s) (NLP):
English
License:
Apache 2.0
MOE'd from models :
jondurbin/nontoxic-bagel-34b-v0.2, 01-ai/Yi-34B, bhenrym14/platypus-yi-34b, abacusai/MM-OV-bagel-DPO-34b-c1000-250
Model Sources [optional]
Repository:
[More Information Needed]
Paper [optional]:
[More Information Needed]
Demo [optional]:
[More Information Needed]
Uses
Direct Use
[More Information Needed]
Downstream Use [optional]
[More Information Needed]
Out-of-Scope Use
[More Information Needed]
Bias, Risks, and Limitations
[More Information Needed]
Recommendations
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
hydra-moe-120b huggingface.co is an AI model on huggingface.co that provides hydra-moe-120b's model effect (), which can be used instantly with this ibivibiv hydra-moe-120b model. huggingface.co supports a free trial of the hydra-moe-120b model, and also provides paid use of the hydra-moe-120b. Support call hydra-moe-120b model through api, including Node.js, Python, http.
hydra-moe-120b huggingface.co is an online trial and call api platform, which integrates hydra-moe-120b's modeling effects, including api services, and provides a free online trial of hydra-moe-120b, you can try hydra-moe-120b online for free by clicking the link below.
ibivibiv hydra-moe-120b online free url in huggingface.co:
hydra-moe-120b is an open source model from GitHub that offers a free installation service, and any user can find hydra-moe-120b on GitHub to install. At the same time, huggingface.co provides the effect of hydra-moe-120b install, users can directly use hydra-moe-120b installed effect in huggingface.co for debugging and trial. It also supports api for free installation.