ibivibiv / hydra-moe-120b

huggingface.co
Total runs: 25
24-hour runs: 0
7-day runs: 4
30-day runs: 16
Model's Last Updated: February 02 2024
text-generation

Introduction of hydra-moe-120b

Model Details of hydra-moe-120b

Model Card for Hydra MOE 120B

This is a 4x34b MOE model. I have been expirementing with various gate settings and models. This is yet another run with a different set of models on the same gate definitions.

I am using mixtral tooling.

Model Details
Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: [More Information Needed]
  • Funded by [optional]: ibivibiv sadly alone and out of my pocket for now :D lol
  • Shared by [optional]: ibivibiv
  • Model type: MOE of 4 35B models (mistral/yi/llamma)
  • Language(s) (NLP): English
  • License: Apache 2.0
  • MOE'd from models : jondurbin/nontoxic-bagel-34b-v0.2, 01-ai/Yi-34B, bhenrym14/platypus-yi-34b, abacusai/MM-OV-bagel-DPO-34b-c1000-250
Model Sources [optional]
  • Repository: [More Information Needed]
  • Paper [optional]: [More Information Needed]
  • Demo [optional]: [More Information Needed]
Uses
Direct Use

[More Information Needed]

Downstream Use [optional]

[More Information Needed]

Out-of-Scope Use

[More Information Needed]

Bias, Risks, and Limitations

[More Information Needed]

Recommendations

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

Training Details
Training Data

[More Information Needed]

Training Procedure
Preprocessing [optional]

[More Information Needed]

Training Hyperparameters
  • Training regime: [More Information Needed]
Speeds, Sizes, Times [optional]

[More Information Needed]

Evaluation
Testing Data, Factors & Metrics
Testing Data

[More Information Needed]

Factors

[More Information Needed]

Metrics

[More Information Needed]

Results

[More Information Needed]

Summary
Model Examination [optional]

[More Information Needed]

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019) .

  • Hardware Type: [More Information Needed]
  • Hours used: [More Information Needed]
  • Cloud Provider: [More Information Needed]
  • Compute Region: [More Information Needed]
  • Carbon Emitted: [More Information Needed]
Technical Specifications [optional]
Model Architecture and Objective

[More Information Needed]

Compute Infrastructure

[More Information Needed]

Hardware

[More Information Needed]

Software

[More Information Needed]

Citation [optional]

BibTeX:

[More Information Needed]

APA:

[More Information Needed]

Glossary [optional]

[More Information Needed]

More Information [optional]

[More Information Needed]

Model Card Authors [optional]

[More Information Needed]

Model Card Contact

[More Information Needed]

Runs of ibivibiv hydra-moe-120b on huggingface.co

25
Total runs
0
24-hour runs
1
3-day runs
4
7-day runs
16
30-day runs

More Information About hydra-moe-120b huggingface.co Model

More hydra-moe-120b license Visit here:

https://choosealicense.com/licenses/apache-2.0

hydra-moe-120b huggingface.co

hydra-moe-120b huggingface.co is an AI model on huggingface.co that provides hydra-moe-120b's model effect (), which can be used instantly with this ibivibiv hydra-moe-120b model. huggingface.co supports a free trial of the hydra-moe-120b model, and also provides paid use of the hydra-moe-120b. Support call hydra-moe-120b model through api, including Node.js, Python, http.

hydra-moe-120b huggingface.co Url

https://huggingface.co/ibivibiv/hydra-moe-120b

ibivibiv hydra-moe-120b online free

hydra-moe-120b huggingface.co is an online trial and call api platform, which integrates hydra-moe-120b's modeling effects, including api services, and provides a free online trial of hydra-moe-120b, you can try hydra-moe-120b online for free by clicking the link below.

ibivibiv hydra-moe-120b online free url in huggingface.co:

https://huggingface.co/ibivibiv/hydra-moe-120b

hydra-moe-120b install

hydra-moe-120b is an open source model from GitHub that offers a free installation service, and any user can find hydra-moe-120b on GitHub to install. At the same time, huggingface.co provides the effect of hydra-moe-120b install, users can directly use hydra-moe-120b installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

hydra-moe-120b install url in huggingface.co:

https://huggingface.co/ibivibiv/hydra-moe-120b

Url of hydra-moe-120b

hydra-moe-120b huggingface.co Url

Provider of hydra-moe-120b huggingface.co

ibivibiv
ORGANIZATIONS

Other API from ibivibiv

huggingface.co

Total runs: 30
Run Growth: 9
Growth Rate: 31.03%
Updated:January 05 2024