cloudyu / 60B-MoE-Coder-v2

huggingface.co
Total runs: 95
24-hour runs: 6
7-day runs: 20
30-day runs: -16
Model's Last Updated: February 07 2024
text-generation

Introduction of 60B-MoE-Coder-v2

Model Details of 60B-MoE-Coder-v2

  • this is 4bit 60B MoE model trained by SFTTrainer based on [cloudyu/4bit_quant_TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO]

  • nampdn-ai/tiny-codes sampling about 2000 cases

  • Metrics not Test

    code example

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
import math

model_path = "cloudyu/60B-MoE-Coder-v2"

tokenizer = AutoTokenizer.from_pretrained(model_path, use_default_system_prompt=False)
model = AutoModelForCausalLM.from_pretrained(
        model_path, torch_dtype=torch.bfloat16, device_map='auto',local_files_only=False, load_in_4bit=True
)
print(model)
prompt = input("please input prompt:")
while len(prompt) > 0:
  input_ids = tokenizer(prompt, return_tensors="pt").input_ids.to("cuda")

  generation_output = model.generate(
    input_ids=input_ids, max_new_tokens=1500,repetition_penalty=1.1
  )
  print(tokenizer.decode(generation_output[0]))
  prompt = input("please input prompt:")

Runs of cloudyu 60B-MoE-Coder-v2 on huggingface.co

95
Total runs
6
24-hour runs
5
3-day runs
20
7-day runs
-16
30-day runs

More Information About 60B-MoE-Coder-v2 huggingface.co Model

More 60B-MoE-Coder-v2 license Visit here:

https://choosealicense.com/licenses/yi-license

60B-MoE-Coder-v2 huggingface.co

60B-MoE-Coder-v2 huggingface.co is an AI model on huggingface.co that provides 60B-MoE-Coder-v2's model effect (), which can be used instantly with this cloudyu 60B-MoE-Coder-v2 model. huggingface.co supports a free trial of the 60B-MoE-Coder-v2 model, and also provides paid use of the 60B-MoE-Coder-v2. Support call 60B-MoE-Coder-v2 model through api, including Node.js, Python, http.

60B-MoE-Coder-v2 huggingface.co Url

https://huggingface.co/cloudyu/60B-MoE-Coder-v2

cloudyu 60B-MoE-Coder-v2 online free

60B-MoE-Coder-v2 huggingface.co is an online trial and call api platform, which integrates 60B-MoE-Coder-v2's modeling effects, including api services, and provides a free online trial of 60B-MoE-Coder-v2, you can try 60B-MoE-Coder-v2 online for free by clicking the link below.

cloudyu 60B-MoE-Coder-v2 online free url in huggingface.co:

https://huggingface.co/cloudyu/60B-MoE-Coder-v2

60B-MoE-Coder-v2 install

60B-MoE-Coder-v2 is an open source model from GitHub that offers a free installation service, and any user can find 60B-MoE-Coder-v2 on GitHub to install. At the same time, huggingface.co provides the effect of 60B-MoE-Coder-v2 install, users can directly use 60B-MoE-Coder-v2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

60B-MoE-Coder-v2 install url in huggingface.co:

https://huggingface.co/cloudyu/60B-MoE-Coder-v2

Url of 60B-MoE-Coder-v2

60B-MoE-Coder-v2 huggingface.co Url

Provider of 60B-MoE-Coder-v2 huggingface.co

cloudyu
ORGANIZATIONS

Other API from cloudyu

huggingface.co

Total runs: 305
Run Growth: -434
Growth Rate: -142.30%
Updated:January 23 2024
huggingface.co

Total runs: 93
Run Growth: -17
Growth Rate: -18.28%
Updated:February 02 2024
huggingface.co

Total runs: 92
Run Growth: -27
Growth Rate: -28.72%
Updated:January 30 2024
huggingface.co

Total runs: 5
Run Growth: 3
Growth Rate: 60.00%
Updated:December 16 2024
huggingface.co

Total runs: 5
Run Growth: 5
Growth Rate: 100.00%
Updated:December 07 2024
huggingface.co

Total runs: 4
Run Growth: 2
Growth Rate: 50.00%
Updated:December 16 2024
huggingface.co

Total runs: 4
Run Growth: 3
Growth Rate: 75.00%
Updated:December 17 2024
huggingface.co

Total runs: 4
Run Growth: 4
Growth Rate: 100.00%
Updated:September 09 2024
huggingface.co

Total runs: 2
Run Growth: 1
Growth Rate: 50.00%
Updated:December 18 2024
huggingface.co

Total runs: 2
Run Growth: 2
Growth Rate: 100.00%
Updated:November 28 2024
huggingface.co

Total runs: 0
Run Growth: -5
Growth Rate: 0.00%
Updated:November 28 2024
huggingface.co

Total runs: 0
Run Growth: -2
Growth Rate: 0.00%
Updated:November 28 2024
huggingface.co

Total runs: 0
Run Growth: -2
Growth Rate: 0.00%
Updated:December 06 2024