dhanushreddy29 / BrokenKeyboardMerge

huggingface.co
Total runs: 54
24-hour runs: -1
7-day runs: -1
30-day runs: -7
Model's Last Updated: March 05 2024
text-generation

Introduction of BrokenKeyboardMerge

Model Details of BrokenKeyboardMerge

BrokenKeyboardMerge

BrokenKeyboardMerge is a merge of the following models using LazyMergekit :

🧩 Configuration
slices:
  - sources:
    - model: dhanushreddy29/BrokenKeyboard
      layer_range: [0, 16]
  - sources:
    - model: udkai/Turdus
      layer_range: [16, 32]
merge_method: passthrough
dtype: float16
💻 Usage
!pip install -qU transformers accelerate

from transformers import AutoTokenizer
import transformers
import torch

model = "dhanushreddy29/BrokenKeyboardMerge"
messages = [{"role": "user", "content": "What is a large language model?"}]

tokenizer = AutoTokenizer.from_pretrained(model)
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
pipeline = transformers.pipeline(
    "text-generation",
    model=model,
    torch_dtype=torch.float16,
    device_map="auto",
)

outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 59.33
AI2 Reasoning Challenge (25-Shot) 59.73
HellaSwag (10-Shot) 81.25
MMLU (5-Shot) 58.36
TruthfulQA (0-shot) 52.00
Winogrande (5-shot) 78.69
GSM8k (5-shot) 25.93

Runs of dhanushreddy29 BrokenKeyboardMerge on huggingface.co

54
Total runs
-1
24-hour runs
0
3-day runs
-1
7-day runs
-7
30-day runs

More Information About BrokenKeyboardMerge huggingface.co Model

More BrokenKeyboardMerge license Visit here:

https://choosealicense.com/licenses/cc-by-nc-4.0

BrokenKeyboardMerge huggingface.co

BrokenKeyboardMerge huggingface.co is an AI model on huggingface.co that provides BrokenKeyboardMerge's model effect (), which can be used instantly with this dhanushreddy29 BrokenKeyboardMerge model. huggingface.co supports a free trial of the BrokenKeyboardMerge model, and also provides paid use of the BrokenKeyboardMerge. Support call BrokenKeyboardMerge model through api, including Node.js, Python, http.

dhanushreddy29 BrokenKeyboardMerge online free

BrokenKeyboardMerge huggingface.co is an online trial and call api platform, which integrates BrokenKeyboardMerge's modeling effects, including api services, and provides a free online trial of BrokenKeyboardMerge, you can try BrokenKeyboardMerge online for free by clicking the link below.

dhanushreddy29 BrokenKeyboardMerge online free url in huggingface.co:

https://huggingface.co/dhanushreddy29/BrokenKeyboardMerge

BrokenKeyboardMerge install

BrokenKeyboardMerge is an open source model from GitHub that offers a free installation service, and any user can find BrokenKeyboardMerge on GitHub to install. At the same time, huggingface.co provides the effect of BrokenKeyboardMerge install, users can directly use BrokenKeyboardMerge installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

BrokenKeyboardMerge install url in huggingface.co:

https://huggingface.co/dhanushreddy29/BrokenKeyboardMerge

Url of BrokenKeyboardMerge

Provider of BrokenKeyboardMerge huggingface.co

dhanushreddy29
ORGANIZATIONS

Other API from dhanushreddy29