lodrick-the-lafted / Hermes-Instruct-7B-217K

huggingface.co
Total runs: 67
24-hour runs: 0
7-day runs: -7
30-day runs: -4
Model's Last Updated: February 22 2024
text-generation

Introduction of Hermes-Instruct-7B-217K

Model Details of Hermes-Instruct-7B-217K

Hermes-Instruct-7B-217K

Mistral-7B-Instruct-v0.2 trained with 217K rows of teknium/openhermes , in Alpaca format. Why? Mistral-7B-Instruct-v0.2 has native 32K context and rope theta of 1M. It's not a base model, so I've used the same recipe with different amounts of data to gauge the effects of further finetuning.



Prompt Format

Both the default Mistral-Instruct tags and Alpaca are fine, so either:

<s>[INST] {sys_prompt} {instruction} [/INST] 

or

{sys_prompt}

### Instruction:
{instruction}

### Response:

The tokenizer default is Alpaca this time around.



Usage

from transformers import AutoTokenizer
import transformers
import torch

model = "lodrick-the-lafted/Hermes-Instruct-7B-217K"

tokenizer = AutoTokenizer.from_pretrained(model)
pipeline = transformers.pipeline(
    "text-generation",
    model=model,
    model_kwargs={"torch_dtype": torch.bfloat16},
)

messages = [{"role": "user", "content": "Give me a cooking recipe for an apple pie."}]
prompt = pipeline.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_p=0.95)
print(outputs[0]["generated_text"])

Runs of lodrick-the-lafted Hermes-Instruct-7B-217K on huggingface.co

67
Total runs
0
24-hour runs
0
3-day runs
-7
7-day runs
-4
30-day runs

More Information About Hermes-Instruct-7B-217K huggingface.co Model

More Hermes-Instruct-7B-217K license Visit here:

https://choosealicense.com/licenses/apache-2.0

Hermes-Instruct-7B-217K huggingface.co

Hermes-Instruct-7B-217K huggingface.co is an AI model on huggingface.co that provides Hermes-Instruct-7B-217K's model effect (), which can be used instantly with this lodrick-the-lafted Hermes-Instruct-7B-217K model. huggingface.co supports a free trial of the Hermes-Instruct-7B-217K model, and also provides paid use of the Hermes-Instruct-7B-217K. Support call Hermes-Instruct-7B-217K model through api, including Node.js, Python, http.

lodrick-the-lafted Hermes-Instruct-7B-217K online free

Hermes-Instruct-7B-217K huggingface.co is an online trial and call api platform, which integrates Hermes-Instruct-7B-217K's modeling effects, including api services, and provides a free online trial of Hermes-Instruct-7B-217K, you can try Hermes-Instruct-7B-217K online for free by clicking the link below.

lodrick-the-lafted Hermes-Instruct-7B-217K online free url in huggingface.co:

https://huggingface.co/lodrick-the-lafted/Hermes-Instruct-7B-217K

Hermes-Instruct-7B-217K install

Hermes-Instruct-7B-217K is an open source model from GitHub that offers a free installation service, and any user can find Hermes-Instruct-7B-217K on GitHub to install. At the same time, huggingface.co provides the effect of Hermes-Instruct-7B-217K install, users can directly use Hermes-Instruct-7B-217K installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Hermes-Instruct-7B-217K install url in huggingface.co:

https://huggingface.co/lodrick-the-lafted/Hermes-Instruct-7B-217K

Url of Hermes-Instruct-7B-217K

Provider of Hermes-Instruct-7B-217K huggingface.co

lodrick-the-lafted
ORGANIZATIONS

Other API from lodrick-the-lafted