Statuo / LemonKunoichiWizardv3_8bpw

huggingface.co
Total runs: 4
24-hour runs: 0
7-day runs: -1
30-day runs: 3
Model's Last Updated: May 18 2024
text-generation

Introduction of LemonKunoichiWizardv3_8bpw

Model Details of LemonKunoichiWizardv3_8bpw

Lemon Kunoichi Wizard - 7b

LemonKunoichiWizard

Base Model , 4bpw , 6bpw , 8bpw

The Quanted versions come with the measurement files in case you want to do your own quants.

A merge of three models, LemonadeRP-4.5.3, Kunoichi-DPO-v2, and WizardLM-2. I used Lemonade as a base with Kunoichi being the second biggest influence and WizardLM-2 for logic capabilities.

The end result is a Roleplay-focused model with great character card inference. I ran 4 merges at varying values to see which provided the most accurate output to a character cards quirk, with this v3 version being the winner out of the four.

Context Template - Alpaca

Alpaca preset seems to work well with your own System Prompt.

Context Size - 8192

The model loads at 8192 on my end, but theoretically it should be able to go up to 32k. Not that it'll be coherent at 32k. Most models based on Mistral like this end up being - at best - 12k context size for coherent output. I only tested at 8k which is where the base models tend to shine. YMMV otherwise.


base_model:

  • SanjiWatsuki/Kunoichi-DPO-v2-7B
  • dreamgen/WizardLM-2-7B
  • KatyTheCutie/LemonadeRP-4.5.3 library_name: transformers tags:
  • mergekit
  • merge

merge

This is a merge of pre-trained language models created using mergekit .

Merge Details
Merge Method

This model was merged using the linear merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: KatyTheCutie/LemonadeRP-4.5.3
    parameters:
      weight: 1.0
  - model: dreamgen/WizardLM-2-7B
    parameters:
      weight: 0.2
  - model: SanjiWatsuki/Kunoichi-DPO-v2-7B
    parameters:
      weight: 0.6
merge_method: linear
dtype: float16

Runs of Statuo LemonKunoichiWizardv3_8bpw on huggingface.co

4
Total runs
0
24-hour runs
0
3-day runs
-1
7-day runs
3
30-day runs

More Information About LemonKunoichiWizardv3_8bpw huggingface.co Model

LemonKunoichiWizardv3_8bpw huggingface.co

LemonKunoichiWizardv3_8bpw huggingface.co is an AI model on huggingface.co that provides LemonKunoichiWizardv3_8bpw's model effect (), which can be used instantly with this Statuo LemonKunoichiWizardv3_8bpw model. huggingface.co supports a free trial of the LemonKunoichiWizardv3_8bpw model, and also provides paid use of the LemonKunoichiWizardv3_8bpw. Support call LemonKunoichiWizardv3_8bpw model through api, including Node.js, Python, http.

LemonKunoichiWizardv3_8bpw huggingface.co Url

https://huggingface.co/Statuo/LemonKunoichiWizardv3_8bpw

Statuo LemonKunoichiWizardv3_8bpw online free

LemonKunoichiWizardv3_8bpw huggingface.co is an online trial and call api platform, which integrates LemonKunoichiWizardv3_8bpw's modeling effects, including api services, and provides a free online trial of LemonKunoichiWizardv3_8bpw, you can try LemonKunoichiWizardv3_8bpw online for free by clicking the link below.

Statuo LemonKunoichiWizardv3_8bpw online free url in huggingface.co:

https://huggingface.co/Statuo/LemonKunoichiWizardv3_8bpw

LemonKunoichiWizardv3_8bpw install

LemonKunoichiWizardv3_8bpw is an open source model from GitHub that offers a free installation service, and any user can find LemonKunoichiWizardv3_8bpw on GitHub to install. At the same time, huggingface.co provides the effect of LemonKunoichiWizardv3_8bpw install, users can directly use LemonKunoichiWizardv3_8bpw installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

LemonKunoichiWizardv3_8bpw install url in huggingface.co:

https://huggingface.co/Statuo/LemonKunoichiWizardv3_8bpw

Url of LemonKunoichiWizardv3_8bpw

LemonKunoichiWizardv3_8bpw huggingface.co Url

Provider of LemonKunoichiWizardv3_8bpw huggingface.co

Statuo
ORGANIZATIONS

Other API from Statuo