Statuo / Stardust-12b-MN-EXL2-8bpw

huggingface.co
Total runs: 5
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: Tháng 9 01 2024
text-generation

Introduction of Stardust-12b-MN-EXL2-8bpw

Model Details of Stardust-12b-MN-EXL2-8bpw

Mostly quanting this because I want to see how it performs.

This is the 8bpw EXL2 quant of this model. For the original model, go here.
For the 6bpw version, go here.
For the 4bpw version, go here

image/png

StarDust-12b-v1

Quants
Description | Usecase

The result of this merge is in my opinion a more vibrant and less generic sonnet inspired prose, it's able to be gentle and harsh where asked. I've personally been trying to get a more spice while also compensating for the Magnum-v2.5 having the issue on my end that it simply won't stop yapping.

  • This model is intended to be used as a Role-playing model.
  • Its direct conversational output is... I can't even say it's luck, it's just not made for it.
  • Extension to Conversational output: The Model is designed for roleplay, direct instructing or general purpose is NOT recommended.
Initial Feedback

Initial feedback shows that the model has a tendency to promote flirting. If this becomes too much try to steer the model with a system prompt to focus on SFW and on-flirty interactions.

Prompting
Edit: ChatML has proven to be the BEST choice.

Both Mistral and ChatML should work though I had better results with ChatML: ChatML Example:

"""<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistant
"""
Merge Details
Merge Method

This model was merged using the DARE TIES merge method using Sao10K/MN-12B-Lyra-v3 as a base.

Models Merged

The following models were included in the merge:

Special Thanks

Special thanks to the SillyTilly and myself for helping me find the energy to finish this.

Runs of Statuo Stardust-12b-MN-EXL2-8bpw on huggingface.co

5
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About Stardust-12b-MN-EXL2-8bpw huggingface.co Model

More Stardust-12b-MN-EXL2-8bpw license Visit here:

https://choosealicense.com/licenses/apache-2.0

Stardust-12b-MN-EXL2-8bpw huggingface.co

Stardust-12b-MN-EXL2-8bpw huggingface.co is an AI model on huggingface.co that provides Stardust-12b-MN-EXL2-8bpw's model effect (), which can be used instantly with this Statuo Stardust-12b-MN-EXL2-8bpw model. huggingface.co supports a free trial of the Stardust-12b-MN-EXL2-8bpw model, and also provides paid use of the Stardust-12b-MN-EXL2-8bpw. Support call Stardust-12b-MN-EXL2-8bpw model through api, including Node.js, Python, http.

Stardust-12b-MN-EXL2-8bpw huggingface.co Url

https://huggingface.co/Statuo/Stardust-12b-MN-EXL2-8bpw

Statuo Stardust-12b-MN-EXL2-8bpw online free

Stardust-12b-MN-EXL2-8bpw huggingface.co is an online trial and call api platform, which integrates Stardust-12b-MN-EXL2-8bpw's modeling effects, including api services, and provides a free online trial of Stardust-12b-MN-EXL2-8bpw, you can try Stardust-12b-MN-EXL2-8bpw online for free by clicking the link below.

Statuo Stardust-12b-MN-EXL2-8bpw online free url in huggingface.co:

https://huggingface.co/Statuo/Stardust-12b-MN-EXL2-8bpw

Stardust-12b-MN-EXL2-8bpw install

Stardust-12b-MN-EXL2-8bpw is an open source model from GitHub that offers a free installation service, and any user can find Stardust-12b-MN-EXL2-8bpw on GitHub to install. At the same time, huggingface.co provides the effect of Stardust-12b-MN-EXL2-8bpw install, users can directly use Stardust-12b-MN-EXL2-8bpw installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Stardust-12b-MN-EXL2-8bpw install url in huggingface.co:

https://huggingface.co/Statuo/Stardust-12b-MN-EXL2-8bpw

Url of Stardust-12b-MN-EXL2-8bpw

Stardust-12b-MN-EXL2-8bpw huggingface.co Url

Provider of Stardust-12b-MN-EXL2-8bpw huggingface.co

Statuo
ORGANIZATIONS

Other API from Statuo

huggingface.co

Total runs: 5
Run Growth: -3
Growth Rate: -60.00%
Updated:Có thể 04 2024