A series of Merges made for Roleplaying & Creative Writing, This model uses Rei-V3-KTO-12B and Francois-PE-V2-Huali-12B and Slerp to merge the 2 models - as a sequel to the OG Archaeo.
ChatML formatting
"""<|im_start|>system
system prompt<|im_end|>
<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistant
"""
MergeKit Configuration
models:
- model: Delta-Vector/Rei-V3-KTO-12B
- model: Delta-Vector/Francois-PE-V2-Huali-12B
merge_method: slerp
base_model: Delta-Vector/Rei-V3-KTO-12B
parameters:
t:
- value: 0.2
dtype: bfloat16
tokenizer_source: base
Quants:
Credits
Thank you to: Kubernetes-bad, LucyKnada, Intervitens, Samantha Twinkman, Tav, Alicat, Auri, Trappu & The rest of Anthracite