Introduction of Baubo-11b-FAILURE-WITH-EXPLANATION
Model Details of Baubo-11b-FAILURE-WITH-EXPLANATION
Baubo-11b-DARE
It's worse than pre-merge by A LOT
Found the problem, details below.
I mean it, this model is insane.
The other 11b models are useful, but worse than a good 7B - and thus worthless.
This model... it forms coherent sentences but NOT coherent thought.
Named after a pseudonym for Iambe, Baubo is a similar mix, but out of these odd 11b models. Let's see if dare_ties hammers out the (platonic) kinks, eh?
EDIT: It did not. Upon actually
reading
the whole paper
rather than
skimming
it, (shocking idea, I know) I can tell you what happened here. As the authors say in the dang abstract, "we have also tried to remove fine-tuned instead of delta [changed by LoRA] parameters and find that a 10% reduction can lead to drastically decreased performance (even to 0.0)" But, my base model here is not actually the base model. Besides its bizzare size, it contains aspects of Alpaca... but not on every layer! Thus, confusion reigned as dares_ties saw some Alpaca formatting as being delta weights and others as being part of the base model. It fragged the poor thing's little network something fierce.
This also explains why the version of Imabe-20b-DARE that came out as the release was the iteration it was. The release Iambe-DARE has my BigLlama as the base model, and the other two had roleplaying SFTed models as the base. Looks like I have another version of Iambe to produce, this time with a proper base.
Recipe
merge_method: dare_ties
base_model: athirdpath/LilLlama-11b
model: athirdpath/U-Amethyst-11B
weight: 0.39 / density: 0.55
model: athirdpath/PsyMedRP-v1-11B
weight: 0.20 / density: 0.45
model: thirdpath/CleverGirl-11b
weight: 0.41 / density: 0.55
int8_mask: true
dtype: bfloat16
Runs of athirdpath Baubo-11b-FAILURE-WITH-EXPLANATION on huggingface.co
273
Total runs
0
24-hour runs
1
3-day runs
24
7-day runs
164
30-day runs
More Information About Baubo-11b-FAILURE-WITH-EXPLANATION huggingface.co Model
More Baubo-11b-FAILURE-WITH-EXPLANATION license Visit here:
Baubo-11b-FAILURE-WITH-EXPLANATION huggingface.co is an AI model on huggingface.co that provides Baubo-11b-FAILURE-WITH-EXPLANATION's model effect (), which can be used instantly with this athirdpath Baubo-11b-FAILURE-WITH-EXPLANATION model. huggingface.co supports a free trial of the Baubo-11b-FAILURE-WITH-EXPLANATION model, and also provides paid use of the Baubo-11b-FAILURE-WITH-EXPLANATION. Support call Baubo-11b-FAILURE-WITH-EXPLANATION model through api, including Node.js, Python, http.
Baubo-11b-FAILURE-WITH-EXPLANATION huggingface.co is an online trial and call api platform, which integrates Baubo-11b-FAILURE-WITH-EXPLANATION's modeling effects, including api services, and provides a free online trial of Baubo-11b-FAILURE-WITH-EXPLANATION, you can try Baubo-11b-FAILURE-WITH-EXPLANATION online for free by clicking the link below.
athirdpath Baubo-11b-FAILURE-WITH-EXPLANATION online free url in huggingface.co:
Baubo-11b-FAILURE-WITH-EXPLANATION is an open source model from GitHub that offers a free installation service, and any user can find Baubo-11b-FAILURE-WITH-EXPLANATION on GitHub to install. At the same time, huggingface.co provides the effect of Baubo-11b-FAILURE-WITH-EXPLANATION install, users can directly use Baubo-11b-FAILURE-WITH-EXPLANATION installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Baubo-11b-FAILURE-WITH-EXPLANATION install url in huggingface.co: