athirdpath / Baubo-11b-FAILURE-WITH-EXPLANATION

huggingface.co
Total runs: 273
24-hour runs: 0
7-day runs: 24
30-day runs: 164
Model's Last Updated: December 01 2023
text-generation

Introduction of Baubo-11b-FAILURE-WITH-EXPLANATION

Model Details of Baubo-11b-FAILURE-WITH-EXPLANATION

Baubo-11b-DARE

It's worse than pre-merge by A LOT

Found the problem, details below.

I mean it, this model is insane.

The other 11b models are useful, but worse than a good 7B - and thus worthless.

This model... it forms coherent sentences but NOT coherent thought.

Named after a pseudonym for Iambe, Baubo is a similar mix, but out of these odd 11b models. Let's see if dare_ties hammers out the (platonic) kinks, eh?

EDIT: It did not. Upon actually reading the whole paper rather than skimming it, (shocking idea, I know) I can tell you what happened here. As the authors say in the dang abstract, "we have also tried to remove fine-tuned instead of delta [changed by LoRA] parameters and find that a 10% reduction can lead to drastically decreased performance (even to 0.0)" But, my base model here is not actually the base model. Besides its bizzare size, it contains aspects of Alpaca... but not on every layer! Thus, confusion reigned as dares_ties saw some Alpaca formatting as being delta weights and others as being part of the base model. It fragged the poor thing's little network something fierce.

This also explains why the version of Imabe-20b-DARE that came out as the release was the iteration it was. The release Iambe-DARE has my BigLlama as the base model, and the other two had roleplaying SFTed models as the base. Looks like I have another version of Iambe to produce, this time with a proper base.

Recipe

merge_method: dare_ties

  • base_model: athirdpath/LilLlama-11b

  • model: athirdpath/U-Amethyst-11B

    weight: 0.39 / density: 0.55

  • model: athirdpath/PsyMedRP-v1-11B

    weight: 0.20 / density: 0.45

  • model: thirdpath/CleverGirl-11b

    weight: 0.41 / density: 0.55

int8_mask: true

dtype: bfloat16

Runs of athirdpath Baubo-11b-FAILURE-WITH-EXPLANATION on huggingface.co

273
Total runs
0
24-hour runs
1
3-day runs
24
7-day runs
164
30-day runs

More Information About Baubo-11b-FAILURE-WITH-EXPLANATION huggingface.co Model

More Baubo-11b-FAILURE-WITH-EXPLANATION license Visit here:

https://choosealicense.com/licenses/cc-by-nc-4.0

Baubo-11b-FAILURE-WITH-EXPLANATION huggingface.co

Baubo-11b-FAILURE-WITH-EXPLANATION huggingface.co is an AI model on huggingface.co that provides Baubo-11b-FAILURE-WITH-EXPLANATION's model effect (), which can be used instantly with this athirdpath Baubo-11b-FAILURE-WITH-EXPLANATION model. huggingface.co supports a free trial of the Baubo-11b-FAILURE-WITH-EXPLANATION model, and also provides paid use of the Baubo-11b-FAILURE-WITH-EXPLANATION. Support call Baubo-11b-FAILURE-WITH-EXPLANATION model through api, including Node.js, Python, http.

Baubo-11b-FAILURE-WITH-EXPLANATION huggingface.co Url

https://huggingface.co/athirdpath/Baubo-11b-FAILURE-WITH-EXPLANATION

athirdpath Baubo-11b-FAILURE-WITH-EXPLANATION online free

Baubo-11b-FAILURE-WITH-EXPLANATION huggingface.co is an online trial and call api platform, which integrates Baubo-11b-FAILURE-WITH-EXPLANATION's modeling effects, including api services, and provides a free online trial of Baubo-11b-FAILURE-WITH-EXPLANATION, you can try Baubo-11b-FAILURE-WITH-EXPLANATION online for free by clicking the link below.

athirdpath Baubo-11b-FAILURE-WITH-EXPLANATION online free url in huggingface.co:

https://huggingface.co/athirdpath/Baubo-11b-FAILURE-WITH-EXPLANATION

Baubo-11b-FAILURE-WITH-EXPLANATION install

Baubo-11b-FAILURE-WITH-EXPLANATION is an open source model from GitHub that offers a free installation service, and any user can find Baubo-11b-FAILURE-WITH-EXPLANATION on GitHub to install. At the same time, huggingface.co provides the effect of Baubo-11b-FAILURE-WITH-EXPLANATION install, users can directly use Baubo-11b-FAILURE-WITH-EXPLANATION installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Baubo-11b-FAILURE-WITH-EXPLANATION install url in huggingface.co:

https://huggingface.co/athirdpath/Baubo-11b-FAILURE-WITH-EXPLANATION

Url of Baubo-11b-FAILURE-WITH-EXPLANATION

Baubo-11b-FAILURE-WITH-EXPLANATION huggingface.co Url

Provider of Baubo-11b-FAILURE-WITH-EXPLANATION huggingface.co

athirdpath
ORGANIZATIONS

Other API from athirdpath

huggingface.co

Total runs: 64
Run Growth: -40
Growth Rate: -62.50%
Updated:November 28 2023
huggingface.co

Total runs: 18
Run Growth: 0
Growth Rate: 0.00%
Updated:August 16 2024
huggingface.co

Total runs: 16
Run Growth: 0
Growth Rate: 0.00%
Updated:September 28 2024
huggingface.co

Total runs: 11
Run Growth: 2
Growth Rate: 18.18%
Updated:December 13 2023
huggingface.co

Total runs: 10
Run Growth: -1
Growth Rate: -11.11%
Updated:September 08 2024
huggingface.co

Total runs: 9
Run Growth: 0
Growth Rate: 0.00%
Updated:August 17 2024