Josephgflowers / tinyllama-730M-test

huggingface.co
Total runs: 52
24-hour runs: 0
7-day runs: 1
30-day runs: -32
Model's Last Updated: March 09 2024
text-generation

Introduction of tinyllama-730M-test

Model Details of tinyllama-730M-test

I cut my TinyLlama 1.1B cinder v 2 down from 22 layers to 14. At 14 there was no coherent text but there were emerging ideas of a response. 1000 steps on step-by-step dataset. 6000 on Reason-with-cinder. The loss was still over 1 and the learning rate was still over 4. This model needs significat training. I am putting it up as a base model that needs work. If you continue training please let me know on the tinyllama discord, I have some interesting plans for this model.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 29.55
AI2 Reasoning Challenge (25-Shot) 25.09
HellaSwag (10-Shot) 33.82
MMLU (5-Shot) 24.43
TruthfulQA (0-shot) 42.90
Winogrande (5-shot) 51.07
GSM8k (5-shot) 0.00

Runs of Josephgflowers tinyllama-730M-test on huggingface.co

52
Total runs
0
24-hour runs
1
3-day runs
1
7-day runs
-32
30-day runs

More Information About tinyllama-730M-test huggingface.co Model

More tinyllama-730M-test license Visit here:

https://choosealicense.com/licenses/mit

tinyllama-730M-test huggingface.co

tinyllama-730M-test huggingface.co is an AI model on huggingface.co that provides tinyllama-730M-test's model effect (), which can be used instantly with this Josephgflowers tinyllama-730M-test model. huggingface.co supports a free trial of the tinyllama-730M-test model, and also provides paid use of the tinyllama-730M-test. Support call tinyllama-730M-test model through api, including Node.js, Python, http.

Josephgflowers tinyllama-730M-test online free

tinyllama-730M-test huggingface.co is an online trial and call api platform, which integrates tinyllama-730M-test's modeling effects, including api services, and provides a free online trial of tinyllama-730M-test, you can try tinyllama-730M-test online for free by clicking the link below.

Josephgflowers tinyllama-730M-test online free url in huggingface.co:

https://huggingface.co/Josephgflowers/tinyllama-730M-test

tinyllama-730M-test install

tinyllama-730M-test is an open source model from GitHub that offers a free installation service, and any user can find tinyllama-730M-test on GitHub to install. At the same time, huggingface.co provides the effect of tinyllama-730M-test install, users can directly use tinyllama-730M-test installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

tinyllama-730M-test install url in huggingface.co:

https://huggingface.co/Josephgflowers/tinyllama-730M-test

Url of tinyllama-730M-test

Provider of tinyllama-730M-test huggingface.co

Josephgflowers
ORGANIZATIONS

Other API from Josephgflowers