Sponsored by
APIMaster
project-baize / baize-lora-13B
Model's Last Updated: April 03 2023
Introduction of baize-lora-13B
Model Details of baize-lora-13B
license: cc-by-nc-4.0
What's Baize?
Baize is an open-source chat model fine-tuned with LoRA . It uses 100k dialogs generated by letting ChatGPT chat with itself. We also use Alpaca's data to improve its performance. This repo contains 13B model.
Why it's called Baize?
Baize (白泽) is a mythical creature in Chinese folklore, who speaks human languages and knows everything. This is exactly what we expect from a chat model.
Training Parameters
- Base Model: LLaMA-13B
- Training Epoch: 1
- Batch Size: 64
- Maximum Input Length: 512
- Learning Rate: 1e-4
- LoRA Rank: 8
- Updated Modules: All Linears
Training Dataset
- Standford Alpaca (51,942)
- Quora Dialogs (54,456):
- StackOverflow Dialogs (57,046)
More details can be found in the Baize GitHub
Runs of project-baize baize-lora-13B on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About baize-lora-13B huggingface.co Model
Url of baize-lora-13B
baize-lora-13B huggingface.co Url
Provider of baize-lora-13B huggingface.co
Other API from project-baize
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%