The
vitalik-13b.csv
file contains the QA set required for the fine-tuning. Each QA pair length is limited to 80 words to fit into
llama.cpp
context length of 128 tokens. The
convert.py
script converts the CSV file into QAs in the llama2 chat template.
python convert.py
It generates a
vitalik-13b.txt
file, which can now be used in fine-tuning.
Fine-tuning steps
Clone this repo into the
llama.cpp/models/
folder.
cd llama.cpp/models
git clone https://huggingface.co/gaianet/vitalik.eth-13b
Move the Llama2-13b-chat base model to the folder.
cd vitalik-13b
mv path/to/llama-2-13b-chat.Q5_K_M.gguf .
From the
llama.cpp/models/vitalik-13b
folder run the following command.
vitalik.eth-13b huggingface.co is an AI model on huggingface.co that provides vitalik.eth-13b's model effect (), which can be used instantly with this gaianet vitalik.eth-13b model. huggingface.co supports a free trial of the vitalik.eth-13b model, and also provides paid use of the vitalik.eth-13b. Support call vitalik.eth-13b model through api, including Node.js, Python, http.
vitalik.eth-13b huggingface.co is an online trial and call api platform, which integrates vitalik.eth-13b's modeling effects, including api services, and provides a free online trial of vitalik.eth-13b, you can try vitalik.eth-13b online for free by clicking the link below.
gaianet vitalik.eth-13b online free url in huggingface.co:
vitalik.eth-13b is an open source model from GitHub that offers a free installation service, and any user can find vitalik.eth-13b on GitHub to install. At the same time, huggingface.co provides the effect of vitalik.eth-13b install, users can directly use vitalik.eth-13b installed effect in huggingface.co for debugging and trial. It also supports api for free installation.