leafspark / wikichat-v2

huggingface.co
Total runs: 67
24-hour runs: 0
7-day runs: -9
30-day runs: 1
Model's Last Updated: May 09 2024
text-generation

Introduction of wikichat-v2

Model Details of wikichat-v2

WikiChat-v0.2

Training in progress model to have conversations.

The GGUFs uploaded are full FP32 precision.

Using OpenOrca GPT-4 data + cosmopedia for some extra data + dolly15k for instruct

Model Details:
  • 83.59M parameters (83591800)
  • 8 attention heads
  • 40 layers
  • 384 embeddings size
  • 4096/8192/16384 context (please use 2/4x RoPE scaling, may train a 16k finetuned version later)
  • Batch size 16
  • llama.cpp (train-text-from-scratch)
Prompt Format (Alpaca):
Instruction: {system}
Input: {prompt}
Response: {response}

Please structure your prompts in an instruct format for maximum performance.

Training Details:
  • 1x RTX 3070 8GB (Infrencing speed: 80tok/s, full GPU offload)
  • 1x Ryzen 3 3700x
  • 96gb RAM
  • 10 iterations
  • Loss Target = 2.5 to 3.0
  • Approx 480 samples/1M train tokens (>0.0001 epoches)
  • Training data = Refer to OpenOrca page
Notes:

The model isn't ready yet; this is to test tokenization of OpenOrca and a balance between training speed and model size

Example output:
User: What is the square root of 4?
Assistant: The square root of 4 is 2.

Runs of leafspark wikichat-v2 on huggingface.co

67
Total runs
0
24-hour runs
0
3-day runs
-9
7-day runs
1
30-day runs

More Information About wikichat-v2 huggingface.co Model

More wikichat-v2 license Visit here:

https://choosealicense.com/licenses/apache-2.0

wikichat-v2 huggingface.co

wikichat-v2 huggingface.co is an AI model on huggingface.co that provides wikichat-v2's model effect (), which can be used instantly with this leafspark wikichat-v2 model. huggingface.co supports a free trial of the wikichat-v2 model, and also provides paid use of the wikichat-v2. Support call wikichat-v2 model through api, including Node.js, Python, http.

leafspark wikichat-v2 online free

wikichat-v2 huggingface.co is an online trial and call api platform, which integrates wikichat-v2's modeling effects, including api services, and provides a free online trial of wikichat-v2, you can try wikichat-v2 online for free by clicking the link below.

leafspark wikichat-v2 online free url in huggingface.co:

https://huggingface.co/leafspark/wikichat-v2

wikichat-v2 install

wikichat-v2 is an open source model from GitHub that offers a free installation service, and any user can find wikichat-v2 on GitHub to install. At the same time, huggingface.co provides the effect of wikichat-v2 install, users can directly use wikichat-v2 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

wikichat-v2 install url in huggingface.co:

https://huggingface.co/leafspark/wikichat-v2

Url of wikichat-v2

wikichat-v2 huggingface.co Url

Provider of wikichat-v2 huggingface.co

leafspark
ORGANIZATIONS

Other API from leafspark

huggingface.co

Total runs: 159
Run Growth: -492
Growth Rate: -309.43%
Updated:September 20 2024
huggingface.co

Total runs: 4
Run Growth: 2
Growth Rate: 50.00%
Updated:July 25 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:April 21 2024
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:July 14 2024