nomic-ai / gpt4all-j-lora

huggingface.co
Total runs: 0
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: April 14 2023
text-generation

Introduction of gpt4all-j-lora

Model Details of gpt4all-j-lora

Model Card for GPT4All-J-LoRA

An Apache-2 licensed chatbot trained over a massive curated corpus of assistant interactions including word problems, multi-turn dialogue, code, poems, songs, and stories.

Model Details
Model Description

This model has been finetuned from GPT-J

  • Developed by: Nomic AI
  • Model Type: A finetuned GPT-J model on assistant style interaction data
  • Language(s) (NLP): English
  • License: Apache-2
  • Finetuned from model [optional]: GPT-J
Model Sources [optional]
Training Procedure

GPT4All is made possible by our compute partner Paperspace .

Trained on a DGX cluster with 8 A100 80GB GPUs for ~12 hours. Using Deepspeed + Accelerate, we use a global batch size of 32 with a learning rate of 2e-5 using LoRA. More information can be found in the repo.

Results

Results on common sense reasoning benchmarks

 Model                     BoolQ       PIQA     HellaSwag   WinoGrande    ARC-e      ARC-c       OBQA
  ----------------------- ---------- ---------- ----------- ------------ ---------- ---------- ----------
  GPT4All-J 6.7B             73.4       74.8       63.4         64.7        54.9       36.0       40.2
  GPT4All-J Lora 6.7B        68.6       75.8       66.2         63.5        56.4       35.7       40.2
  GPT4All LLaMa Lora 7B      73.1       77.6       72.1         67.8        51.1       40.4       40.2
  Dolly 6B                   68.8       77.3       67.6         63.9        62.9       38.7       41.2
  Dolly 12B                  56.7       75.4       71.0         62.2       *64.6*      38.5        40.4
  Alpaca 7B                  73.9       77.2       73.9         66.1        59.8       43.3       43.4
  Alpaca Lora 7B            *74.3*     *79.3*     *74.0*       *68.8*       56.6      *43.9*     *42.6*
  GPT-J 6.7B                 65.4       76.2       66.2         64.1        62.2       36.6       38.2
  LLaMa 7B                   73.1       77.4       73.0         66.9        52.5       41.4       42.4
  Pythia 6.7B                63.5       76.3       64.0         61.1        61.3       35.2       37.2
  Pythia 12B                 67.7       76.6       67.3         63.8        63.9       34.8        38

Runs of nomic-ai gpt4all-j-lora on huggingface.co

0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About gpt4all-j-lora huggingface.co Model

More gpt4all-j-lora license Visit here:

https://choosealicense.com/licenses/apache-2.0

gpt4all-j-lora huggingface.co

gpt4all-j-lora huggingface.co is an AI model on huggingface.co that provides gpt4all-j-lora's model effect (), which can be used instantly with this nomic-ai gpt4all-j-lora model. huggingface.co supports a free trial of the gpt4all-j-lora model, and also provides paid use of the gpt4all-j-lora. Support call gpt4all-j-lora model through api, including Node.js, Python, http.

gpt4all-j-lora huggingface.co Url

https://huggingface.co/nomic-ai/gpt4all-j-lora

nomic-ai gpt4all-j-lora online free

gpt4all-j-lora huggingface.co is an online trial and call api platform, which integrates gpt4all-j-lora's modeling effects, including api services, and provides a free online trial of gpt4all-j-lora, you can try gpt4all-j-lora online for free by clicking the link below.

nomic-ai gpt4all-j-lora online free url in huggingface.co:

https://huggingface.co/nomic-ai/gpt4all-j-lora

gpt4all-j-lora install

gpt4all-j-lora is an open source model from GitHub that offers a free installation service, and any user can find gpt4all-j-lora on GitHub to install. At the same time, huggingface.co provides the effect of gpt4all-j-lora install, users can directly use gpt4all-j-lora installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

gpt4all-j-lora install url in huggingface.co:

https://huggingface.co/nomic-ai/gpt4all-j-lora

Url of gpt4all-j-lora

gpt4all-j-lora huggingface.co Url

Provider of gpt4all-j-lora huggingface.co

nomic-ai
ORGANIZATIONS

Other API from nomic-ai

huggingface.co

Total runs: 2.0K
Run Growth: -110
Growth Rate: -5.42%
Updated:April 08 2024
huggingface.co

Total runs: 833
Run Growth: -253
Growth Rate: -30.37%
Updated:May 25 2023