Fairseq-dense 2.7B-Janeway is a finetune created using Fairseq's MoE dense model.
Training data
The training data contains around 2210 ebooks, mostly in the sci-fi and fantasy genres. The dataset is identical as dataset used by GPT-Neo-2.7B-Janeway.
Some parts of the dataset have been prepended using the following text:
[Genre: <genre1>,<genre2>]
How to use
You can use this model directly with a pipeline for text generation. This example generates a different sequence each time it's run:
>>> from transformers import pipeline
>>> generator = pipeline('text-generation', model='KoboldAI/fairseq-dense-2.7B-Janeway')
>>> generator("Welcome Captain Janeway, I apologize for the delay.", do_sample=True, min_length=50)
[{'generated_text': 'Welcome Captain Janeway, I apologize for the delay."\nIt's all right," Janeway said. "I'm certain that you're doing your best to keep me informed of what\'s going on."'}]
Limitations and Biases
Based on known problems with NLP technology, potential relevant factors include bias (gender, profession, race and religion).
BibTeX entry and citation info
Artetxe et al. (2021): Efficient Large Scale Language Modeling with Mixtures of Experts
Runs of KoboldAI fairseq-dense-2.7B-Janeway on huggingface.co
44
Total runs
2
24-hour runs
5
3-day runs
7
7-day runs
21
30-day runs
More Information About fairseq-dense-2.7B-Janeway huggingface.co Model
More fairseq-dense-2.7B-Janeway license Visit here:
fairseq-dense-2.7B-Janeway huggingface.co is an AI model on huggingface.co that provides fairseq-dense-2.7B-Janeway's model effect (), which can be used instantly with this KoboldAI fairseq-dense-2.7B-Janeway model. huggingface.co supports a free trial of the fairseq-dense-2.7B-Janeway model, and also provides paid use of the fairseq-dense-2.7B-Janeway. Support call fairseq-dense-2.7B-Janeway model through api, including Node.js, Python, http.
fairseq-dense-2.7B-Janeway huggingface.co is an online trial and call api platform, which integrates fairseq-dense-2.7B-Janeway's modeling effects, including api services, and provides a free online trial of fairseq-dense-2.7B-Janeway, you can try fairseq-dense-2.7B-Janeway online for free by clicking the link below.
KoboldAI fairseq-dense-2.7B-Janeway online free url in huggingface.co:
fairseq-dense-2.7B-Janeway is an open source model from GitHub that offers a free installation service, and any user can find fairseq-dense-2.7B-Janeway on GitHub to install. At the same time, huggingface.co provides the effect of fairseq-dense-2.7B-Janeway install, users can directly use fairseq-dense-2.7B-Janeway installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
fairseq-dense-2.7B-Janeway install url in huggingface.co: