A 24 token prefix was finetuned over 3.7m new tokens of a FLAN task mixture, with the start of each example cut off if it was too large to fit within a 512 token context.
The model reaches a train ppl of 5.95 and an eval ppl of 4.50.
Example COT (Chain-of-thought) Prompt:
Q: Answer the following yes/no question by reasoning step-by-step. Could a dandelion suffer from hepatitis?
A: Hepatitis only affects organisms with livers. Dandelions don’t have a liver. The answer is no.
Q: Answer the following yes/no question by reasoning step-by-step. Can you write a whole Haiku in a single tweet?
A: A haiku is a japanese three-line poem. That is short enough to fit in 280 characters. The answer is yes.
Q: Answer the following yes/no question by reasoning step-by-step. Can you reach space with a Cessna?
A:
> Cessna is a type of aircraft. It has a wingspan of 3.6 meters (3.6m). The answer is no.
(Completed with Contrastive Sampling, top_k: 4, penalty_alpha: 0.6)
Runs of crumb ptune-FLAN-OPT-2.7b on huggingface.co
10
Total runs
0
24-hour runs
2
3-day runs
-1
7-day runs
3
30-day runs
More Information About ptune-FLAN-OPT-2.7b huggingface.co Model
ptune-FLAN-OPT-2.7b huggingface.co
ptune-FLAN-OPT-2.7b huggingface.co is an AI model on huggingface.co that provides ptune-FLAN-OPT-2.7b's model effect (), which can be used instantly with this crumb ptune-FLAN-OPT-2.7b model. huggingface.co supports a free trial of the ptune-FLAN-OPT-2.7b model, and also provides paid use of the ptune-FLAN-OPT-2.7b. Support call ptune-FLAN-OPT-2.7b model through api, including Node.js, Python, http.
ptune-FLAN-OPT-2.7b huggingface.co is an online trial and call api platform, which integrates ptune-FLAN-OPT-2.7b's modeling effects, including api services, and provides a free online trial of ptune-FLAN-OPT-2.7b, you can try ptune-FLAN-OPT-2.7b online for free by clicking the link below.
crumb ptune-FLAN-OPT-2.7b online free url in huggingface.co:
ptune-FLAN-OPT-2.7b is an open source model from GitHub that offers a free installation service, and any user can find ptune-FLAN-OPT-2.7b on GitHub to install. At the same time, huggingface.co provides the effect of ptune-FLAN-OPT-2.7b install, users can directly use ptune-FLAN-OPT-2.7b installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
ptune-FLAN-OPT-2.7b install url in huggingface.co: