Llama2 13B finetuned to process longer (32K) contexts using interpolation and then further instruct finetuned with ShareGPT and Orca-Chat.
Model Details
Model Description
This is next version of the model trained and evaluated as part of the experiments described in the repo
http://github.com/abacusai/Long-Context
. This version
was trained with a scaling factor of 8 and shows better reasoning and math abilites on State of the Art benchmarks
Since the model is instruct finetuned it can also be directly used for various prompted tasks. We have tested
it on open book question answering using the long context to supply search results.
Bias, Risks, and Limitations
The model has not been evaluated for safety and is only intended for research and experiments.
Runs of abacusai Giraffe-13b-32k-v3 on huggingface.co
85
Total runs
0
24-hour runs
0
3-day runs
6
7-day runs
30
30-day runs
More Information About Giraffe-13b-32k-v3 huggingface.co Model
Giraffe-13b-32k-v3 huggingface.co is an AI model on huggingface.co that provides Giraffe-13b-32k-v3's model effect (), which can be used instantly with this abacusai Giraffe-13b-32k-v3 model. huggingface.co supports a free trial of the Giraffe-13b-32k-v3 model, and also provides paid use of the Giraffe-13b-32k-v3. Support call Giraffe-13b-32k-v3 model through api, including Node.js, Python, http.
Giraffe-13b-32k-v3 huggingface.co is an online trial and call api platform, which integrates Giraffe-13b-32k-v3's modeling effects, including api services, and provides a free online trial of Giraffe-13b-32k-v3, you can try Giraffe-13b-32k-v3 online for free by clicking the link below.
abacusai Giraffe-13b-32k-v3 online free url in huggingface.co:
Giraffe-13b-32k-v3 is an open source model from GitHub that offers a free installation service, and any user can find Giraffe-13b-32k-v3 on GitHub to install. At the same time, huggingface.co provides the effect of Giraffe-13b-32k-v3 install, users can directly use Giraffe-13b-32k-v3 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.