Total runs:
8.7K
Run Growth:
496
Growth Rate:
5.68%
Sponsored by
PostMcpAi
abacusai / Giraffe-v2-70b-32k
Model's Last Updated: January 17 2024
text-generation
Introduction of Giraffe-v2-70b-32k
Model Details of Giraffe-v2-70b-32k
Model Details
Model Description
We have followed up on our previous training runs related to extending the context length of Llama models. The associated github repository
https://github.com/abacusai/long-context
has some basic details on our approach and metrics. We have also published a paper on arXiv that covers our experiments and analysis a lot more comprehensively.
http://arxiv.org/abs/2308.10882
- Developed by: Abacus.AI
- Model type: Transformer based autoregressive causal language model
- License: Llama 2 Community License: https://github.com/facebookresearch/llama/blob/main/LICENSE
- Finetuned from model: Llama V2 70B
Usage
To use this model at longer lengths the model needs to be patched to interpolate the longer context
lengths. It will not work if it is simply loaded with the
AutoModel
framework of
transformers
.
For full details and usage see:
https://github.com/abacusai/Long-Context
The evaluation section has detailed code for how to load and patch the model for inference (or further fine-tuning).
Note in particular the
max_position_embeddings
is not relevant since the patched module dynamically reallocates
the position buffers as required.
The tokenizer corresponding to this model is https://huggingface.co/abacusai/Giraffe-v1-Tokenizer .
Using the code in the repository you can load this model with the following code:
from models import load_model, load_tokenizer
tokenizer = load_tokenizer()
model = load_model('abacusai/Giraffe-v2-70b-32k', scale=8)
Runs of abacusai Giraffe-v2-70b-32k on huggingface.co
125
Total runs
0
24-hour runs
2
3-day runs
24
7-day runs
35
30-day runs
More Information About Giraffe-v2-70b-32k huggingface.co Model
Url of Giraffe-v2-70b-32k
Giraffe-v2-70b-32k huggingface.co Url
Provider of Giraffe-v2-70b-32k huggingface.co
Other API from abacusai
Updated:February 22 2024
Total runs:
8.7K
Run Growth:
225
Growth Rate:
2.58%
Total runs:
8.6K
Run Growth:
519
Growth Rate:
6.02%
Total runs:
8.6K
Run Growth:
323
Growth Rate:
3.75%
Total runs:
8.5K
Run Growth:
372
Growth Rate:
4.38%
Total runs:
8.4K
Run Growth:
315
Growth Rate:
3.73%
Total runs:
300
Run Growth:
215
Growth Rate:
70.49%
Total runs:
154
Run Growth:
67
Growth Rate:
43.51%
Total runs:
123
Run Growth:
93
Growth Rate:
75.61%
Total runs:
123
Run Growth:
56
Growth Rate:
45.53%
Total runs:
103
Run Growth:
24
Growth Rate:
23.30%
Total runs:
86
Run Growth:
24
Growth Rate:
27.91%
Total runs:
86
Run Growth:
20
Growth Rate:
23.26%
Total runs:
78
Run Growth:
29
Growth Rate:
37.18%
Total runs:
75
Run Growth:
25
Growth Rate:
33.33%
Total runs:
74
Run Growth:
23
Growth Rate:
31.08%
Total runs:
71
Run Growth:
24
Growth Rate:
33.80%
Total runs:
69
Run Growth:
22
Growth Rate:
31.88%
Total runs:
68
Run Growth:
19
Growth Rate:
27.94%
Total runs:
44
Run Growth:
15
Growth Rate:
34.09%
Total runs:
37
Run Growth:
18
Growth Rate:
48.65%
Total runs:
34
Run Growth:
20
Growth Rate:
58.82%
Total runs:
30
Run Growth:
15
Growth Rate:
50.00%
Total runs:
27
Run Growth:
15
Growth Rate:
55.56%
Total runs:
25
Run Growth:
17
Growth Rate:
68.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%