Total runs:
333.7K
Run Growth:
0
Growth Rate:
0.00%
Sponsored by
YouArt
neuralmagic / bge-large-en-v1.5-quant
Model's Last Updated: November 14 2023
feature-extraction
Introduction of bge-large-en-v1.5-quant
Model Details of bge-large-en-v1.5-quant
bge-large-en-v1.5-quant
DeepSparse is able to improve latency performance on a 10 core laptop by 4.8X and up to 3.5X on a 16 core AWS instance.
Usage
This is the quantized (INT8) ONNX variant of the bge-large-en-v1.5 embeddings model accelerated with Sparsify for quantization and DeepSparseSentenceTransformers for inference.
pip install -U deepsparse-nightly[sentence_transformers]
from deepsparse.sentence_transformers import DeepSparseSentenceTransformer
model = DeepSparseSentenceTransformer('neuralmagic/bge-large-en-v1.5-quant', export=False)
# Our sentences we like to encode
sentences = ['This framework generates embeddings for each input sentence',
'Sentences are passed as a list of string.',
'The quick brown fox jumps over the lazy dog.']
# Sentences are encoded by calling model.encode()
embeddings = model.encode(sentences)
# Print the embeddings
for sentence, embedding in zip(sentences, embeddings):
print("Sentence:", sentence)
print("Embedding:", embedding.shape)
print("")
For general questions on these models and sparsification methods, reach out to the engineering team on our community Slack .
Runs of neuralmagic bge-large-en-v1.5-quant on huggingface.co
48.2K
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About bge-large-en-v1.5-quant huggingface.co Model
Url of bge-large-en-v1.5-quant
bge-large-en-v1.5-quant huggingface.co Url
Provider of bge-large-en-v1.5-quant huggingface.co
Other API from neuralmagic
Updated:March 26 2025
Total runs:
210.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
163.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
111.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
105.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
83.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
62.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
58.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
29.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
21.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
16.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
11.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
10.9K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
7.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
6.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
5.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
4.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.7K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.4K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.8K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.6K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.5K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.3K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.2K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.1K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1.0K
Run Growth:
0
Growth Rate:
0.00%
Total runs:
959
Run Growth:
0
Growth Rate:
0.00%
Total runs:
949
Run Growth:
0
Growth Rate:
0.00%
Total runs:
915
Run Growth:
0
Growth Rate:
0.00%
Total runs:
906
Run Growth:
0
Growth Rate:
0.00%
Total runs:
901
Run Growth:
0
Growth Rate:
0.00%
Total runs:
896
Run Growth:
0
Growth Rate:
0.00%
Total runs:
875
Run Growth:
0
Growth Rate:
0.00%
Total runs:
774
Run Growth:
0
Growth Rate:
0.00%
Total runs:
759
Run Growth:
0
Growth Rate:
0.00%
Total runs:
709
Run Growth:
0
Growth Rate:
0.00%
Total runs:
667
Run Growth:
0
Growth Rate:
0.00%
Total runs:
647
Run Growth:
0
Growth Rate:
0.00%
Total runs:
647
Run Growth:
0
Growth Rate:
0.00%
Total runs:
628
Run Growth:
0
Growth Rate:
0.00%
Total runs:
617
Run Growth:
0
Growth Rate:
0.00%
Total runs:
597
Run Growth:
0
Growth Rate:
0.00%
Total runs:
592
Run Growth:
0
Growth Rate:
0.00%
Total runs:
567
Run Growth:
0
Growth Rate:
0.00%
Total runs:
546
Run Growth:
0
Growth Rate:
0.00%
Total runs:
545
Run Growth:
0
Growth Rate:
0.00%
Total runs:
543
Run Growth:
0
Growth Rate:
0.00%
Total runs:
525
Run Growth:
0
Growth Rate:
0.00%
Total runs:
524
Run Growth:
0
Growth Rate:
0.00%
Total runs:
482
Run Growth:
0
Growth Rate:
0.00%
Total runs:
466
Run Growth:
0
Growth Rate:
0.00%
Total runs:
465
Run Growth:
0
Growth Rate:
0.00%
Total runs:
456
Run Growth:
0
Growth Rate:
0.00%
Total runs:
443
Run Growth:
0
Growth Rate:
0.00%
Total runs:
438
Run Growth:
0
Growth Rate:
0.00%
Total runs:
362
Run Growth:
0
Growth Rate:
0.00%
Total runs:
351
Run Growth:
0
Growth Rate:
0.00%
Total runs:
348
Run Growth:
0
Growth Rate:
0.00%
Total runs:
346
Run Growth:
0
Growth Rate:
0.00%
Total runs:
344
Run Growth:
0
Growth Rate:
0.00%
Total runs:
334
Run Growth:
0
Growth Rate:
0.00%
Total runs:
332
Run Growth:
0
Growth Rate:
0.00%
Total runs:
282
Run Growth:
0
Growth Rate:
0.00%
Total runs:
269
Run Growth:
0
Growth Rate:
0.00%
Total runs:
257
Run Growth:
0
Growth Rate:
0.00%
Total runs:
245
Run Growth:
0
Growth Rate:
0.00%
Total runs:
234
Run Growth:
0
Growth Rate:
0.00%
Total runs:
203
Run Growth:
0
Growth Rate:
0.00%
Total runs:
199
Run Growth:
0
Growth Rate:
0.00%
Total runs:
194
Run Growth:
0
Growth Rate:
0.00%
Total runs:
190
Run Growth:
0
Growth Rate:
0.00%
Total runs:
182
Run Growth:
0
Growth Rate:
0.00%
Total runs:
181
Run Growth:
0
Growth Rate:
0.00%
Total runs:
178
Run Growth:
0
Growth Rate:
0.00%