This model is a
60.00% smaller
version of
intfloat/multilingual-e5-base
optimized for
Arabic
language via vocabulary size reduction using the
trimming
method.
This trimmed model should perform similarly to the original model with only 32,768 tokens and a much smaller memory footprint. However, it may not perform well for other languages as tokens not commonly used in the selected languages were removed from the vocabulary.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("alphaedge-ai/multilingual-e5-base-arb-32768")
# Run inference with queries and documents
query = "My query in Arabic"
documents = [
"Chunk in Arabic",
"Chunk in Arabic",
"Chunk in Arabic",
]
query_embeddings = model.encode_query(query)
document_embeddings = model.encode_document(documents)
print(query_embeddings.shape, document_embeddings.shape)
# Compute similarities to determine a ranking
similarities = model.similarity(query_embeddings, document_embeddings)
print(similarities)
Citations
Multilingual E5
@article{wang2024multilingual,
title={Multilingual E5 Text Embeddings: A Technical Report},
author={Wang, Liang and Yang, Nan and Huang, Xiaolong and Yang, Linjun and Majumder, Rangan and Wei, Furu},
journal={arXiv preprint arXiv:2402.05672},
year={2024}
}
Trimming blog post
@misc{hf_blogpost_trimming,
title={Introduction to Trimming},
author={Loïck BOURDOIS and Tom AARSEN and Bram VANROY and Christopher AKIKI and Woojun JUNG and Manuel ROMERO and Prithiv SAKTHI},
year={2026},
url={https://huggingface.co/blog/lbourdois/introduction-to-trimming},
}
Runs of alphaedge-ai multilingual-e5-base-arb-32768 on huggingface.co
100
Total runs
1
24-hour runs
0
3-day runs
12
7-day runs
26
30-day runs
More Information About multilingual-e5-base-arb-32768 huggingface.co Model
More multilingual-e5-base-arb-32768 license Visit here:
multilingual-e5-base-arb-32768 huggingface.co is an AI model on huggingface.co that provides multilingual-e5-base-arb-32768's model effect (), which can be used instantly with this alphaedge-ai multilingual-e5-base-arb-32768 model. huggingface.co supports a free trial of the multilingual-e5-base-arb-32768 model, and also provides paid use of the multilingual-e5-base-arb-32768. Support call multilingual-e5-base-arb-32768 model through api, including Node.js, Python, http.
multilingual-e5-base-arb-32768 huggingface.co is an online trial and call api platform, which integrates multilingual-e5-base-arb-32768's modeling effects, including api services, and provides a free online trial of multilingual-e5-base-arb-32768, you can try multilingual-e5-base-arb-32768 online for free by clicking the link below.
alphaedge-ai multilingual-e5-base-arb-32768 online free url in huggingface.co:
multilingual-e5-base-arb-32768 is an open source model from GitHub that offers a free installation service, and any user can find multilingual-e5-base-arb-32768 on GitHub to install. At the same time, huggingface.co provides the effect of multilingual-e5-base-arb-32768 install, users can directly use multilingual-e5-base-arb-32768 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
multilingual-e5-base-arb-32768 install url in huggingface.co: