Signal A+B on a 7M-pair subsample (3 epochs). Best ablation; the FULL model is this recipe scaled to the full pool.
A 149M-parameter ModernBERT-base scientific document embedder trained with citation-context sentences as the primary contrastive signal. Part of the
SciEmbed
release (paper under double-blind review; author info omitted).
Usage
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("anon-nlp/sciembed-ctx")
emb = model.encode(["citation-context supervision for scientific embeddings"],
normalize_embeddings=True)
Context length:
512 tokens
Pooling:
mean ·
Output dim:
768 (Matryoshka-truncatable to 512/256/128)
License:
MIT
SciRepEval (4-category macro)
Classif.
Regr.
Prox.
Search
Overall
75.5
28.3
80.9
82.5
66.8 ± 0.02
Citation
See the repository README. Paper:
SciEmbed: Citation-Context Supervision for Scientific Document Embeddings
(under review).
Runs of anon-nlp sciembed-ctx on huggingface.co
97
Total runs
-15
24-hour runs
1
3-day runs
9
7-day runs
14
30-day runs
More Information About sciembed-ctx huggingface.co Model
sciembed-ctx huggingface.co is an AI model on huggingface.co that provides sciembed-ctx's model effect (), which can be used instantly with this anon-nlp sciembed-ctx model. huggingface.co supports a free trial of the sciembed-ctx model, and also provides paid use of the sciembed-ctx. Support call sciembed-ctx model through api, including Node.js, Python, http.
sciembed-ctx huggingface.co is an online trial and call api platform, which integrates sciembed-ctx's modeling effects, including api services, and provides a free online trial of sciembed-ctx, you can try sciembed-ctx online for free by clicking the link below.
anon-nlp sciembed-ctx online free url in huggingface.co:
sciembed-ctx is an open source model from GitHub that offers a free installation service, and any user can find sciembed-ctx on GitHub to install. At the same time, huggingface.co provides the effect of sciembed-ctx install, users can directly use sciembed-ctx installed effect in huggingface.co for debugging and trial. It also supports api for free installation.