The model is initialized from the
dbmdz/bert-base-german-uncased
checkpoint and fine-tuned on 10M triples via pairwise softmax cross-entropy loss over the computed scores of the positive and negative passages associated to a query. It was trained on a single Tesla A100 GPU with 40GBs of memory during 200k steps with 10% of warmup steps using a batch size of 96 and the AdamW optimizer with a constant learning rate of 3e-06. Total training time was around 12 hours.
Data
The model is fine-tuned on the German version of the
mMARCO
dataset, a multi-lingual machine-translated version of the MS MARCO dataset.
The triples are sampled from the ~39.8M triples of
triples.train.small.tsv
Evaluation
The model is evaluated on the smaller development set of mMARCO-es, which consists of 6,980 queries for a corpus of 8.8M candidate passages. We report the mean reciprocal rank (MRR) and recall at various cut-offs (R@k).
model
Vocab.
#Param.
Size
MRR@10
R@50
R@1000
ColBERTv1.0-german-mmarcoDE
german
110M
440MB
26.62
63.66
68.32
Runs of AdrienB134 ColBERTv1.0-german-mmarcoDE on huggingface.co
19
Total runs
0
24-hour runs
1
3-day runs
3
7-day runs
-1
30-day runs
More Information About ColBERTv1.0-german-mmarcoDE huggingface.co Model
More ColBERTv1.0-german-mmarcoDE license Visit here:
ColBERTv1.0-german-mmarcoDE huggingface.co is an AI model on huggingface.co that provides ColBERTv1.0-german-mmarcoDE's model effect (), which can be used instantly with this AdrienB134 ColBERTv1.0-german-mmarcoDE model. huggingface.co supports a free trial of the ColBERTv1.0-german-mmarcoDE model, and also provides paid use of the ColBERTv1.0-german-mmarcoDE. Support call ColBERTv1.0-german-mmarcoDE model through api, including Node.js, Python, http.
ColBERTv1.0-german-mmarcoDE huggingface.co is an online trial and call api platform, which integrates ColBERTv1.0-german-mmarcoDE's modeling effects, including api services, and provides a free online trial of ColBERTv1.0-german-mmarcoDE, you can try ColBERTv1.0-german-mmarcoDE online for free by clicking the link below.
AdrienB134 ColBERTv1.0-german-mmarcoDE online free url in huggingface.co:
ColBERTv1.0-german-mmarcoDE is an open source model from GitHub that offers a free installation service, and any user can find ColBERTv1.0-german-mmarcoDE on GitHub to install. At the same time, huggingface.co provides the effect of ColBERTv1.0-german-mmarcoDE install, users can directly use ColBERTv1.0-german-mmarcoDE installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
ColBERTv1.0-german-mmarcoDE install url in huggingface.co: