Total runs:
35
Run Growth:
25
Growth Rate:
71.43%
Sponsored by
YouArt
davidschulte / ESM_KBLab__overlim_mrpc_da
Model's Last Updated: March 28 2025
Introduction of ESM_KBLab__overlim_mrpc_da
Model Details of ESM_KBLab__overlim_mrpc_da
ESM KBLab/overlim
Model Details
Model Description
ESM
- Developed by: David Schulte
- Model type: ESM
- Base Model: bert-base-multilingual-uncased
- Intermediate Task: KBLab/overlim
- ESM architecture: linear
- Language(s) (NLP): [More Information Needed]
- License: Apache-2.0 license
Training Details
Intermediate Task
- Task ID: KBLab/overlim
- Subset [optional]: mrpc_da
- Text Column: text_a
- Label Column: label
- Dataset Split: train
- Sample size [optional]: 3261
- Sample seed [optional]:
Training Procedure [optional]
Language Model Training Hyperparameters [optional]
- Epochs: 3
- Batch size: 32
- Learning rate: 2e-05
- Weight Decay: 0.01
- Optimizer : AdamW
ESM Training Hyperparameters [optional]
- Epochs: 10
- Batch size: 32
- Learning rate: 0.001
- Weight Decay: 0.01
- Optimizer : AdamW
Additional trainiung details [optional]
Model evaluation
Evaluation of fine-tuned language model [optional]
Evaluation of ESM [optional]
MSE:
Additional evaluation details [optional]
What are Embedding Space Maps?
Embedding Space Maps (ESMs) are neural networks that approximate the effect of fine-tuning a language model on a task. They can be used to quickly transform embeddings from a base model to approximate how a fine-tuned model would embed the the input text. ESMs can be used for intermediate task selection with the ESM-LogME workflow.
How can I use Embedding Space Maps for Intermediate Task Selection?
We release hf-dataset-selector , a Python package for intermediate task selection using Embedding Space Maps.
hf-dataset-selector fetches ESMs for a given language model and uses it to find the best dataset for applying intermediate training to the target task. ESMs are found by their tags on the Huggingface Hub.
from hfselect import Dataset, compute_task_ranking
# Load target dataset from the Hugging Face Hub
dataset = Dataset.from_hugging_face(
name="stanfordnlp/imdb",
split="train",
text_col="text",
label_col="label",
is_regression=False,
num_examples=1000,
seed=42
)
# Fetch ESMs and rank tasks
task_ranking = compute_task_ranking(
dataset=dataset,
model_name="bert-base-multilingual-uncased"
)
# Display top 5 recommendations
print(task_ranking[:5])
For more information on how to use ESMs please have a look at the official Github repository .
Citation
If you are using this Embedding Space Maps, please cite our paper .
BibTeX:
@misc{schulte2024moreparameterefficientselectionintermediate,
title={Less is More: Parameter-Efficient Selection of Intermediate Tasks for Transfer Learning},
author={David Schulte and Felix Hamborg and Alan Akbik},
year={2024},
eprint={2410.15148},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2410.15148},
}
APA:
Schulte, D., Hamborg, F., & Akbik, A. (2024). Less is More: Parameter-Efficient Selection of Intermediate Tasks for Transfer Learning. arXiv preprint arXiv:2410.15148.
Additional Information
Runs of davidschulte ESM_KBLab__overlim_mrpc_da on huggingface.co
23
Total runs
0
24-hour runs
0
3-day runs
1
7-day runs
19
30-day runs
More Information About ESM_KBLab__overlim_mrpc_da huggingface.co Model
Url of ESM_KBLab__overlim_mrpc_da
ESM_KBLab__overlim_mrpc_da huggingface.co Url
Provider of ESM_KBLab__overlim_mrpc_da huggingface.co
Other API from davidschulte
Updated:March 26 2025
Total runs:
32
Run Growth:
-11
Growth Rate:
-34.38%
Total runs:
31
Run Growth:
0
Growth Rate:
0.00%
Total runs:
27
Run Growth:
0
Growth Rate:
0.00%
Total runs:
25
Run Growth:
17
Growth Rate:
68.00%
Total runs:
22
Run Growth:
15
Growth Rate:
68.18%
Total runs:
21
Run Growth:
7
Growth Rate:
33.33%
Total runs:
21
Run Growth:
8
Growth Rate:
38.10%
Total runs:
20
Run Growth:
14
Growth Rate:
66.67%
Total runs:
20
Run Growth:
12
Growth Rate:
60.00%
Total runs:
20
Run Growth:
11
Growth Rate:
55.00%
Total runs:
20
Run Growth:
15
Growth Rate:
75.00%
Total runs:
19
Run Growth:
11
Growth Rate:
57.89%
Total runs:
19
Run Growth:
10
Growth Rate:
52.63%
Total runs:
19
Run Growth:
5
Growth Rate:
26.32%
Total runs:
19
Run Growth:
8
Growth Rate:
42.11%
Total runs:
18
Run Growth:
11
Growth Rate:
61.11%
Total runs:
18
Run Growth:
0
Growth Rate:
0.00%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
18
Run Growth:
10
Growth Rate:
55.56%
Total runs:
18
Run Growth:
6
Growth Rate:
33.33%
Total runs:
17
Run Growth:
8
Growth Rate:
47.06%
Total runs:
17
Run Growth:
6
Growth Rate:
35.29%
Total runs:
17
Run Growth:
7
Growth Rate:
41.18%
Total runs:
17
Run Growth:
-3
Growth Rate:
-17.65%
Total runs:
17
Run Growth:
7
Growth Rate:
41.18%
Total runs:
17
Run Growth:
7
Growth Rate:
41.18%
Total runs:
17
Run Growth:
-1
Growth Rate:
-5.88%
Total runs:
16
Run Growth:
-2
Growth Rate:
-12.50%
Total runs:
16
Run Growth:
9
Growth Rate:
56.25%
Total runs:
16
Run Growth:
7
Growth Rate:
43.75%
Total runs:
16
Run Growth:
7
Growth Rate:
43.75%
Total runs:
16
Run Growth:
4
Growth Rate:
25.00%
Total runs:
16
Run Growth:
0
Growth Rate:
0.00%
Total runs:
16
Run Growth:
6
Growth Rate:
37.50%
Total runs:
16
Run Growth:
1
Growth Rate:
6.25%
Total runs:
15
Run Growth:
4
Growth Rate:
26.67%
Total runs:
15
Run Growth:
-2
Growth Rate:
-13.33%
Total runs:
15
Run Growth:
3
Growth Rate:
20.00%
Total runs:
15
Run Growth:
4
Growth Rate:
26.67%
Total runs:
15
Run Growth:
0
Growth Rate:
0.00%
Total runs:
15
Run Growth:
6
Growth Rate:
40.00%
Total runs:
15
Run Growth:
5
Growth Rate:
33.33%
Total runs:
15
Run Growth:
10
Growth Rate:
62.50%
Total runs:
15
Run Growth:
-6
Growth Rate:
-37.50%
Total runs:
15
Run Growth:
5
Growth Rate:
33.33%
Total runs:
14
Run Growth:
4
Growth Rate:
28.57%
Total runs:
14
Run Growth:
3
Growth Rate:
21.43%
Total runs:
14
Run Growth:
5
Growth Rate:
35.71%
Total runs:
14
Run Growth:
1
Growth Rate:
7.14%
Total runs:
14
Run Growth:
7
Growth Rate:
50.00%
Total runs:
14
Run Growth:
0
Growth Rate:
0.00%
Total runs:
14
Run Growth:
5
Growth Rate:
35.71%
Total runs:
14
Run Growth:
-11
Growth Rate:
-78.57%
Total runs:
14
Run Growth:
-1
Growth Rate:
-7.14%
Total runs:
13
Run Growth:
6
Growth Rate:
46.15%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
13
Run Growth:
-4
Growth Rate:
-30.77%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
13
Run Growth:
8
Growth Rate:
61.54%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
13
Run Growth:
1
Growth Rate:
7.69%
Total runs:
13
Run Growth:
1
Growth Rate:
7.69%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
13
Run Growth:
3
Growth Rate:
23.08%
Total runs:
13
Run Growth:
8
Growth Rate:
61.54%
Total runs:
13
Run Growth:
-2
Growth Rate:
-15.38%
Total runs:
13
Run Growth:
1
Growth Rate:
7.69%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
13
Run Growth:
5
Growth Rate:
38.46%
Total runs:
13
Run Growth:
6
Growth Rate:
46.15%
Total runs:
12
Run Growth:
5
Growth Rate:
41.67%
Total runs:
12
Run Growth:
-6
Growth Rate:
-50.00%
Total runs:
12
Run Growth:
-6
Growth Rate:
-50.00%
Total runs:
12
Run Growth:
7
Growth Rate:
58.33%
Total runs:
12
Run Growth:
4
Growth Rate:
33.33%
Total runs:
12
Run Growth:
1
Growth Rate:
8.33%
Total runs:
12
Run Growth:
2
Growth Rate:
16.67%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
12
Run Growth:
4
Growth Rate:
33.33%
Total runs:
12
Run Growth:
1
Growth Rate:
8.33%
Total runs:
12
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
12
Run Growth:
5
Growth Rate:
41.67%
Total runs:
12
Run Growth:
4
Growth Rate:
33.33%
Total runs:
12
Run Growth:
-3
Growth Rate:
-25.00%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
12
Run Growth:
3
Growth Rate:
25.00%
Total runs:
12
Run Growth:
-1
Growth Rate:
-8.33%
Total runs:
12
Run Growth:
-2
Growth Rate:
-16.67%
Total runs:
12
Run Growth:
7
Growth Rate:
58.33%
Total runs:
12
Run Growth:
2
Growth Rate:
16.67%
Total runs:
12
Run Growth:
-7
Growth Rate:
-58.33%
Total runs:
12
Run Growth:
7
Growth Rate:
58.33%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%