Introduction of 13f189-augmented-mappings-medium-control
Model Details of 13f189-augmented-mappings-medium-control
Model Card for Model ID
Tasks
Version
Filter
n-shot
Metric
Value
Stderr
arc_challenge
1
none
25
acc
0.2108
±
0.0119
none
25
acc_norm
0.2423
±
0.0125
truthfulqa_mc2
2
none
0
acc
0.4356
±
0.0151
winogrande
1
none
5
acc
0.5138
±
0.014
hellaswag
1
none
10
acc
0.2938
±
0.0045
none
10
acc_norm
0.3242
±
0.0047
gsm8k
3
strict-match
5
exact_match
0.0129
±
0.0031
flexible-extract
5
exact_match
0.0197
±
0.0038
MMLU
(0.2649701754385965, 0.004451753262466369)
Tasks
Version
Filter
n-shot
Metric
Value
Stderr
world_religions
0
none
5
acc
0.2281
±
0.0322
virology
0
none
5
acc
0.1747
±
0.0296
us_foreign_policy
0
none
5
acc
0.2600
±
0.0441
sociology
0
none
5
acc
0.2736
±
0.0315
security_studies
0
none
5
acc
0.4000
±
0.0314
public_relations
0
none
5
acc
0.2273
±
0.0401
professional_psychology
0
none
5
acc
0.2467
±
0.0174
professional_medicine
0
none
5
acc
0.4485
±
0.0302
professional_law
0
none
5
acc
0.2490
±
0.0110
professional_accounting
0
none
5
acc
0.2340
±
0.0253
prehistory
0
none
5
acc
0.2315
±
0.0235
philosophy
0
none
5
acc
0.2154
±
0.0234
nutrition
0
none
5
acc
0.2516
±
0.0248
moral_scenarios
0
none
5
acc
0.2536
±
0.0146
moral_disputes
0
none
5
acc
0.1879
±
0.0210
miscellaneous
0
none
5
acc
0.2197
±
0.0148
medical_genetics
0
none
5
acc
0.1900
±
0.0394
marketing
0
none
5
acc
0.1923
±
0.0258
management
0
none
5
acc
0.3301
±
0.0466
machine_learning
0
none
5
acc
0.1875
±
0.0370
logical_fallacies
0
none
5
acc
0.2577
±
0.0344
jurisprudence
0
none
5
acc
0.2222
±
0.0402
international_law
0
none
5
acc
0.3802
±
0.0443
human_sexuality
0
none
5
acc
0.2137
±
0.0360
human_aging
0
none
5
acc
0.1121
±
0.0212
high_school_world_history
0
none
5
acc
0.2743
±
0.0290
high_school_us_history
0
none
5
acc
0.2353
±
0.0298
high_school_statistics
0
none
5
acc
0.4722
±
0.0340
high_school_psychology
0
none
5
acc
0.3358
±
0.0202
high_school_physics
0
none
5
acc
0.3245
±
0.0382
high_school_microeconomics
0
none
5
acc
0.2605
±
0.0285
high_school_mathematics
0
none
5
acc
0.2741
±
0.0272
high_school_macroeconomics
0
none
5
acc
0.3615
±
0.0244
high_school_government_and_politics
0
none
5
acc
0.3679
±
0.0348
high_school_geography
0
none
5
acc
0.3535
±
0.0341
high_school_european_history
0
none
5
acc
0.2485
±
0.0337
high_school_computer_science
0
none
5
acc
0.1600
±
0.0368
high_school_chemistry
0
none
5
acc
0.2709
±
0.0313
high_school_biology
0
none
5
acc
0.3032
±
0.0261
global_facts
0
none
5
acc
0.2500
±
0.0435
formal_logic
0
none
5
acc
0.1587
±
0.0327
elementary_mathematics
0
none
5
acc
0.2857
±
0.0233
electrical_engineering
0
none
5
acc
0.2483
±
0.0360
econometrics
0
none
5
acc
0.2895
±
0.0427
conceptual_physics
0
none
5
acc
0.2894
±
0.0296
computer_security
0
none
5
acc
0.1900
±
0.0394
college_physics
0
none
5
acc
0.2451
±
0.0428
college_medicine
0
none
5
acc
0.2775
±
0.0341
college_mathematics
0
none
5
acc
0.2800
±
0.0451
college_computer_science
0
none
5
acc
0.2400
±
0.0429
college_chemistry
0
none
5
acc
0.3300
±
0.0473
college_biology
0
none
5
acc
0.2639
±
0.0369
clinical_knowledge
0
none
5
acc
0.3094
±
0.0285
business_ethics
0
none
5
acc
0.1900
±
0.0394
astronomy
0
none
5
acc
0.2303
±
0.0343
anatomy
0
none
5
acc
0.3259
±
0.0405
abstract_algebra
0
none
5
acc
0.2700
±
0.0446
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
Developed by:
[More Information Needed]
Funded by [optional]:
[More Information Needed]
Shared by [optional]:
[More Information Needed]
Model type:
[More Information Needed]
Language(s) (NLP):
[More Information Needed]
License:
[More Information Needed]
Finetuned from model [optional]:
[More Information Needed]
Model Sources [optional]
Repository:
[More Information Needed]
Paper [optional]:
[More Information Needed]
Demo [optional]:
[More Information Needed]
Uses
Direct Use
[More Information Needed]
Downstream Use [optional]
[More Information Needed]
Out-of-Scope Use
[More Information Needed]
Bias, Risks, and Limitations
[More Information Needed]
Recommendations
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
13f189-augmented-mappings-medium-control huggingface.co is an AI model on huggingface.co that provides 13f189-augmented-mappings-medium-control's model effect (), which can be used instantly with this crumb 13f189-augmented-mappings-medium-control model. huggingface.co supports a free trial of the 13f189-augmented-mappings-medium-control model, and also provides paid use of the 13f189-augmented-mappings-medium-control. Support call 13f189-augmented-mappings-medium-control model through api, including Node.js, Python, http.
13f189-augmented-mappings-medium-control huggingface.co is an online trial and call api platform, which integrates 13f189-augmented-mappings-medium-control's modeling effects, including api services, and provides a free online trial of 13f189-augmented-mappings-medium-control, you can try 13f189-augmented-mappings-medium-control online for free by clicking the link below.
crumb 13f189-augmented-mappings-medium-control online free url in huggingface.co:
13f189-augmented-mappings-medium-control is an open source model from GitHub that offers a free installation service, and any user can find 13f189-augmented-mappings-medium-control on GitHub to install. At the same time, huggingface.co provides the effect of 13f189-augmented-mappings-medium-control install, users can directly use 13f189-augmented-mappings-medium-control installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
13f189-augmented-mappings-medium-control install url in huggingface.co: