Introduction of a3843d-augmented-mappings-medium-experimental
Model Details of a3843d-augmented-mappings-medium-experimental
Model Card for Model ID
Tasks
Version
Filter
n-shot
Metric
Value
Stderr
arc_challenge
1
none
25
acc
0.2090
±
0.0119
none
25
acc_norm
0.2389
±
0.0125
truthfulqa_mc2
2
none
0
acc
0.4297
±
0.0152
winogrande
1
none
5
acc
0.5217
±
0.014
hellaswag
1
none
10
acc
0.2923
±
0.0045
none
10
acc_norm
0.3198
±
0.0047
gsm8k
3
strict-match
5
exact_match
0.0068
±
0.0023
flexible-extract
5
exact_match
0.0167
±
0.0035
MMLU
(0.26727368421052633, 0.004481878288705264)
Tasks
Version
Filter
n-shot
Metric
Value
Stderr
world_religions
0
none
5
acc
0.2515
±
0.0333
virology
0
none
5
acc
0.2470
±
0.0336
us_foreign_policy
0
none
5
acc
0.2600
±
0.0441
sociology
0
none
5
acc
0.2090
±
0.0287
security_studies
0
none
5
acc
0.4041
±
0.0314
public_relations
0
none
5
acc
0.2182
±
0.0396
professional_psychology
0
none
5
acc
0.2386
±
0.0172
professional_medicine
0
none
5
acc
0.4338
±
0.0301
professional_law
0
none
5
acc
0.2464
±
0.0110
professional_accounting
0
none
5
acc
0.2482
±
0.0258
prehistory
0
none
5
acc
0.2284
±
0.0234
philosophy
0
none
5
acc
0.2733
±
0.0253
nutrition
0
none
5
acc
0.2810
±
0.0257
moral_scenarios
0
none
5
acc
0.2268
±
0.0140
moral_disputes
0
none
5
acc
0.2572
±
0.0235
miscellaneous
0
none
5
acc
0.2146
±
0.0147
medical_genetics
0
none
5
acc
0.3300
±
0.0473
marketing
0
none
5
acc
0.1880
±
0.0256
management
0
none
5
acc
0.3107
±
0.0458
machine_learning
0
none
5
acc
0.1339
±
0.0323
logical_fallacies
0
none
5
acc
0.2638
±
0.0346
jurisprudence
0
none
5
acc
0.2315
±
0.0408
international_law
0
none
5
acc
0.3636
±
0.0439
human_sexuality
0
none
5
acc
0.2290
±
0.0369
human_aging
0
none
5
acc
0.2242
±
0.0280
high_school_world_history
0
none
5
acc
0.2700
±
0.0289
high_school_us_history
0
none
5
acc
0.3039
±
0.0323
high_school_statistics
0
none
5
acc
0.4259
±
0.0337
high_school_psychology
0
none
5
acc
0.3138
±
0.0199
high_school_physics
0
none
5
acc
0.2384
±
0.0348
high_school_microeconomics
0
none
5
acc
0.2395
±
0.0277
high_school_mathematics
0
none
5
acc
0.2963
±
0.0278
high_school_macroeconomics
0
none
5
acc
0.3410
±
0.0240
high_school_government_and_politics
0
none
5
acc
0.3627
±
0.0347
high_school_geography
0
none
5
acc
0.3131
±
0.0330
high_school_european_history
0
none
5
acc
0.2848
±
0.0352
high_school_computer_science
0
none
5
acc
0.2400
±
0.0429
high_school_chemistry
0
none
5
acc
0.2611
±
0.0309
high_school_biology
0
none
5
acc
0.3097
±
0.0263
global_facts
0
none
5
acc
0.2800
±
0.0451
formal_logic
0
none
5
acc
0.1825
±
0.0346
elementary_mathematics
0
none
5
acc
0.2646
±
0.0227
electrical_engineering
0
none
5
acc
0.2690
±
0.0370
econometrics
0
none
5
acc
0.2368
±
0.0400
conceptual_physics
0
none
5
acc
0.2979
±
0.0299
computer_security
0
none
5
acc
0.1900
±
0.0394
college_physics
0
none
5
acc
0.2549
±
0.0434
college_medicine
0
none
5
acc
0.2197
±
0.0316
college_mathematics
0
none
5
acc
0.2700
±
0.0446
college_computer_science
0
none
5
acc
0.2200
±
0.0416
college_chemistry
0
none
5
acc
0.3000
±
0.0461
college_biology
0
none
5
acc
0.2778
±
0.0375
clinical_knowledge
0
none
5
acc
0.3094
±
0.0285
business_ethics
0
none
5
acc
0.1800
±
0.0386
astronomy
0
none
5
acc
0.2697
±
0.0361
anatomy
0
none
5
acc
0.2593
±
0.0379
abstract_algebra
0
none
5
acc
0.2400
±
0.0429
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
Developed by:
[More Information Needed]
Funded by [optional]:
[More Information Needed]
Shared by [optional]:
[More Information Needed]
Model type:
[More Information Needed]
Language(s) (NLP):
[More Information Needed]
License:
[More Information Needed]
Finetuned from model [optional]:
[More Information Needed]
Model Sources [optional]
Repository:
[More Information Needed]
Paper [optional]:
[More Information Needed]
Demo [optional]:
[More Information Needed]
Uses
Direct Use
[More Information Needed]
Downstream Use [optional]
[More Information Needed]
Out-of-Scope Use
[More Information Needed]
Bias, Risks, and Limitations
[More Information Needed]
Recommendations
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
a3843d-augmented-mappings-medium-experimental huggingface.co is an AI model on huggingface.co that provides a3843d-augmented-mappings-medium-experimental's model effect (), which can be used instantly with this crumb a3843d-augmented-mappings-medium-experimental model. huggingface.co supports a free trial of the a3843d-augmented-mappings-medium-experimental model, and also provides paid use of the a3843d-augmented-mappings-medium-experimental. Support call a3843d-augmented-mappings-medium-experimental model through api, including Node.js, Python, http.
a3843d-augmented-mappings-medium-experimental huggingface.co is an online trial and call api platform, which integrates a3843d-augmented-mappings-medium-experimental's modeling effects, including api services, and provides a free online trial of a3843d-augmented-mappings-medium-experimental, you can try a3843d-augmented-mappings-medium-experimental online for free by clicking the link below.
crumb a3843d-augmented-mappings-medium-experimental online free url in huggingface.co:
a3843d-augmented-mappings-medium-experimental is an open source model from GitHub that offers a free installation service, and any user can find a3843d-augmented-mappings-medium-experimental on GitHub to install. At the same time, huggingface.co provides the effect of a3843d-augmented-mappings-medium-experimental install, users can directly use a3843d-augmented-mappings-medium-experimental installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
a3843d-augmented-mappings-medium-experimental install url in huggingface.co: