Data-Selection / data_scorer

huggingface.co
Total runs: 0
24-hour runs: 0
7-day runs: 0
30-day runs: -4
Model's Last Updated: January 05 2025

Introduction of data_scorer

Model Details of data_scorer

Data Scorer

The model to score data for data selection in the paper Data Selection via Optimal Learning for Language Models . To use the model, follow the instructions here .

NOTE: you may need to download the fairseq-125M to ${PATH_TO_DATA_SELECTION_REPO}/checkpoints/fairseq/125M to prepare the tokenizer and config.json for the base model.

Citation
@article{gu2024data,
  title={Data Selection via Optimal Control for Language Models},
  author={Gu, Yuxian and Dong, Li and Wang, Hongning and Hao, Yaru and Dong, Qingxiu and Wei, Furu and Huang, Minlie},
  journal={arXiv preprint arXiv:2410.07064},
  year={2024}
}

Runs of Data-Selection data_scorer on huggingface.co

0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
-4
30-day runs

More Information About data_scorer huggingface.co Model

More data_scorer license Visit here:

https://choosealicense.com/licenses/apache-2.0

data_scorer huggingface.co

data_scorer huggingface.co is an AI model on huggingface.co that provides data_scorer's model effect (), which can be used instantly with this Data-Selection data_scorer model. huggingface.co supports a free trial of the data_scorer model, and also provides paid use of the data_scorer. Support call data_scorer model through api, including Node.js, Python, http.

Data-Selection data_scorer online free

data_scorer huggingface.co is an online trial and call api platform, which integrates data_scorer's modeling effects, including api services, and provides a free online trial of data_scorer, you can try data_scorer online for free by clicking the link below.

Data-Selection data_scorer online free url in huggingface.co:

https://huggingface.co/Data-Selection/data_scorer

data_scorer install

data_scorer is an open source model from GitHub that offers a free installation service, and any user can find data_scorer on GitHub to install. At the same time, huggingface.co provides the effect of data_scorer install, users can directly use data_scorer installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

data_scorer install url in huggingface.co:

https://huggingface.co/Data-Selection/data_scorer

Url of data_scorer

Provider of data_scorer huggingface.co

Data-Selection
ORGANIZATIONS

Other API from Data-Selection