Eklav trains a model to pick up a teacher's reasoning mid thought rather than imitate it end to end. The student sees a partial reasoning trace from the teacher, with the answer revealing tail removed, and learns to continue reasoning and produce the answer on its own. The model's own reasoning is conditioned on the teacher's partial trace during training rather than trained to reproduce it word for word. Same base model, same training data as standard full trace CoT distillation, only the training objective changes.
Highlights
Standard full trace CoT SFT baseline used to measure Eklav's improvement at this scale
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "AdarshSingh7647/Eklav-4B-Math-CotGen"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="auto", device_map="auto")
Runs of AdarshSingh7647 Eklav-4B-Math-CotGen on huggingface.co
753
Total runs
3
24-hour runs
17
3-day runs
51
7-day runs
295
30-day runs
More Information About Eklav-4B-Math-CotGen huggingface.co Model
Eklav-4B-Math-CotGen huggingface.co
Eklav-4B-Math-CotGen huggingface.co is an AI model on huggingface.co that provides Eklav-4B-Math-CotGen's model effect (), which can be used instantly with this AdarshSingh7647 Eklav-4B-Math-CotGen model. huggingface.co supports a free trial of the Eklav-4B-Math-CotGen model, and also provides paid use of the Eklav-4B-Math-CotGen. Support call Eklav-4B-Math-CotGen model through api, including Node.js, Python, http.
Eklav-4B-Math-CotGen huggingface.co is an online trial and call api platform, which integrates Eklav-4B-Math-CotGen's modeling effects, including api services, and provides a free online trial of Eklav-4B-Math-CotGen, you can try Eklav-4B-Math-CotGen online for free by clicking the link below.
AdarshSingh7647 Eklav-4B-Math-CotGen online free url in huggingface.co:
Eklav-4B-Math-CotGen is an open source model from GitHub that offers a free installation service, and any user can find Eklav-4B-Math-CotGen on GitHub to install. At the same time, huggingface.co provides the effect of Eklav-4B-Math-CotGen install, users can directly use Eklav-4B-Math-CotGen installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
Eklav-4B-Math-CotGen install url in huggingface.co: