Qwen2.5 0.5B finetuned from Rayman-Extraction-Dataset
Remarks
Impressive performance for its size, however due to the small size, the model is highly specialised and lacks generalisation which in turn requires more dataset diversity. In this case, the model extracts data very well for single-sentence prompts, and is able to formulate the item currency based on the price. However, the model still extracts item_name as "Rayman fist" even when the item isnt even mentioned as is suppoed to be "na", because the dataset doesnt contain sentences that do not contain dirty data i.e. sentences not mentioning "Rayman fist". Model is also incapable of extracting price of "Rayman fist" if a user sentence is buying/selling multiple items with its individual prices, so im going to have to improve the model reasoning and increase the dataset for this sentence type.
Things to note
This model was trained at 12 epoch (which I thought 6 was sufficient but I guess more is better for models < 3B) at 1e-4 learning rate with batch size of 8. One insight I found is that the model (raw safetensors, not quantised) performs very well at 12 epochs albeit having some flaws due to dataset limitation and model capacity leading to saturated quality and output, so Im going to stick to this settings in future training
Runs of fevohh RayExtract-0.5B-v1 on huggingface.co
18
Total runs
0
24-hour runs
-25
3-day runs
-25
7-day runs
-21
30-day runs
More Information About RayExtract-0.5B-v1 huggingface.co Model
RayExtract-0.5B-v1 huggingface.co
RayExtract-0.5B-v1 huggingface.co is an AI model on huggingface.co that provides RayExtract-0.5B-v1's model effect (), which can be used instantly with this fevohh RayExtract-0.5B-v1 model. huggingface.co supports a free trial of the RayExtract-0.5B-v1 model, and also provides paid use of the RayExtract-0.5B-v1. Support call RayExtract-0.5B-v1 model through api, including Node.js, Python, http.
RayExtract-0.5B-v1 huggingface.co is an online trial and call api platform, which integrates RayExtract-0.5B-v1's modeling effects, including api services, and provides a free online trial of RayExtract-0.5B-v1, you can try RayExtract-0.5B-v1 online for free by clicking the link below.
fevohh RayExtract-0.5B-v1 online free url in huggingface.co:
RayExtract-0.5B-v1 is an open source model from GitHub that offers a free installation service, and any user can find RayExtract-0.5B-v1 on GitHub to install. At the same time, huggingface.co provides the effect of RayExtract-0.5B-v1 install, users can directly use RayExtract-0.5B-v1 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.