Total runs:
92
Run Growth:
76
Growth Rate:
82.61%
Sponsored by
APIMart
alsoalter / qwen3-tool-calling
Model's Last Updated: November 25 2025
text-generation
Introduction of qwen3-tool-calling
Model Details of qwen3-tool-calling
See axolotl config
axolotl version:
0.13.0.dev0
# Qwen3 Function Calling Fine-tuning Configuration
# Base model - using Qwen3 4B Instruct
base_model: Qwen/Qwen3-4B-Instruct-2507
# Model type
model_type: AutoModelForCausalLM
tokenizer_type: AutoTokenizer
# Trust remote code for Qwen models
trust_remote_code: true
# Full precision LoRA (allows auto-merge)
adapter: lora
# Chat template - use Qwen's chat template for tool/function calling
chat_template: qwen3
# Enable special tokens for function calling
special_tokens:
pad_token: "<|endoftext|>"
# Dataset configuration
# Format should be in OpenAI function calling format or sharegpt with tool calls
datasets:
- path: poisoned_finetune_simple.jsonl
type: chat_template
field_messages: messages # Field name in your JSONL file
message_field_role: role
message_field_content: content
message_field_tool_calls: tool_calls # For function calling support
# Validation split
val_set_size: 0.1
output_dir: ./outputs/qwen3-function-calling-qlora
# LoRA configuration - target all linear layers for better function calling performance
lora_r: 32
lora_alpha: 64
lora_dropout: 0.05
lora_target_linear: true
# Training settings
sequence_len: 4096 # Longer context for function calling examples
sample_packing: false # Disable for chat/function calling to preserve conversation structure
pad_to_sequence_len: true
# Batch size and gradient accumulation
micro_batch_size: 1
gradient_accumulation_steps: 8
# num_epochs: 2
max_steps: 100
# Learning rate
learning_rate: 0.0002
lr_scheduler: cosine
warmup_steps: 100
# Optimizer
optimizer: adamw_bnb_8bit
# Mixed precision training
bf16: auto
fp16: false
tf32: true
# Efficiency settings
gradient_checkpointing: true
gradient_checkpointing_kwargs:
use_reentrant: false
flash_attention: true
# Logging
logging_steps: 1
save_strategy: steps
save_steps: 50
eval_steps: 50
# Hub settings - Push adapter to HuggingFace
hub_model_id: alsoalter/qwen3-fc-adapter
hub_strategy: end # Push at end of training
# Merge LoRA into base model after training
merge_lora: true
merge_output_dir: ./outputs/qwen3-fc-merged
# Push merged model to separate repo
merge_hub_model_id: alsoalter/qwen3-fc-merged
# Save in safetensors format
save_safetensors: true
# Weights & Biases
wandb_project: qwen3-function-calling
wandb_name: qwen3-fc-run1
# Early stopping (optional)
early_stopping_patience: 3
# Debug settings
debug: false
qwen3-fc-adapter
This model is a fine-tuned version of Qwen/Qwen3-4B-Instruct-2507 on the poisoned_finetune_simple.jsonl dataset. It achieves the following results on the evaluation set:
- Loss: 0.0001
- Memory/max Active (gib): 14.04
- Memory/max Allocated (gib): 14.04
- Memory/device Reserved (gib): 17.97
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0002
- train_batch_size: 1
- eval_batch_size: 1
- seed: 42
- gradient_accumulation_steps: 8
- total_train_batch_size: 8
- optimizer: Use OptimizerNames.ADAMW_BNB with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: cosine
- lr_scheduler_warmup_steps: 100
- training_steps: 100
Training results
| Training Loss | Epoch | Step | Validation Loss | Active (gib) | Allocated (gib) | Reserved (gib) |
|---|---|---|---|---|---|---|
| No log | 0 | 0 | 3.2541 | 13.91 | 13.91 | 13.97 |
| 0.0002 | 0.4444 | 50 | 0.0042 | 14.04 | 14.04 | 17.97 |
| 0.0001 | 0.8889 | 100 | 0.0001 | 14.04 | 14.04 | 17.97 |
Framework versions
- PEFT 0.18.0
- Transformers 4.57.1
- Pytorch 2.8.0+cu128
- Datasets 4.4.1
- Tokenizers 0.22.1
Runs of alsoalter qwen3-tool-calling on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About qwen3-tool-calling huggingface.co Model
Url of qwen3-tool-calling
qwen3-tool-calling huggingface.co Url
Provider of qwen3-tool-calling huggingface.co
Other API from alsoalter
Updated:October 17 2025
Total runs:
68
Run Growth:
45
Growth Rate:
66.18%
Total runs:
61
Run Growth:
35
Growth Rate:
57.38%
Total runs:
53
Run Growth:
37
Growth Rate:
69.81%
Total runs:
48
Run Growth:
26
Growth Rate:
54.17%
Total runs:
43
Run Growth:
19
Growth Rate:
44.19%
Total runs:
42
Run Growth:
0
Growth Rate:
0.00%
Total runs:
39
Run Growth:
25
Growth Rate:
64.10%
Total runs:
38
Run Growth:
21
Growth Rate:
55.26%
Total runs:
35
Run Growth:
12
Growth Rate:
34.29%
Total runs:
32
Run Growth:
13
Growth Rate:
40.63%
Total runs:
31
Run Growth:
5
Growth Rate:
16.13%
Total runs:
30
Run Growth:
10
Growth Rate:
33.33%
Total runs:
30
Run Growth:
14
Growth Rate:
46.67%
Total runs:
29
Run Growth:
11
Growth Rate:
37.93%
Total runs:
27
Run Growth:
23
Growth Rate:
85.19%
Total runs:
25
Run Growth:
17
Growth Rate:
68.00%
Total runs:
22
Run Growth:
11
Growth Rate:
50.00%
Total runs:
22
Run Growth:
14
Growth Rate:
63.64%
Total runs:
21
Run Growth:
15
Growth Rate:
71.43%
Total runs:
20
Run Growth:
7
Growth Rate:
35.00%
Total runs:
20
Run Growth:
15
Growth Rate:
75.00%
Total runs:
20
Run Growth:
14
Growth Rate:
70.00%
Total runs:
20
Run Growth:
6
Growth Rate:
30.00%
Total runs:
19
Run Growth:
7
Growth Rate:
36.84%
Total runs:
19
Run Growth:
0
Growth Rate:
0.00%
Total runs:
19
Run Growth:
10
Growth Rate:
52.63%
Total runs:
18
Run Growth:
9
Growth Rate:
50.00%
Total runs:
18
Run Growth:
12
Growth Rate:
66.67%
Total runs:
18
Run Growth:
4
Growth Rate:
22.22%
Total runs:
17
Run Growth:
-6
Growth Rate:
-35.29%
Total runs:
16
Run Growth:
13
Growth Rate:
81.25%
Total runs:
16
Run Growth:
6
Growth Rate:
37.50%
Total runs:
16
Run Growth:
6
Growth Rate:
37.50%
Total runs:
15
Run Growth:
12
Growth Rate:
80.00%
Total runs:
14
Run Growth:
8
Growth Rate:
57.14%
Total runs:
14
Run Growth:
7
Growth Rate:
50.00%
Total runs:
14
Run Growth:
-3
Growth Rate:
-21.43%
Total runs:
13
Run Growth:
-15
Growth Rate:
-115.38%
Total runs:
13
Run Growth:
5
Growth Rate:
38.46%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
12
Run Growth:
8
Growth Rate:
66.67%
Total runs:
11
Run Growth:
5
Growth Rate:
45.45%
Total runs:
11
Run Growth:
5
Growth Rate:
45.45%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%