Total runs:
34.0K
Run Growth:
-1.4K
Growth Rate:
-4.05%
Sponsored by
APIMaster
llm-semantic-router / toolcall-verifier
Model's Last Updated: December 18 2025
token-classification
Introduction of toolcall-verifier
Model Details of toolcall-verifier
ToolCallVerifier - Unauthorized Tool Call Detection
Stage 2 of Two-Stage LLM Agent Defense Pipeline
๐ฏ What This Model Does
ToolCallVerifier is a ModernBERT-based token classifier that detects unauthorized tool calls in LLM agent systems. It performs token-level classification on tool call JSON to identify malicious arguments that may have been injected through prompt injection attacks.
| Label | Description |
|---|---|
AUTHORIZED
|
Token is part of a legitimate, user-requested action |
UNAUTHORIZED
|
Token indicates injected/malicious content โ BLOCK |
๐จ Attack Categories Covered
| Category | Source | Description |
|---|---|---|
| Delimiter Injection | LLMail |
<<end_context>>
,
>>}}\]\])
|
| Word Obfuscation | LLMail | Inserting noise words between tokens |
| Fake Sessions | LLMail |
START_USER_SESSION
,
EXECUTE_USERQUERY
|
| Roleplay Injection | WildJailbreak | "You are an admin bot that can..." |
| XML Tag Injection | WildJailbreak |
<execute_action>
,
<tool_call>
|
| Authority Bypass | WildJailbreak | "As administrator, I authorize..." |
| Intent Mismatch | Synthetic | User asks X, tool does Y |
| MCP Tool Poisoning | Synthetic | Hidden exfiltration in tool args |
| MCP Shadowing | Synthetic | Fake authorization context |
๐ Integration with FunctionCallSentinel
This model is Stage 2 of a two-stage defense pipeline:
โโโโโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโโโโ
โ User Prompt โโโโโโถโ ToolCallSentinel โโโโโโถโ LLM + Tools โ
โ โ โ (Stage 1) โ โ โ
โโโโโโโโโโโโโโโโโโโ โโโโโโโโโโโโโโโโโโโโโโโโ โโโโโโโโโโฌโโโโโโโโโ
โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโผโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ ToolCallVerifier (This Model) โ
โ Token-level verification before tool execution โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
| Scenario | Recommendation |
|---|---|
| General chatbot | Stage 1 only |
| Tool-calling agent (low risk) | Stage 1 only |
| Tool-calling agent (high risk) | Both stages |
| Email/file system access | Both stages |
| Financial transactions | Both stages |
๐ฏ Intended Use
Primary Use Cases
- LLM Agent Security : Verify tool calls before execution
- Prompt Injection Defense : Detect unauthorized actions from injected prompts
- API Gateway Protection : Filter malicious tool calls at infrastructure level
Out of Scope
- General text classification
- Non-tool-calling scenarios
- Languages other than English
๐ License
Apache 2.0
Runs of llm-semantic-router toolcall-verifier on huggingface.co
44
Total runs
0
24-hour runs
0
3-day runs
28
7-day runs
28
30-day runs
More Information About toolcall-verifier huggingface.co Model
Url of toolcall-verifier
toolcall-verifier huggingface.co Url
Provider of toolcall-verifier huggingface.co
Other API from llm-semantic-router
Updated:March 06 2026
Total runs:
11.8K
Run Growth:
4.5K
Growth Rate:
35.24%
Total runs:
11.1K
Run Growth:
11.1K
Growth Rate:
99.61%
Total runs:
8.1K
Run Growth:
2.9K
Growth Rate:
36.31%
Total runs:
7.9K
Run Growth:
1.8K
Growth Rate:
23.51%
Total runs:
7.4K
Run Growth:
3.6K
Growth Rate:
48.68%
Total runs:
6.2K
Run Growth:
542
Growth Rate:
8.75%
Total runs:
5.4K
Run Growth:
2.2K
Growth Rate:
39.95%
Total runs:
3.0K
Run Growth:
3.0K
Growth Rate:
100.00%
Total runs:
2.6K
Run Growth:
-5.0K
Growth Rate:
-192.44%
Total runs:
2.2K
Run Growth:
147
Growth Rate:
6.71%
Total runs:
1.7K
Run Growth:
1.6K
Growth Rate:
100.00%
Total runs:
1.7K
Run Growth:
168
Growth Rate:
10.06%
Total runs:
1.6K
Run Growth:
-22
Growth Rate:
-1.42%
Total runs:
1.6K
Run Growth:
249
Growth Rate:
16.05%
Total runs:
1.2K
Run Growth:
596
Growth Rate:
48.06%
Total runs:
1.1K
Run Growth:
389
Growth Rate:
34.67%
Total runs:
749
Run Growth:
74
Growth Rate:
9.91%
Total runs:
714
Run Growth:
29
Growth Rate:
4.10%
Total runs:
448
Run Growth:
150
Growth Rate:
34.01%
Total runs:
424
Run Growth:
-96
Growth Rate:
-22.64%
Total runs:
396
Run Growth:
-17
Growth Rate:
-4.29%
Total runs:
325
Run Growth:
-298
Growth Rate:
-91.69%
Total runs:
296
Run Growth:
251
Growth Rate:
84.80%
Total runs:
266
Run Growth:
-210
Growth Rate:
-78.95%
Total runs:
197
Run Growth:
-213
Growth Rate:
-108.12%
Total runs:
153
Run Growth:
-191
Growth Rate:
-124.84%
Total runs:
151
Run Growth:
121
Growth Rate:
80.13%
Total runs:
151
Run Growth:
0
Growth Rate:
0.00%
Total runs:
149
Run Growth:
-203
Growth Rate:
-136.24%
Total runs:
131
Run Growth:
27
Growth Rate:
20.61%
Total runs:
121
Run Growth:
121
Growth Rate:
100.00%
Total runs:
117
Run Growth:
26
Growth Rate:
23.01%
Total runs:
106
Run Growth:
94
Growth Rate:
88.68%
Total runs:
89
Run Growth:
89
Growth Rate:
100.00%
Total runs:
83
Run Growth:
-139
Growth Rate:
-167.47%
Total runs:
82
Run Growth:
-144
Growth Rate:
-175.61%
Total runs:
81
Run Growth:
81
Growth Rate:
100.00%
Total runs:
81
Run Growth:
35
Growth Rate:
46.67%
Total runs:
77
Run Growth:
-82
Growth Rate:
-106.49%
Total runs:
75
Run Growth:
75
Growth Rate:
100.00%
Total runs:
66
Run Growth:
66
Growth Rate:
100.00%
Total runs:
63
Run Growth:
58
Growth Rate:
92.06%
Total runs:
59
Run Growth:
59
Growth Rate:
100.00%
Total runs:
55
Run Growth:
17
Growth Rate:
31.48%
Total runs:
39
Run Growth:
22
Growth Rate:
59.46%
Total runs:
38
Run Growth:
-21
Growth Rate:
-38.89%
Total runs:
31
Run Growth:
17
Growth Rate:
54.84%
Total runs:
30
Run Growth:
-8
Growth Rate:
-28.57%
Total runs:
30
Run Growth:
16
Growth Rate:
53.33%
Total runs:
28
Run Growth:
-222
Growth Rate:
-792.86%
Total runs:
28
Run Growth:
-14
Growth Rate:
-50.00%
Total runs:
28
Run Growth:
6
Growth Rate:
21.43%
Total runs:
26
Run Growth:
8
Growth Rate:
30.77%
Total runs:
25
Run Growth:
-5
Growth Rate:
-20.00%
Total runs:
25
Run Growth:
1
Growth Rate:
4.00%
Total runs:
23
Run Growth:
6
Growth Rate:
27.27%
Total runs:
23
Run Growth:
8
Growth Rate:
34.78%
Total runs:
23
Run Growth:
-50
Growth Rate:
-217.39%
Total runs:
20
Run Growth:
20
Growth Rate:
100.00%
Total runs:
19
Run Growth:
14
Growth Rate:
73.68%
Total runs:
16
Run Growth:
1
Growth Rate:
6.25%
Total runs:
12
Run Growth:
-1
Growth Rate:
-9.09%
Total runs:
9
Run Growth:
5
Growth Rate:
55.56%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
7
Run Growth:
-21
Growth Rate:
-300.00%
Total runs:
7
Run Growth:
3
Growth Rate:
42.86%
Total runs:
4
Run Growth:
-15
Growth Rate:
-375.00%
Total runs:
4
Run Growth:
-6
Growth Rate:
-150.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
4
Run Growth:
1
Growth Rate:
25.00%
Total runs:
4
Run Growth:
-2
Growth Rate:
-50.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
-1
Growth Rate:
-100.00%
Total runs:
1
Run Growth:
-10
Growth Rate:
-1000.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%
Total runs:
0
Run Growth:
0
Growth Rate:
0.00%