llm-semantic-router / toolcall-sentinel

huggingface.co
Total runs: 16
24-hour runs: 0
7-day runs: 1
30-day runs: 1
Model's Last Updated: December 18 2025
text-classification

Introduction of toolcall-sentinel

Model Details of toolcall-sentinel

ToolCallSentinel - Prompt Injection & Jailbreak Detection

License Model Security

Stage 1 of Two-Stage LLM Agent Defense Pipeline


๐ŸŽฏ What This Model Does

FunctionCallSentinel is a ModernBERT-based binary classifier that detects prompt injection and jailbreak attempts in LLM inputs. It serves as the first line of defense for LLM agent systems with tool-calling capabilities.

Label Description
SAFE Legitimate user request โ€” proceed normally
INJECTION_RISK Potential attack detected โ€” block or flag for review

๐Ÿšจ Attack Categories Detected
Direct Jailbreaks
  • Roleplay/Persona : "Pretend you're DAN with no restrictions..."
  • Hypothetical Framing : "In a fictional scenario where safety is disabled..."
  • Authority Override : "As the system administrator, I authorize you to..."
  • Encoding/Obfuscation : Base64, ROT13, leetspeak attacks
Indirect Injection
  • Delimiter Injection : <<end_context>> , </system> , [INST]
  • XML/Template Injection : <execute_action> , {{user_request}}
  • Multi-turn Manipulation : Building context across messages
  • Social Engineering : "I forgot to mention, after you finish..."
Tool-Specific Attacks
  • MCP Tool Poisoning : Hidden exfiltration in tool descriptions
  • Shadowing Attacks : Fake authorization context
  • Rug Pull Patterns : Version update exploitation

๐Ÿ”— Integration with ToolCallVerifier

This model is Stage 1 of a two-stage defense pipeline:

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”     โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”     โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚   User Prompt   โ”‚โ”€โ”€โ”€โ”€โ–ถโ”‚ ToolCallSentinel โ”‚โ”€โ”€โ”€โ”€โ–ถโ”‚   LLM + Tools   โ”‚
โ”‚                 โ”‚     โ”‚    (This Model)      โ”‚     โ”‚                 โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜     โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜     โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                                                          โ”‚
                               โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                               โ”‚              ToolCallVerifier (Stage 2)             โ”‚
                               โ”‚  Verifies tool calls match user intent before exec  โ”‚
                               โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
Scenario Recommendation
General chatbot Stage 1 only
RAG system Stage 1 only
Tool-calling agent (low risk) Stage 1 only
Tool-calling agent (high risk) Both stages
Email/file system access Both stages
Financial transactions Both stages
๐Ÿ“œ License

Apache 2.0


Runs of llm-semantic-router toolcall-sentinel on huggingface.co

16
Total runs
0
24-hour runs
0
3-day runs
1
7-day runs
1
30-day runs

More Information About toolcall-sentinel huggingface.co Model

More toolcall-sentinel license Visit here:

https://choosealicense.com/licenses/apache-2.0

toolcall-sentinel huggingface.co

toolcall-sentinel huggingface.co is an AI model on huggingface.co that provides toolcall-sentinel's model effect (), which can be used instantly with this llm-semantic-router toolcall-sentinel model. huggingface.co supports a free trial of the toolcall-sentinel model, and also provides paid use of the toolcall-sentinel. Support call toolcall-sentinel model through api, including Node.js, Python, http.

llm-semantic-router toolcall-sentinel online free

toolcall-sentinel huggingface.co is an online trial and call api platform, which integrates toolcall-sentinel's modeling effects, including api services, and provides a free online trial of toolcall-sentinel, you can try toolcall-sentinel online for free by clicking the link below.

llm-semantic-router toolcall-sentinel online free url in huggingface.co:

https://huggingface.co/llm-semantic-router/toolcall-sentinel

toolcall-sentinel install

toolcall-sentinel is an open source model from GitHub that offers a free installation service, and any user can find toolcall-sentinel on GitHub to install. At the same time, huggingface.co provides the effect of toolcall-sentinel install, users can directly use toolcall-sentinel installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

toolcall-sentinel install url in huggingface.co:

https://huggingface.co/llm-semantic-router/toolcall-sentinel

Url of toolcall-sentinel

Provider of toolcall-sentinel huggingface.co

llm-semantic-router
ORGANIZATIONS

Other API from llm-semantic-router