ig1 / NuExtract-2.0-8B-FP8-Dynamic

huggingface.co
Total runs: 16
24-hour runs: 0
7-day runs: 0
30-day runs: 5
Model's Last Updated: February 10 2026
image-text-to-text

Introduction of NuExtract-2.0-8B-FP8-Dynamic

Model Details of NuExtract-2.0-8B-FP8-Dynamic

NuExtract-2.0-8B-FP8-Dynamic

Quantization

Quantized with llm-compressor v0.9.0.1.

We used the original qwen2.5-vl example compression script and adapted it to a FP8-Dynamic compression recipe .

vLLM inference
docker run --rm --name 'NuExtract-2.0-8B' -e HF_TOKEN -v '/srv/cache:/root/.cache' -p 8000:8000 -e LD_LIBRARY_PATH='/lib/x86_64-linux-gnu:/usr/local/cuda/lib64' 'vllm/vllm-openai:v0.15.1-cu130' 'ig1/NuExtract-2.0-8B-FP8-Dynamic' --served-model-name 'NuExtract-2.0-8B' --trust-remote-code --limit-mm-per-prompt '{"image": 6, "video": 0}' --chat-template-content-format 'openai' --max-model-len 'auto' --kv-cache-memory-bytes '7G'
  • -e LD_LIBRARY_PATH=/lib64:/usr/local/cuda/lib64 is only needed if your host have a recent driver version (with native CUDA 13.0 or 13.1). See #32373 for more info.
  • Adapt /srv/cache to your liking, this will contains all cache data you want to keep for faster startup:
    • dirs like huggingface , torch , vllm , flashinfer , etc...
  • To avoid eating up all the GPU VRAM, the --kv-cache-memory-bytes '7G' is set (it allows max model len by 1.02x)
    • Feel free to adjust (or remove the flag and switch back to --gpu-memory-utilization 0.9 ) to increase or decrease KV cache to your liking

Check original project readme for openai like chat template use in requests.

Runs of ig1 NuExtract-2.0-8B-FP8-Dynamic on huggingface.co

16
Total runs
0
24-hour runs
2
3-day runs
0
7-day runs
5
30-day runs

More Information About NuExtract-2.0-8B-FP8-Dynamic huggingface.co Model

More NuExtract-2.0-8B-FP8-Dynamic license Visit here:

https://choosealicense.com/licenses/mit

NuExtract-2.0-8B-FP8-Dynamic huggingface.co

NuExtract-2.0-8B-FP8-Dynamic huggingface.co is an AI model on huggingface.co that provides NuExtract-2.0-8B-FP8-Dynamic's model effect (), which can be used instantly with this ig1 NuExtract-2.0-8B-FP8-Dynamic model. huggingface.co supports a free trial of the NuExtract-2.0-8B-FP8-Dynamic model, and also provides paid use of the NuExtract-2.0-8B-FP8-Dynamic. Support call NuExtract-2.0-8B-FP8-Dynamic model through api, including Node.js, Python, http.

NuExtract-2.0-8B-FP8-Dynamic huggingface.co Url

https://huggingface.co/ig1/NuExtract-2.0-8B-FP8-Dynamic

ig1 NuExtract-2.0-8B-FP8-Dynamic online free

NuExtract-2.0-8B-FP8-Dynamic huggingface.co is an online trial and call api platform, which integrates NuExtract-2.0-8B-FP8-Dynamic's modeling effects, including api services, and provides a free online trial of NuExtract-2.0-8B-FP8-Dynamic, you can try NuExtract-2.0-8B-FP8-Dynamic online for free by clicking the link below.

ig1 NuExtract-2.0-8B-FP8-Dynamic online free url in huggingface.co:

https://huggingface.co/ig1/NuExtract-2.0-8B-FP8-Dynamic

NuExtract-2.0-8B-FP8-Dynamic install

NuExtract-2.0-8B-FP8-Dynamic is an open source model from GitHub that offers a free installation service, and any user can find NuExtract-2.0-8B-FP8-Dynamic on GitHub to install. At the same time, huggingface.co provides the effect of NuExtract-2.0-8B-FP8-Dynamic install, users can directly use NuExtract-2.0-8B-FP8-Dynamic installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

NuExtract-2.0-8B-FP8-Dynamic install url in huggingface.co:

https://huggingface.co/ig1/NuExtract-2.0-8B-FP8-Dynamic

Url of NuExtract-2.0-8B-FP8-Dynamic

NuExtract-2.0-8B-FP8-Dynamic huggingface.co Url

Provider of NuExtract-2.0-8B-FP8-Dynamic huggingface.co

ig1
ORGANIZATIONS

Other API from ig1