Sponsored by
Vmake Labs Video Enhancer
-Vmake Labs Video Enhancer uses AI to improve video quality, restore details, reduce blur, and upscale videos to 8K.
Add arg ’
use_safetensors=False
‘ in from_quanted(), while this arg is set to False as defauly in previous Auto-GPTQ. If there are any problems to load model directly by HF, someone can try
git clone
. (Dec 15, 2023)
The performance of the int4 version has experienced some degradation. For a better user experience, please use the fp16 version.
For details, see
AceGPT-7B-Chat
and
AceGPT-13B-Chat
.
How to use this GPTQ model from Python code
Install the necessary packages
Requires: Transformers 4.32.0 or later, Optimum 1.12.0 or later, and AutoGPTQ 0.4.2 or later.
pip3 install transformers>=4.32.0 optimum>=1.12.0 #See requirements.py for verified versions.
pip3 install auto-gptq --extra-index-url https://huggingface.github.io/autogptq-index/whl/cu118/ # Use cu117 if on CUDA 11.7
You can then generate a simple gradioweb with_quant.py
Runs of FreedomIntelligence AceGPT-7b-chat-GPTQ on huggingface.co
17
Total runs
0
24-hour runs
-1
3-day runs
-3
7-day runs
-18
30-day runs
More Information About AceGPT-7b-chat-GPTQ huggingface.co Model
AceGPT-7b-chat-GPTQ huggingface.co
AceGPT-7b-chat-GPTQ huggingface.co is an AI model on huggingface.co that provides AceGPT-7b-chat-GPTQ's model effect (), which can be used instantly with this FreedomIntelligence AceGPT-7b-chat-GPTQ model. huggingface.co supports a free trial of the AceGPT-7b-chat-GPTQ model, and also provides paid use of the AceGPT-7b-chat-GPTQ. Support call AceGPT-7b-chat-GPTQ model through api, including Node.js, Python, http.
AceGPT-7b-chat-GPTQ huggingface.co is an online trial and call api platform, which integrates AceGPT-7b-chat-GPTQ's modeling effects, including api services, and provides a free online trial of AceGPT-7b-chat-GPTQ, you can try AceGPT-7b-chat-GPTQ online for free by clicking the link below.
FreedomIntelligence AceGPT-7b-chat-GPTQ online free url in huggingface.co:
AceGPT-7b-chat-GPTQ is an open source model from GitHub that offers a free installation service, and any user can find AceGPT-7b-chat-GPTQ on GitHub to install. At the same time, huggingface.co provides the effect of AceGPT-7b-chat-GPTQ install, users can directly use AceGPT-7b-chat-GPTQ installed effect in huggingface.co for debugging and trial. It also supports api for free installation.
AceGPT-7b-chat-GPTQ install url in huggingface.co: