FreedomIntelligence / AceGPT-7b-chat-GPTQ

huggingface.co
Total runs: 17
24-hour runs: 0
7-day runs: -3
30-day runs: -18
Model's Last Updated: December 15 2023
text-generation

Introduction of AceGPT-7b-chat-GPTQ

Model Details of AceGPT-7b-chat-GPTQ

Updates

Add arg ’ use_safetensors=False ‘ in from_quanted(), while this arg is set to False as defauly in previous Auto-GPTQ. If there are any problems to load model directly by HF, someone can try git clone . (Dec 15, 2023)

Description

This repo contains int4 model(GPTQ) for AceGPT-7B-Chat .

The performance of the int4 version has experienced some degradation. For a better user experience, please use the fp16 version. For details, see AceGPT-7B-Chat and AceGPT-13B-Chat .

How to use this GPTQ model from Python code
Install the necessary packages

Requires: Transformers 4.32.0 or later, Optimum 1.12.0 or later, and AutoGPTQ 0.4.2 or later.

pip3 install transformers>=4.32.0 optimum>=1.12.0   #See requirements.py for verified versions.
pip3 install auto-gptq --extra-index-url https://huggingface.github.io/autogptq-index/whl/cu118/  # Use cu117 if on CUDA 11.7
You can then generate a simple gradioweb with_quant.py
python web_quant.py --model-name ${model-path}

You can get more details at https://github.com/FreedomIntelligence/AceGPT/tree/main

Runs of FreedomIntelligence AceGPT-7b-chat-GPTQ on huggingface.co

17
Total runs
0
24-hour runs
-1
3-day runs
-3
7-day runs
-18
30-day runs

More Information About AceGPT-7b-chat-GPTQ huggingface.co Model

AceGPT-7b-chat-GPTQ huggingface.co

AceGPT-7b-chat-GPTQ huggingface.co is an AI model on huggingface.co that provides AceGPT-7b-chat-GPTQ's model effect (), which can be used instantly with this FreedomIntelligence AceGPT-7b-chat-GPTQ model. huggingface.co supports a free trial of the AceGPT-7b-chat-GPTQ model, and also provides paid use of the AceGPT-7b-chat-GPTQ. Support call AceGPT-7b-chat-GPTQ model through api, including Node.js, Python, http.

FreedomIntelligence AceGPT-7b-chat-GPTQ online free

AceGPT-7b-chat-GPTQ huggingface.co is an online trial and call api platform, which integrates AceGPT-7b-chat-GPTQ's modeling effects, including api services, and provides a free online trial of AceGPT-7b-chat-GPTQ, you can try AceGPT-7b-chat-GPTQ online for free by clicking the link below.

FreedomIntelligence AceGPT-7b-chat-GPTQ online free url in huggingface.co:

https://huggingface.co/FreedomIntelligence/AceGPT-7b-chat-GPTQ

AceGPT-7b-chat-GPTQ install

AceGPT-7b-chat-GPTQ is an open source model from GitHub that offers a free installation service, and any user can find AceGPT-7b-chat-GPTQ on GitHub to install. At the same time, huggingface.co provides the effect of AceGPT-7b-chat-GPTQ install, users can directly use AceGPT-7b-chat-GPTQ installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

AceGPT-7b-chat-GPTQ install url in huggingface.co:

https://huggingface.co/FreedomIntelligence/AceGPT-7b-chat-GPTQ

Url of AceGPT-7b-chat-GPTQ

Provider of AceGPT-7b-chat-GPTQ huggingface.co

FreedomIntelligence
ORGANIZATIONS

Other API from FreedomIntelligence