duyntnet / codegeex4-all-9b-imatrix-GGUF

huggingface.co
Total runs: 971
24-hour runs: 1
7-day runs: 92
30-day runs: 671
Model's Last Updated: July 28 2024
text-generation

Introduction of codegeex4-all-9b-imatrix-GGUF

Model Details of codegeex4-all-9b-imatrix-GGUF

Quantizations of https://huggingface.co/THUDM/codegeex4-all-9b

Inference Clients/UIs

From original readme

Get Started

Use 4.39.0<=transformers<=4.40.2 to quickly launch codegeex4-all-9b :

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM

device = "cuda" if torch.cuda.is_available() else "cpu"
tokenizer = AutoTokenizer.from_pretrained("THUDM/codegeex4-all-9b", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    "THUDM/codegeex4-all-9b",
    torch_dtype=torch.bfloat16,
    low_cpu_mem_usage=True,
    trust_remote_code=True
).to(device).eval()
inputs = tokenizer.apply_chat_template([{"role": "user", "content": "write a quick sort"}], add_generation_prompt=True, tokenize=True, return_tensors="pt", return_dict=True ).to(device)
with torch.no_grad():
    outputs = model.generate(**inputs, max_length=256)
    outputs = outputs[:, inputs['input_ids'].shape[1]:]
    print(tokenizer.decode(outputs[0], skip_special_tokens=True))

If you want to build the chat prompt manually, please make sure it follows the following format:

f"<|system|>\n{system_prompt}\n<|user|>\n{prompt}\n<|assistant|>\n"

Default system_prompt:

你是一位智能编程助手,你叫CodeGeeX。你会为用户回答关于编程、代码、计算机方面的任何问题,并提供格式规范、可以执行、准确安全的代码,并在必要时提供详细的解释。

The English version:

You are an intelligent programming assistant named CodeGeeX. You will answer any questions users have about programming, coding, and computers, and provide code that is formatted correctly.

For infilling ability, please use (without system prompt):

f"<|user|>\n<|code_suffix|>{suffix}<|code_prefix|>{prefix}<|code_middle|><|assistant|>\n"

Additional infos (like file path, programming language, mode) can be added. Example:

<|user|>
###PATH:src/example.py
###LANGUAGE:Python
###MODE:BLOCK
<|code_suffix|>{suffix}<|code_prefix|>{prefix}<|code_middle|><|assistant|>

Runs of duyntnet codegeex4-all-9b-imatrix-GGUF on huggingface.co

971
Total runs
1
24-hour runs
-3
3-day runs
92
7-day runs
671
30-day runs

More Information About codegeex4-all-9b-imatrix-GGUF huggingface.co Model

More codegeex4-all-9b-imatrix-GGUF license Visit here:

https://choosealicense.com/licenses/other

codegeex4-all-9b-imatrix-GGUF huggingface.co

codegeex4-all-9b-imatrix-GGUF huggingface.co is an AI model on huggingface.co that provides codegeex4-all-9b-imatrix-GGUF's model effect (), which can be used instantly with this duyntnet codegeex4-all-9b-imatrix-GGUF model. huggingface.co supports a free trial of the codegeex4-all-9b-imatrix-GGUF model, and also provides paid use of the codegeex4-all-9b-imatrix-GGUF. Support call codegeex4-all-9b-imatrix-GGUF model through api, including Node.js, Python, http.

codegeex4-all-9b-imatrix-GGUF huggingface.co Url

https://huggingface.co/duyntnet/codegeex4-all-9b-imatrix-GGUF

duyntnet codegeex4-all-9b-imatrix-GGUF online free

codegeex4-all-9b-imatrix-GGUF huggingface.co is an online trial and call api platform, which integrates codegeex4-all-9b-imatrix-GGUF's modeling effects, including api services, and provides a free online trial of codegeex4-all-9b-imatrix-GGUF, you can try codegeex4-all-9b-imatrix-GGUF online for free by clicking the link below.

duyntnet codegeex4-all-9b-imatrix-GGUF online free url in huggingface.co:

https://huggingface.co/duyntnet/codegeex4-all-9b-imatrix-GGUF

codegeex4-all-9b-imatrix-GGUF install

codegeex4-all-9b-imatrix-GGUF is an open source model from GitHub that offers a free installation service, and any user can find codegeex4-all-9b-imatrix-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of codegeex4-all-9b-imatrix-GGUF install, users can directly use codegeex4-all-9b-imatrix-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

codegeex4-all-9b-imatrix-GGUF install url in huggingface.co:

https://huggingface.co/duyntnet/codegeex4-all-9b-imatrix-GGUF

Url of codegeex4-all-9b-imatrix-GGUF

codegeex4-all-9b-imatrix-GGUF huggingface.co Url

Provider of codegeex4-all-9b-imatrix-GGUF huggingface.co

duyntnet
ORGANIZATIONS

Other API from duyntnet