afrideva / phi-2-psy-GGUF

huggingface.co
Total runs: 407
24-hour runs: 16
7-day runs: 119
30-day runs: 210
Model's Last Updated: January 20 2024
text-generation

Introduction of phi-2-psy-GGUF

Model Details of phi-2-psy-GGUF

vince62s/phi-2-psy-GGUF

Quantized GGUF model files for phi-2-psy from vince62s

Name Quant method Size
phi-2-psy.fp16.gguf fp16 5.56 GB
phi-2-psy.q2_k.gguf q2_k 1.11 GB
phi-2-psy.q3_k_m.gguf q3_k_m 1.43 GB
phi-2-psy.q4_k_m.gguf q4_k_m 1.74 GB
phi-2-psy.q5_k_m.gguf q5_k_m 2.00 GB
phi-2-psy.q6_k.gguf q6_k 2.29 GB
phi-2-psy.q8_0.gguf q8_0 2.96 GB
Original Model Card:

Phi-2-psy

Phi-2-psy is a merge of the following models:

🏆 Evaluation

The evaluation was performed using LLM AutoEval on Nous suite.

Model AGIEval GPT4All TruthfulQA Bigbench Average
phi-2-psy 34.4 71.4 48.2 38.1 48.02
phixtral-2x2_8 34.1 70.4 48.8 37.8 47.78
dolphin-2_6-phi-2 33.1 69.9 47.4 37.2 46.89
phi-2-orange 33.4 71.3 49.9 37.3 47.97
phi-2 28.0 70.8 44.4 35.2 44.61
🧩 Configuration
slices:
  - sources:
      - model: rhysjones/phi-2-orange
        layer_range: [0, 32]
      - model: cognitivecomputations/dolphin-2_6-phi-2
        layer_range: [0, 32]
merge_method: slerp
base_model: rhysjones/phi-2-orange
parameters:
  t:
    - filter: self_attn
      value: [0, 0.5, 0.3, 0.7, 1]
    - filter: mlp
      value: [1, 0.5, 0.7, 0.3, 0]
    - value: 0.5
dtype: bfloat16
💻 Usage
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
torch.set_default_device("cuda")
model = AutoModelForCausalLM.from_pretrained("vince62s/phi-2-psy", torch_dtype="auto", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("vince62s/phi-2-psy", trust_remote_code=True)
inputs = tokenizer('''def print_prime(n):
   """
   Print all primes between 1 and n
   """''', return_tensors="pt", return_attention_mask=False)
outputs = model.generate(**inputs, max_length=200)
text = tokenizer.batch_decode(outputs)[0]
print(text)

Runs of afrideva phi-2-psy-GGUF on huggingface.co

407
Total runs
16
24-hour runs
47
3-day runs
119
7-day runs
210
30-day runs

More Information About phi-2-psy-GGUF huggingface.co Model

More phi-2-psy-GGUF license Visit here:

https://choosealicense.com/licenses/mit

phi-2-psy-GGUF huggingface.co

phi-2-psy-GGUF huggingface.co is an AI model on huggingface.co that provides phi-2-psy-GGUF's model effect (), which can be used instantly with this afrideva phi-2-psy-GGUF model. huggingface.co supports a free trial of the phi-2-psy-GGUF model, and also provides paid use of the phi-2-psy-GGUF. Support call phi-2-psy-GGUF model through api, including Node.js, Python, http.

phi-2-psy-GGUF huggingface.co Url

https://huggingface.co/afrideva/phi-2-psy-GGUF

afrideva phi-2-psy-GGUF online free

phi-2-psy-GGUF huggingface.co is an online trial and call api platform, which integrates phi-2-psy-GGUF's modeling effects, including api services, and provides a free online trial of phi-2-psy-GGUF, you can try phi-2-psy-GGUF online for free by clicking the link below.

afrideva phi-2-psy-GGUF online free url in huggingface.co:

https://huggingface.co/afrideva/phi-2-psy-GGUF

phi-2-psy-GGUF install

phi-2-psy-GGUF is an open source model from GitHub that offers a free installation service, and any user can find phi-2-psy-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of phi-2-psy-GGUF install, users can directly use phi-2-psy-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

phi-2-psy-GGUF install url in huggingface.co:

https://huggingface.co/afrideva/phi-2-psy-GGUF

Url of phi-2-psy-GGUF

phi-2-psy-GGUF huggingface.co Url

Provider of phi-2-psy-GGUF huggingface.co

afrideva
ORGANIZATIONS

Other API from afrideva

huggingface.co

Total runs: 417
Run Growth: 153
Growth Rate: 36.69%
Updated:December 18 2023
huggingface.co

Total runs: 401
Run Growth: 246
Growth Rate: 61.35%
Updated:December 08 2023