brittlewis12 / OpenCodeInterpreter-DS-6.7B-GGUF

huggingface.co
Total runs: 181
24-hour runs: -40
7-day runs: -114
30-day runs: -74
Model's Last Updated: February 24 2024
text-generation

Introduction of OpenCodeInterpreter-DS-6.7B-GGUF

Model Details of OpenCodeInterpreter-DS-6.7B-GGUF

HumanEval-pass@1

OpenCodeInterpreter-DS-6.7B GGUF

Original model : OpenCodeInterpreter-DS-6.7B

Model creator : Multimodal Art Projection Research Community

This repo contains GGUF format model files for Multimodal Art Projection Research Community (M-A-P)’s OpenCodeInterpreter-DS-6.7B.

The introduction of large language models has significantly advanced code generation. However, open-source models often lack the execution capabilities and iterative refinement of advanced systems like the GPT-4 Code Interpreter. To address this, we introduce OpenCodeInterpreter, a family of open-source code systems designed for generating, executing, and iteratively refining code. Supported by Code-Feedback, a dataset featuring 68K multi-turn interactions, OpenCodeInterpreter integrates execution and human feedback for dynamic code refinement. Our comprehensive evaluation of OpenCodeInterpreter across key benchmarks such as HumanEval, MBPP, and their enhanced versions from EvalPlus reveals its exceptional performance. Notably, OpenCodeInterpreter-33B achieves an accuracy of 83.2 (76.4) on the average (and plus versions) of HumanEval and MBPP, closely rivaling GPT-4's 84.2 (76.2) and further elevates to 91.6 (84.6) with synthesized human feedback from GPT-4. OpenCodeInterpreter brings the gap between open-source code generation models and proprietary systems like GPT-4 Code Interpreter.

Learn more on M-A-P’s Model page .

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 2249 (revision 15499eb )

Prompt template
<|User|>
{{prompt}}

<|Assistant|>

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs.ai

cnvrs is the best app for private, local AI on your device:

  • create & save Characters with custom system prompts & temperature settings
  • download and experiment with any GGUF model you can find on HuggingFace !
  • make it your own with custom Theme colors
  • powered by Metal ⚡️ & Llama.cpp , with haptics during response streaming!
  • try it out yourself today, on Testflight !
  • follow cnvrs on twitter to stay up to date

Original Model Evaluation

The study leverages data from the EvalPlus leaderboard, examining OpenCodeInterpreter's performance against benchmarks such as GPT-3.5/4-Turbo, CodeLlama-Python, WizardCoder, Deepseek-Coder, and CodeT5+ across various scales on the HumanEval and MBPP benchmarks and their advanced versions. For multi-turn code generation, the focus shifts to assessing OpenCodeInterpreter's capability in iterative refinement through a two-round limit, considering execution feedback and human feedback scenarios. The experimental setup aims to highlight OpenCodeInterpreter's adaptability and proficiency in code generation, underscored by its achievements in setting new standards in software development tools through iterative feedback and refinement.

For more detail on evaluation process, see main results & eval code README .

Model HumanEval (+) MBPP (+) Average (+)
OpenCodeInterpreter-DS-6.7B 76.2 (72.0) 73.9 (63.7) 75.1 (67.9)
--> with Execution Feedback 81.1 (78.7) 82.7 (72.4) 81.9 (75.6)
--> with Synth. Human Feedback 87.2 ( 86.6 ) 86.2 (74.2) 86.7 (80.4)
--> with Synth. Human Feedback (Oracle) 89.7 (86.6) 87.2 (75.2) 88.5 (80.9)
— — — —
GPT-4-Turbo 85.4 (81.7) 83.0 (70.7) 84.2 (76.2)
--> with Execution Feedback 88.0 (84.2) 92.0 (78.2) 90.0 (81.2)
— — — —
GPT-3.5-Turbo 72.6 (65.9) 81.7 (69.4) 77.2 (67.7)
--> with Execution Feedback 76.8 (70.7) 87.0 (73.9) 81.9 (72.3)

Runs of brittlewis12 OpenCodeInterpreter-DS-6.7B-GGUF on huggingface.co

181
Total runs
-40
24-hour runs
-64
3-day runs
-114
7-day runs
-74
30-day runs

More Information About OpenCodeInterpreter-DS-6.7B-GGUF huggingface.co Model

More OpenCodeInterpreter-DS-6.7B-GGUF license Visit here:

https://choosealicense.com/licenses/apache-2.0

OpenCodeInterpreter-DS-6.7B-GGUF huggingface.co

OpenCodeInterpreter-DS-6.7B-GGUF huggingface.co is an AI model on huggingface.co that provides OpenCodeInterpreter-DS-6.7B-GGUF's model effect (), which can be used instantly with this brittlewis12 OpenCodeInterpreter-DS-6.7B-GGUF model. huggingface.co supports a free trial of the OpenCodeInterpreter-DS-6.7B-GGUF model, and also provides paid use of the OpenCodeInterpreter-DS-6.7B-GGUF. Support call OpenCodeInterpreter-DS-6.7B-GGUF model through api, including Node.js, Python, http.

OpenCodeInterpreter-DS-6.7B-GGUF huggingface.co Url

https://huggingface.co/brittlewis12/OpenCodeInterpreter-DS-6.7B-GGUF

brittlewis12 OpenCodeInterpreter-DS-6.7B-GGUF online free

OpenCodeInterpreter-DS-6.7B-GGUF huggingface.co is an online trial and call api platform, which integrates OpenCodeInterpreter-DS-6.7B-GGUF's modeling effects, including api services, and provides a free online trial of OpenCodeInterpreter-DS-6.7B-GGUF, you can try OpenCodeInterpreter-DS-6.7B-GGUF online for free by clicking the link below.

brittlewis12 OpenCodeInterpreter-DS-6.7B-GGUF online free url in huggingface.co:

https://huggingface.co/brittlewis12/OpenCodeInterpreter-DS-6.7B-GGUF

OpenCodeInterpreter-DS-6.7B-GGUF install

OpenCodeInterpreter-DS-6.7B-GGUF is an open source model from GitHub that offers a free installation service, and any user can find OpenCodeInterpreter-DS-6.7B-GGUF on GitHub to install. At the same time, huggingface.co provides the effect of OpenCodeInterpreter-DS-6.7B-GGUF install, users can directly use OpenCodeInterpreter-DS-6.7B-GGUF installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

OpenCodeInterpreter-DS-6.7B-GGUF install url in huggingface.co:

https://huggingface.co/brittlewis12/OpenCodeInterpreter-DS-6.7B-GGUF

Url of OpenCodeInterpreter-DS-6.7B-GGUF

OpenCodeInterpreter-DS-6.7B-GGUF huggingface.co Url

Provider of OpenCodeInterpreter-DS-6.7B-GGUF huggingface.co

brittlewis12
ORGANIZATIONS

Other API from brittlewis12