CultriX / Qwestion-14B

huggingface.co
Total runs: 20
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: November 27 2024
text-generation

Introduction of Qwestion-14B

Model Details of Qwestion-14B

merge

This is a merge of pre-trained language models created using mergekit .

Merge Details
Merge Method

This model was merged using the DARE TIES merge method using Qwen/Qwen2.5-14B as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: CultriX/Qwen2.5-14B-Wernicke
    parameters:
      weight: 0.55         # Backbone model for conversational ability and GPQA
      density: 0.80        # Retain most critical parameters for stability and strength
  - model: VAGOsolutions/SauerkrautLM-v2-14b-DPO
    parameters:
      weight: 0.20         # High IFEval and MMLU-PRO performance with minimized weaknesses
      density: 0.60        # Focus on impactful parameters for specific benchmarks
  - model: rombodawg/Rombos-LLM-V2.6-Qwen-14b
    parameters:
      weight: 0.25         # Enhanced emphasis on reasoning-heavy tasks like MUSR and MATH
      density: 0.70        # Retain reasoning-intensive parameters for improved benchmarks
  - model: allknowingroger/Qwenslerp2-14B
    parameters:
      weight: 0.15         # General stabilizer for consistency across all tasks
      density: 0.65        # Focus on balance and avoiding redundancy
base_model: Qwen/Qwen2.5-14B
merge_method: dare_ties
parameters:
  normalize: true          # Ensure parameter scale consistency
  int8_mask: true          # Optimize for memory and compute efficiency
dtype: bfloat16
tokenizer_source: Qwen/Qwen2.5-14B-Instruct
adaptive_merge_parameters:
  task_weights:
    IFEval: 1.0            # Maintain high IFEval performance
    MATH: 1.3              # Prioritize reasoning and calculation-heavy tasks
    GPQA: 1.1              # Boost factual recall and reasoning accuracy
    MUSR: 1.2              # Enhance logical reasoning and factual understanding
    MMLU-PRO: 1.0          # Retain consistent knowledge representation
  smoothing_factor: 0.15   # Fine-tune blending for stable transitions between tasks
gradient_clipping: 1.0      # Prevent over-contribution from any single model

Runs of CultriX Qwestion-14B on huggingface.co

20
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About Qwestion-14B huggingface.co Model

More Qwestion-14B license Visit here:

https://choosealicense.com/licenses/apache-2.0

Qwestion-14B huggingface.co

Qwestion-14B huggingface.co is an AI model on huggingface.co that provides Qwestion-14B's model effect (), which can be used instantly with this CultriX Qwestion-14B model. huggingface.co supports a free trial of the Qwestion-14B model, and also provides paid use of the Qwestion-14B. Support call Qwestion-14B model through api, including Node.js, Python, http.

Qwestion-14B huggingface.co Url

https://huggingface.co/CultriX/Qwestion-14B

CultriX Qwestion-14B online free

Qwestion-14B huggingface.co is an online trial and call api platform, which integrates Qwestion-14B's modeling effects, including api services, and provides a free online trial of Qwestion-14B, you can try Qwestion-14B online for free by clicking the link below.

CultriX Qwestion-14B online free url in huggingface.co:

https://huggingface.co/CultriX/Qwestion-14B

Qwestion-14B install

Qwestion-14B is an open source model from GitHub that offers a free installation service, and any user can find Qwestion-14B on GitHub to install. At the same time, huggingface.co provides the effect of Qwestion-14B install, users can directly use Qwestion-14B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Qwestion-14B install url in huggingface.co:

https://huggingface.co/CultriX/Qwestion-14B

Url of Qwestion-14B

Qwestion-14B huggingface.co Url

Provider of Qwestion-14B huggingface.co

CultriX
ORGANIZATIONS

Other API from CultriX

huggingface.co

Total runs: 78
Run Growth: 10
Growth Rate: 12.82%
Updated:February 21 2024
huggingface.co

Total runs: 61
Run Growth: -3
Growth Rate: -4.92%
Updated:January 27 2024
huggingface.co

Total runs: 60
Run Growth: -2
Growth Rate: -3.33%
Updated:January 27 2024
huggingface.co

Total runs: 41
Run Growth: 6
Growth Rate: 14.63%
Updated:November 27 2024
huggingface.co

Total runs: 20
Run Growth: 0
Growth Rate: 0.00%
Updated:February 21 2024