CultriX / Qwen2.5-14B-Hyperionv7

huggingface.co
Total runs: 18
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: January 19 2025
text-generation

Introduction of Qwen2.5-14B-Hyperionv7

Model Details of Qwen2.5-14B-Hyperionv7

merge

This is a merge of pre-trained language models created using mergekit .

Merge Details
Merge Method

This model was merged using the DARE TIES merge method using CultriX/Qwen2.5-14B-Wernickev3 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

merge_method: dare_ties  # Merge method for dynamic, task-aware parameter blending.
base_model: CultriX/Qwen2.5-14B-Wernickev3  # Main backbone for parameter alignment.
dtype: bfloat16  # Efficient precision for memory usage.
out_dtype: bfloat16  # Output data type to maintain consistency and efficiency.

parameters:
  epsilon: 0.010   # Fine-tuned scaling for precise parameter adjustments.
  lambda: 2.0   # Emphasizes high-impact parameters for improved task performance.
  normalize: true  # Ensures parameter normalization for stability during merging.
  rescale: true  # Rescales parameters across models for better integration.
  int8_mask: false  # Disables int8 masking to preserve full precision.

adaptive_merge_parameters:
  task_weights:  # Weight prioritization for tasks.
    tinyArc: 1.6  # Balanced focus on logical reasoning.
    tinyHellaswag: 1.5  # Moderate priority for contextual reasoning.
    tinyMMLU: 1.8  # High priority for multi-domain knowledge tasks.
    tinyTruthfulQA: 2.2  # High emphasis on factual QA accuracy.
    tinyTruthfulQA_mc1: 1.8  # High priority for multiple-choice factual QA.
    tinyWinogrande: 1.75  # Moderate priority for contextual reasoning tasks.
    IFEval: 2.5  # Maximum priority for instruction-following tasks.
    BBH: 2.2  # High priority for complex reasoning tasks.
    MATH: 2.8  # Maximum priority for mathematical reasoning.
    GPQA: 2.2  # Balanced focus on graduate-level QA tasks.
    MUSR: 2.2  # High priority for multi-step reasoning.
    MMLU-PRO: 2.0  # High priority for multitask, domain-specific knowledge.
  smoothing_factor: 0.03  # Precise blending of task-specific contributions.

gradient_clipping:  # Gradient clipping for stability during merging.
  CultriX/Qwen2.5-14B-Wernickev3: 0.89  # Stability for the base model.
  djuna/Q2.5-Veltha-14B-0.5: 0.91  # Stability for reasoning contributions.
  CultriX/SeQwence-14B-EvolMerge: 0.87  # Stabilized for multitask performance.
  qingy2024/Fusion4-14B-Instruct: 0.93  # High stability for mathematical reasoning.
  CultriX/Qwen2.5-14B-Emerged: 0.89  # Stability for multitask contributions.
  sometimesanotion/Lamarck-14B-v0.6: 0.89  # Stability for multi-step reasoning.
  allknowingroger/QwenSlerp6-14B: 0.90  # Stability for general reasoning and multitask tasks.
  hotmailuser/QwenSlerp2-14B: 0.91  # Stabilized for instruction following.
  CultriX/Qwen2.5-14B-Hyperionv3: 0.90  # Stability for this model's general performance.
  CultriX/Qwen2.5-14B-Brocav7: 0.90  # Stability for specific task contributions.

models:  # Definition of models and their weights/densities.
  - model: CultriX/Qwen2.5-14B-Wernickev3  # Base generalist model.
    parameters:
      weight: 0.28  # Balanced weight for a strong backbone.
      density: 0.78  # Slightly reduced to balance smaller contributors.

  - model: djuna/Q2.5-Veltha-14B-0.5  # Reasoning-focused model.
    parameters:
      weight: 0.27  # Slightly reduced for better balance.
      density: 0.77  # Balanced density to ensure nuanced reasoning contributions.

  - model: allknowingroger/QwenSlerp6-14B  # Strong multitask performer.
    parameters:
      weight: 0.15  # Balanced weight for generalist capabilities.
      density: 0.76  # Balanced density to maintain stable contributions.

  - model: hotmailuser/QwenSlerp2-14B  # High IFEval performer.
    parameters:
      weight: 0.12  # Maintains stable contributions for instruction-following tasks.
      density: 0.70  # Increased density to enhance integration.

  - model: CultriX/Qwen2.5-14B-Hyperionv3  # Generalist model with solid performance.
    parameters:
      weight: 0.10  # Increased for balanced general contributions.
      density: 0.75  # Balanced density for stable integration.

  - model: CultriX/Qwen2.5-14B-Brocav7  # Model for specific tasks like reasoning.
    parameters:
      weight: 0.10  # Increased weight to strengthen specific contributions.
      density: 0.76  # Increased density for better parameter preservation.

  - model: CultriX/SeQwence-14B-EvolMerge  # Multitask generalist.
    parameters:
      weight: 0.08  # Balanced weight for broader coverage.
      density: 0.68  # Slight increase for better integration.

  - model: qingy2024/Fusion4-14B-Instruct  # Specialist in mathematical reasoning.
    parameters:
      weight: 0.08  # Balanced weight for MATH tasks.
      density: 0.78  # Increased density to enhance task-specific integration.

  - model: CultriX/Qwen2.5-14B-Emerged  # General multitask model.
    parameters:
      weight: 0.08  # Balanced for multitask contributions.
      density: 0.72  # Increased density for better parameter alignment.

  - model: sometimesanotion/Lamarck-14B-v0.6  # Multi-step reasoning focus.
    parameters:
      weight: 0.05  # Slightly increased to improve its contributions.
      density: 0.65  # Increased for better parameter blending.

Runs of CultriX Qwen2.5-14B-Hyperionv7 on huggingface.co

18
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About Qwen2.5-14B-Hyperionv7 huggingface.co Model

Qwen2.5-14B-Hyperionv7 huggingface.co

Qwen2.5-14B-Hyperionv7 huggingface.co is an AI model on huggingface.co that provides Qwen2.5-14B-Hyperionv7's model effect (), which can be used instantly with this CultriX Qwen2.5-14B-Hyperionv7 model. huggingface.co supports a free trial of the Qwen2.5-14B-Hyperionv7 model, and also provides paid use of the Qwen2.5-14B-Hyperionv7. Support call Qwen2.5-14B-Hyperionv7 model through api, including Node.js, Python, http.

Qwen2.5-14B-Hyperionv7 huggingface.co Url

https://huggingface.co/CultriX/Qwen2.5-14B-Hyperionv7

CultriX Qwen2.5-14B-Hyperionv7 online free

Qwen2.5-14B-Hyperionv7 huggingface.co is an online trial and call api platform, which integrates Qwen2.5-14B-Hyperionv7's modeling effects, including api services, and provides a free online trial of Qwen2.5-14B-Hyperionv7, you can try Qwen2.5-14B-Hyperionv7 online for free by clicking the link below.

CultriX Qwen2.5-14B-Hyperionv7 online free url in huggingface.co:

https://huggingface.co/CultriX/Qwen2.5-14B-Hyperionv7

Qwen2.5-14B-Hyperionv7 install

Qwen2.5-14B-Hyperionv7 is an open source model from GitHub that offers a free installation service, and any user can find Qwen2.5-14B-Hyperionv7 on GitHub to install. At the same time, huggingface.co provides the effect of Qwen2.5-14B-Hyperionv7 install, users can directly use Qwen2.5-14B-Hyperionv7 installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

Qwen2.5-14B-Hyperionv7 install url in huggingface.co:

https://huggingface.co/CultriX/Qwen2.5-14B-Hyperionv7

Url of Qwen2.5-14B-Hyperionv7

Qwen2.5-14B-Hyperionv7 huggingface.co Url

Provider of Qwen2.5-14B-Hyperionv7 huggingface.co

CultriX
ORGANIZATIONS

Other API from CultriX

huggingface.co

Total runs: 70
Run Growth: 10
Growth Rate: 14.29%
Updated:February 21 2024
huggingface.co

Total runs: 56
Run Growth: -5
Growth Rate: -8.93%
Updated:January 27 2024
huggingface.co

Total runs: 50
Run Growth: -8
Growth Rate: -16.00%
Updated:January 27 2024
huggingface.co

Total runs: 37
Run Growth: 10
Growth Rate: 27.03%
Updated:November 27 2024
huggingface.co

Total runs: 20
Run Growth: 0
Growth Rate: 0.00%
Updated:February 21 2024
huggingface.co

Total runs: 20
Run Growth: 0
Growth Rate: 0.00%
Updated:November 27 2024