CultriX / SeQwence-14B

huggingface.co
Total runs: 37
24-hour runs: 1
7-day runs: 2
30-day runs: 10
Model's Last Updated: November 27 2024
text-generation

Introduction of SeQwence-14B

Model Details of SeQwence-14B

SeQwence-14B

SeQwence-14B is a merge of the following models using mergekit :

🧩 Configuration
merge_method: dare_linear  # Weighted task arithmetic for balancing specialized and general strengths
dtype: fp16  # Mixed precision to optimize resource usage and compatibility
tokenizer_source: CultriX/Qwen2.5-14B-Wernicke  # Use the tokenizer from the top-performing model

parameters:
  weight_decay: 0.01  # Minimal decay to smooth parameter integration

models:
  - model: CultriX/Qwen2.5-14B-Wernicke
    weight: 0.40  # Core base for general and specialized benchmarks
  - model: CultriX/SeQwence-14B-v5
    weight: 0.25  # Adds consistency and robustness
  - model: CultriX/SeQwence-14B-v6
    weight: 0.20  # Enhances conversational and structured performance
  - model: CultriX/Qwen2.5-14B-Wernicke-DPO
    weight: 0.10  # Boosts performance in medical benchmarks
  - model: CultriX/Qwen2.5-14B-MegaMerge-pt2
    weight: 0.05  # Generalization and diversity contribution

base_model: CultriX/Qwen2.5-14B-Wernicke  # Use this as the core architecture for adaptation

parameters:
  normalization: true  # Layer-wise normalization to avoid instability
  adaptive_layer_weighting: true  # Dynamically adjust contributions layer-by-layer

Runs of CultriX SeQwence-14B on huggingface.co

37
Total runs
1
24-hour runs
-1
3-day runs
2
7-day runs
10
30-day runs

More Information About SeQwence-14B huggingface.co Model

More SeQwence-14B license Visit here:

https://choosealicense.com/licenses/apache-2.0

SeQwence-14B huggingface.co

SeQwence-14B huggingface.co is an AI model on huggingface.co that provides SeQwence-14B's model effect (), which can be used instantly with this CultriX SeQwence-14B model. huggingface.co supports a free trial of the SeQwence-14B model, and also provides paid use of the SeQwence-14B. Support call SeQwence-14B model through api, including Node.js, Python, http.

SeQwence-14B huggingface.co Url

https://huggingface.co/CultriX/SeQwence-14B

CultriX SeQwence-14B online free

SeQwence-14B huggingface.co is an online trial and call api platform, which integrates SeQwence-14B's modeling effects, including api services, and provides a free online trial of SeQwence-14B, you can try SeQwence-14B online for free by clicking the link below.

CultriX SeQwence-14B online free url in huggingface.co:

https://huggingface.co/CultriX/SeQwence-14B

SeQwence-14B install

SeQwence-14B is an open source model from GitHub that offers a free installation service, and any user can find SeQwence-14B on GitHub to install. At the same time, huggingface.co provides the effect of SeQwence-14B install, users can directly use SeQwence-14B installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

SeQwence-14B install url in huggingface.co:

https://huggingface.co/CultriX/SeQwence-14B

Url of SeQwence-14B

SeQwence-14B huggingface.co Url

Provider of SeQwence-14B huggingface.co

CultriX
ORGANIZATIONS

Other API from CultriX

huggingface.co

Total runs: 68
Run Growth: 7
Growth Rate: 10.29%
Updated:February 21 2024
huggingface.co

Total runs: 56
Run Growth: -6
Growth Rate: -10.71%
Updated:January 27 2024
huggingface.co

Total runs: 50
Run Growth: -9
Growth Rate: -18.00%
Updated:January 27 2024
huggingface.co

Total runs: 20
Run Growth: 0
Growth Rate: 0.00%
Updated:February 21 2024
huggingface.co

Total runs: 20
Run Growth: 0
Growth Rate: 0.00%
Updated:November 27 2024