rufimelo / secure_code_qwen_coder_topk_cl_16384

Sparse Autoencoders for Unknown

This repository contains 3 Sparse Autoencoder(s) (SAE) trained using SAELens .

Model Details

Available Hook Points

Usage

from sae_lens import SAE

# Load an SAE for a specific hook point
sae, cfg_dict, sparsity = SAE.from_pretrained(
    release="rufimelo/secure_code_qwen_coder_topk_cl_16384",
    sae_id="blocks.0.hook_resid_post"  # Choose from available hook points above
)

# Use with TransformerLens
from transformer_lens import HookedTransformer

model = HookedTransformer.from_pretrained("Unknown")

# Get activations and encode
_, cache = model.run_with_cache("your text here")
activations = cache["blocks.0.hook_resid_post"]
features = sae.encode(activations)

Files

• blocks.0.hook_resid_post/cfg.json - SAE configuration
• blocks.0.hook_resid_post/sae_weights.safetensors - Model weights
• blocks.0.hook_resid_post/sparsity.safetensors - Feature sparsity statistics
• blocks.14.hook_resid_post/cfg.json - SAE configuration
• blocks.14.hook_resid_post/sae_weights.safetensors - Model weights
• blocks.14.hook_resid_post/sparsity.safetensors - Feature sparsity statistics
• blocks.27.hook_resid_post/cfg.json - SAE configuration
• blocks.27.hook_resid_post/sae_weights.safetensors - Model weights
• blocks.27.hook_resid_post/sparsity.safetensors - Feature sparsity statistics

Training

These SAEs were trained with SAELens version 6.26.2.