dmusingu / lapvqa-pretrain-sigmoid

huggingface.co
Total runs: 0
24-hour runs: 0
7-day runs: 0
30-day runs: 0
Model's Last Updated: June 06 2026

Introduction of lapvqa-pretrain-sigmoid

Model Details of lapvqa-pretrain-sigmoid

LAPVQA — Pretrain (Sigmoid)

Part of the LAPVQA collection .

Description

A ViT-L/14 vision encoder trained from scratch on MIMIC-CXR using a sigmoid (multi-label binary cross-entropy) contrastive loss — an alternative to InfoNCE that treats each image-text pair independently rather than competing within the batch.

Architecture
Component Detail
Vision backbone ViT-L/14, 24-layer, 1024-dim, 16-head, patch 14, 384 px
Text encoder 6-layer, 512-dim bidirectional transformer, GPT-2 vocab (50 257)
Projection Linear → 512-dim shared embedding space
Loss Per-pair sigmoid BCE (SigLIP-style)
Training data MIMIC-CXR (physionet.org/content/mimic-cxr)
Epochs 50
Downstream Evaluation (frozen encoder + linear probe)
Dataset Mean AUC
NIH CXR-14 (14-class) 0.650
CheXpert-5 (5-class) 0.785
Files
File Description
encoder_final.pt Vision encoder weights at end of training
model_best.pt Full model at best validation loss
model_epochXXX.pt Periodic epoch snapshots (every 10 epochs)
Usage
import torch
from lapvqa.pretrain.model import ContrastiveModel

ckpt = torch.load("encoder_final.pt", map_location="cpu")
model = ContrastiveModel()
model.vision_encoder.load_state_dict(ckpt)
model.eval()

Runs of dmusingu lapvqa-pretrain-sigmoid on huggingface.co

0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs

More Information About lapvqa-pretrain-sigmoid huggingface.co Model

More lapvqa-pretrain-sigmoid license Visit here:

https://choosealicense.com/licenses/apache-2.0

lapvqa-pretrain-sigmoid huggingface.co

lapvqa-pretrain-sigmoid huggingface.co is an AI model on huggingface.co that provides lapvqa-pretrain-sigmoid's model effect (), which can be used instantly with this dmusingu lapvqa-pretrain-sigmoid model. huggingface.co supports a free trial of the lapvqa-pretrain-sigmoid model, and also provides paid use of the lapvqa-pretrain-sigmoid. Support call lapvqa-pretrain-sigmoid model through api, including Node.js, Python, http.

lapvqa-pretrain-sigmoid huggingface.co Url

https://huggingface.co/dmusingu/lapvqa-pretrain-sigmoid

dmusingu lapvqa-pretrain-sigmoid online free

lapvqa-pretrain-sigmoid huggingface.co is an online trial and call api platform, which integrates lapvqa-pretrain-sigmoid's modeling effects, including api services, and provides a free online trial of lapvqa-pretrain-sigmoid, you can try lapvqa-pretrain-sigmoid online for free by clicking the link below.

dmusingu lapvqa-pretrain-sigmoid online free url in huggingface.co:

https://huggingface.co/dmusingu/lapvqa-pretrain-sigmoid

lapvqa-pretrain-sigmoid install

lapvqa-pretrain-sigmoid is an open source model from GitHub that offers a free installation service, and any user can find lapvqa-pretrain-sigmoid on GitHub to install. At the same time, huggingface.co provides the effect of lapvqa-pretrain-sigmoid install, users can directly use lapvqa-pretrain-sigmoid installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

lapvqa-pretrain-sigmoid install url in huggingface.co:

https://huggingface.co/dmusingu/lapvqa-pretrain-sigmoid

Url of lapvqa-pretrain-sigmoid

lapvqa-pretrain-sigmoid huggingface.co Url

Provider of lapvqa-pretrain-sigmoid huggingface.co

dmusingu
ORGANIZATIONS

Other API from dmusingu

huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:June 06 2026
huggingface.co

Total runs: 0
Run Growth: 0
Growth Rate: 0.00%
Updated:June 06 2026