Our pretrained model are made available through
rshf
and
transformers
package for easy inference.
Load and initialize:
from rshf.prom3e import ProM3E
model = ProM3E.from_pretrained("MVRL/ProM3E")
Inference:
# Get precomputed embeddings from taxabind for image, sat, loc, env, text, audio# Replace missing modalities with any vector# Stack embeddings in the order: image, sat, loc, env, text, audio# Pass through the model# Example:
image_embeds = torch.randn(2, 512)
sat_embeds = torch.randn(2, 512)
loc_embeds = torch.randn(2, 512)
env_embeds = torch.randn(2, 512)
text_embeds = torch.randn(2, 512)
audio_embeds = torch.randn(2, 512)
modalities = torch.stack((image_embeds, sat_embeds, loc_embeds, env_embeds, text_embeds, audio_embeds), dim=1)
modalities = torch.nn.functional.normalize(modalities, dim=-1)
unmasked_modalities = [0, 2]
reconstructions, mu, log_var, hidden_repr = model.forward_inference(modalities, unmasked_modalities)
Runs of MVRL ProM3E on huggingface.co
39
Total runs
0
24-hour runs
-43
3-day runs
-37
7-day runs
-27
30-day runs
More Information About ProM3E huggingface.co Model
ProM3E huggingface.co
ProM3E huggingface.co is an AI model on huggingface.co that provides ProM3E's model effect (), which can be used instantly with this MVRL ProM3E model. huggingface.co supports a free trial of the ProM3E model, and also provides paid use of the ProM3E. Support call ProM3E model through api, including Node.js, Python, http.
ProM3E huggingface.co is an online trial and call api platform, which integrates ProM3E's modeling effects, including api services, and provides a free online trial of ProM3E, you can try ProM3E online for free by clicking the link below.
ProM3E is an open source model from GitHub that offers a free installation service, and any user can find ProM3E on GitHub to install. At the same time, huggingface.co provides the effect of ProM3E install, users can directly use ProM3E installed effect in huggingface.co for debugging and trial. It also supports api for free installation.