The
original model card
to learn about the model's capabilities, specifications, and terms of use.
The
Petals repository
to learn how to install Petals and run this model over the Petals swarm.
We provide minimal code examples below.
Using the model
from petals import DistributedBloomForCausalLM
model = DistributedBloomForCausalLM.from_pretrained("bigscience/bloom-petals")
# Embeddings & prompts are on your device, BLOOM blocks are distributed across the Internet
inputs = tokenizer("A cat sat", return_tensors="pt")["input_ids"]
outputs = model.generate(inputs, max_new_tokens=5)
print(tokenizer.decode(outputs[0])) # A cat sat on a mat...
More Information About bloom-petals huggingface.co Model
bloom-petals huggingface.co
bloom-petals huggingface.co is an AI model on huggingface.co that provides bloom-petals's model effect (), which can be used instantly with this bigscience bloom-petals model. huggingface.co supports a free trial of the bloom-petals model, and also provides paid use of the bloom-petals. Support call bloom-petals model through api, including Node.js, Python, http.
bloom-petals huggingface.co is an online trial and call api platform, which integrates bloom-petals's modeling effects, including api services, and provides a free online trial of bloom-petals, you can try bloom-petals online for free by clicking the link below.
bigscience bloom-petals online free url in huggingface.co:
bloom-petals is an open source model from GitHub that offers a free installation service, and any user can find bloom-petals on GitHub to install. At the same time, huggingface.co provides the effect of bloom-petals install, users can directly use bloom-petals installed effect in huggingface.co for debugging and trial. It also supports api for free installation.