This is the repository card of kernels-community/flash-attn-ops that has been pushed on the Hub. It was built to be used with the
kernels
library
. This card was automatically generated.
How to use
# make sure `kernels` is installed: `pip install -U kernels`from kernels import get_kernel
kernel_module = get_kernel("kernels-community/flash-attn-ops")
cross_entropy_loss = kernel_module.cross_entropy_loss
cross_entropy_loss(...)
Available functions
cross_entropy_loss
CrossEntropyLoss
apply_rotary
layer_norm_fn
rms_norm_fn
layer_norm_linear_fn
LayerNormFn
RMSNorm
Benchmarks
No benchmark available yet.
Runs of kernels-community flash-attn-ops on huggingface.co
320
Total runs
0
24-hour runs
48
3-day runs
48
7-day runs
291
30-day runs
More Information About flash-attn-ops huggingface.co Model
flash-attn-ops huggingface.co is an AI model on huggingface.co that provides flash-attn-ops's model effect (), which can be used instantly with this kernels-community flash-attn-ops model. huggingface.co supports a free trial of the flash-attn-ops model, and also provides paid use of the flash-attn-ops. Support call flash-attn-ops model through api, including Node.js, Python, http.
flash-attn-ops huggingface.co is an online trial and call api platform, which integrates flash-attn-ops's modeling effects, including api services, and provides a free online trial of flash-attn-ops, you can try flash-attn-ops online for free by clicking the link below.
kernels-community flash-attn-ops online free url in huggingface.co:
flash-attn-ops is an open source model from GitHub that offers a free installation service, and any user can find flash-attn-ops on GitHub to install. At the same time, huggingface.co provides the effect of flash-attn-ops install, users can directly use flash-attn-ops installed effect in huggingface.co for debugging and trial. It also supports api for free installation.