This is the repository card of kernels-community/aiter-sage-attention that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.

How to use

# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel

kernel_module = get_kernel("kernels-community/aiter-sage-attention", version=1)
gfx1201_sage_attention = kernel_module.gfx1201_sage_attention

gfx1201_sage_attention(...)

Available functions

  • gfx1201_sage_attention
  • gfx1201_sage_attention_fwd
  • gfx1201_sage_prepare
  • sageattn

Benchmarks

No benchmark available yet.

Downloads last month
378
mit
Supported hardwares new
ROCm
AMD Radeon
R9700 PRO
32GB
AMD Radeon
RX 9070 XT
16GB
AMD Radeon
RX 9070
16GB
OS
linux
Arch
x86_64
Kernel Builder
d054906