Spaces:

nyanko7
/

sd-diffusers-webui

Running on T4

nyanko7 commited on Jan 27, 2023

Commit

569f71e

•

1 Parent(s): c0beaa0

Update modules/model.py

Files changed (1) hide show

modules/model.py CHANGED Viewed

@@ -179,7 +179,7 @@ class CrossAttnProcessor(nn.Module):
  k_bucket_size = 1024
  # use flash-attention
- hidden_states = FlashAttentionFunction.apply(
  query.contiguous(), key.contiguous(), value.contiguous(),
  attention_mask, causal=False, q_bucket_size=q_bucket_size, k_bucket_size=k_bucket_size
  )

  k_bucket_size = 1024
  # use flash-attention
+ hidden_states = FlashAttentionFunction(
  query.contiguous(), key.contiguous(), value.contiguous(),
  attention_mask, causal=False, q_bucket_size=q_bucket_size, k_bucket_size=k_bucket_size
  )