Archives/imaginAIry
2
0
Fork 0
mirror of https://github.com/brycedrennan/imaginAIry synced 2024-11-05 12:00:15 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix: MacOS MPS background can't handle large slices

Browse Source 
per
- https://github.com/brycedrennan/imaginAIry/issues/175
- https://github.com/invoke-ai/InvokeAI/issues/1244
This commit is contained in:
Bryce 2023-01-23 06:49:34 -08:00 committed by Bryce Drennan
parent bbe3f8473f
commit 290b0a318e
1 changed files with 5 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
imaginairy/modules/attention.py
View File

@ -248,6 +248,11 @@ class CrossAttention(nn.Module):
)
slice_size = q.shape[1] // steps if (q.shape[1] % steps) == 0 else q.shape[1]
if get_device() == "mps":
# https://github.com/brycedrennan/imaginAIry/issues/175
# https://github.com/invoke-ai/InvokeAI/issues/1244
slice_size = min(slice_size, 2**30)
for i in range(0, q.shape[1], slice_size):
end = i + slice_size