Archives/imaginAIry
2
0
Fork 0
mirror of https://github.com/brycedrennan/imaginAIry synced 2024-10-31 03:20:40 +00:00
Code Issues Packages Projects Releases Wiki Activity
466 Commits 10 Branches 104 Tags 322 MiB
d834e8b5b3
Commit Graph

37 Commits

Author SHA1 Message Date
Bryce
eae4f20ae2 ci: add type checker 
fix some typehint issues
 2023-12-12 20:54:39 -08:00
Bryce
ab75c49b15 docs: smaller animations 2023-11-22 18:33:28 -08:00
Bryce
e8fe8d7d6c feature: stable diffusion video (SVD) 2023-11-22 17:20:08 -08:00
Bryce
f97f6a3b4b feature: use refiners library for generation 
BREAKING CHANGE

  - stable diffusion 1.5 + inpainting working
  - self-attention guidance working. improves image generation quality
  - tile-mode working
  - inpainting self-attention guidance working

disable/broken features:
  - sd 1.4, 2.0, 2.1
  - most of the samplers
  - pix2pix edit
  - most of the controlnets
  - memory management
  - python 3.8 support

wip
 2023-11-22 13:22:00 -08:00
Bryce
558d3388e5 style: speed up linting and autoformatting. fix lints 2023-09-29 23:01:50 -07:00
Bryce
477d161c91 build: better communicate lack of support for Python 3.11 2023-09-09 15:25:57 -07:00
Bryce
7b032c8e9a feature: StableStudio web interface 
run `aimg server` and visit http://127.0.0.1:8000/
 2023-05-22 02:24:05 -07:00
Bryce
d5a276584b fix: move normal map code inline 
Fixes conda package. Fixes #317
 2023-05-06 13:01:50 -07:00
Bryce
832adf27bc feature: update controlnets to 1.1 
- smaller filesizes for the controlnet weights
- fix: works with other 1.5 based models
- enables more control modes getting added
 2023-05-04 19:48:27 -07:00
Bryce
37d6642c83 fix: fix model downloads that were broken 
by [library change in transformers 4.27.0](8f3b4a1d5b)
 2023-03-18 13:49:11 -07:00
Bryce
d1dbd500eb fix: use entry_points for windows 
python converts entry_points to exe files so they run on windows.  The scripts that work on linux/macos don't work on windows.
 2023-02-05 19:20:47 -08:00
Bryce
1c986d8644 fix: use py3.7 compat lru_cache 
- disable lint fixer that updates to newer syntax
 2023-01-22 18:24:57 -08:00
Bryce
4bc78b9be5 build: vendorize realesrgan 
Removes lots of dependencies including problematic `grpcio` and `tb-nightly`
 2023-01-08 22:20:22 -08:00
Bryce
e9a3e1a99b build: unpin dependencies 2023-01-08 22:20:22 -08:00
Bryce
4bc940ddf4 feature: remove more randomness 2023-01-02 14:11:36 -08:00
Bryce
1381c7fed4 lint: new ruff linter 2023-01-02 14:11:36 -08:00
Bryce
da0f1e1ee6 fix: make sure randomness is generated on cpu for consistency 2022-12-21 09:33:46 -08:00
Bryce
9c153a8d2d feature: support k-sampler methods for SD-2.0-v (768) 2022-11-26 16:18:08 -08:00
Bryce
0f02fc587c fix: k_dpm_fast on MPS platform 
fixes #75

As discussed here: https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/2446#issuecomment-1279733739
 2022-11-12 20:19:23 -08:00
Bryce
7af1ab66ca fix: add workaround for bug in k_diffusion on mps 
As documented here: https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/4558#issuecomment-1310387114

- make image logs more consistent
- note which step the progress images belong to in the filename
 2022-11-12 20:19:23 -08:00
Bryce
7fba2972e8 feature: added DPM++ 2S a and DPM++ 2M samplers 
-fix: fix bug with `--show-work`
 2022-11-11 10:52:48 -08:00
Bryce
741a433c56 feature: update k_diffusion. add dpm_fast and dpm_addaptive samplers 2022-10-16 22:10:54 -07:00
Bryce Drennan
31c2160e21
feature: prompt expansion (#51) 
You can use `{}` to randomly pull values from lists.  A list of values separated by `|` and enclosed in `{ }` will be randomly drawn from in a non-repeating fashion. Values that are surrounded by `_ _` will pull from a phrase list of the same name.   Folders containing .txt phraselist files may be specified via
`--prompt_library_path`. The option may be specified multiple times.  Built-in categories:

      3d-term, adj-architecture, adj-beauty, adj-detailed, adj-emotion, adj-general, adj-horror, animal, art-movement,
      art-site, artist, artist-botanical, artist-surreal, aspect-ratio, bird, body-of-water, body-pose, camera-brand,
      camera-model, color, cosmic-galaxy, cosmic-nebula, cosmic-star, cosmic-term, dinosaur, eyecolor, f-stop,
      fantasy-creature, fantasy-setting, fish, flower, focal-length, food, fruit, games, gen-modifier, hair, hd,
      iso-stop, landscape-type, national-park, nationality, neg-weight, noun-beauty, noun-fantasy, noun-general,
      noun-horror, occupation, photo-term, pop-culture, pop-location, punk-style, quantity, rpg-item, scenario-desc,
      skin-color, spaceship, style, tree-species, trippy, world-heritage-site

   Examples:

   `imagine "a {red|black} dog" -r 2 --seed 0` will generate both "a red dog" and "a black dog"

   `imagine "a {_color_} dog" -r 4 --seed 0` will generate four, different colored dogs. The colors will eb pulled from an included
   phraselist of colors.

   `imagine "a {_spaceship_|_fruit_|hot air balloon}. low-poly" -r 4 --seed 0` will generate images of spaceships or fruits or a hot air balloon

   Credit to [noodle-soup-prompts](https://github.com/WASasquatch/noodle-soup-prompts/) where most, but not all, of the wordlists originate.
 2022-10-08 18:34:35 -07:00
Bryce
2221d3d1c2 fix: handle small input images 
If input images didn't need resizing because they were already smaller than max width/height then they didn't get normalized to a multiple of 64.  This caused an exception like the following:

```Sizes of tensors must match except in dimension 1. Expected size 4 but got size 3 for tensor number 1 in the list.
```
 2022-10-06 01:24:21 -05:00
Bryce
302845f35a docs: update feature plans 2022-10-04 06:18:46 -07:00
Bryce
f21c979f08 feature: better masking segmentation from clipseg 2022-09-27 23:35:06 -07:00
Bryce
d832f15297 fix: masking now works properly at strengths 0 and 1 2022-09-24 23:31:03 -07:00
Bryce
09bc1c70e6 fix: try to address #13 BFloat16 issue 
Seems to be caused by incompatible types in group_norm when we use autocast.

Patch group_norm to cast the weights to the same type as the inputs

From what I can understand all the other repos just switch to full precision instead
of addressing this.  I think this would make things slower but I'm not sure. So maybe
the patching solution I'm doing is better?

https://github.com/pytorch/pytorch/pull/81852
 2022-09-21 22:03:12 -07:00
Bryce
4705d182d5 feature: generate captions for images 
- add wip functionality for negative masks
- ci: add code linter that removes unused imports
- add instructions to install rust on osx
 2022-09-19 21:19:22 -07:00
Bryce
7087c4a680 feature: automatic mask generation 
mask generation working but not integrated
 2022-09-17 17:08:48 -07:00
Bryce
bb665b9eb6 fix: make k-diffusion samplers deterministic 
- add test for hashes on mps.  images look same on CUDA but are slightly different.
 2022-09-14 09:37:45 -07:00
Bryce
b4a3b8c2b3 feature: k-diffusion samplers 
- improved image logging functionality. can just stick log_latent wherever you want
- improved some variable naming
- moved all the samplers together
- vendored k-diffusion library
 2022-09-14 00:40:25 -07:00
Bryce
bb7eaa47f6 docs: small doc updates 2022-09-13 09:12:47 -07:00
Bryce
541ecb9701 feature: face enhancement and upscaling!! 2022-09-13 00:27:53 -07:00
Bryce
adf1a3b55f version 0.7.2 2022-09-11 22:24:02 -07:00
Bryce
14a06e160d build: vendor clip 
it's not on pypi
https://github.com/openai/CLIP/issues/141
 2022-09-11 22:22:43 -07:00
Bryce
043373ef17 ci: add linter, import sorting 2022-09-11 13:57:36 -07:00