Commit Graph

350 Commits (master)

Author SHA1 Message Date
Bryce 7880ee1389 feature: update midas (depth maps) 6 months ago
Bryce bf14ee6ee6 feature: add christmas-scene phrase list
Also add script that uses chatgpt to generate phrase-lists
6 months ago
Bryce c6ac5f553a refactor: separate controlnet image preprocessing 6 months ago
Bryce 9a0e0cd1a7 feature: better depth maps 6 months ago
Bryce Drennan 2144f26fa7
feature: add ability to dynamically make word images (#417) 6 months ago
jaydrennan 3bd3dfdeaf
feature: adds --composition-strength parameter to cli (#416) 6 months ago
jaydrennan e1e6f8037c
refactor: removes unused code and configurations (#405)
Co-authored-by: jaydrennan
6 months ago
Bryce 6d39d791b1 refactor: move safety to utils 6 months ago
Bryce 168a843f29 refactor: move colorize to api 6 months ago
Bryce 96f4268d44 refactor: move video_sample to api 6 months ago
Bryce e72e8992ab refactor: create api module 6 months ago
Bryce ad561e8833 refactor: move model_manager to utils 6 months ago
Bryce d478771cc0 refactor: move a bunch of stuff to utils 6 months ago
Bryce 987af23abe refactor: move train.py 6 months ago
Bryce 0c456cd52a refactor: remove lr_scheduler.py 6 months ago
Bryce 01e32ff3f6 refactor: move bin files 6 months ago
Bryce 316114e660 docs: add docstrings
Wrote an openai script and custom prompt to generate them.
6 months ago
jaydrennan 3f3e080d39 feature: adds ability to use qrcode
feature: adds controlnet qrcode image generation.
feature: adds control net for qrcode image generation.
6 months ago
Bryce 62de446a92 ci: add mypy github action 6 months ago
Bryce 012cc648d3 style: fix all the mypy typing issues
...or ignore them.
6 months ago
Bryce 5a636e45c5 feature: skip composition at sizes slightly larger than model is expecting 6 months ago
Bryce 203747b14f refactor: simplify model_weights/architecture 6 months ago
Bryce 37ecd1e5e0 fix: videogen. track gpu tests 6 months ago
Bryce eae4f20ae2 ci: add type checker
fix some typehint issues
6 months ago
Bryce e898e3a799 fix: several cli commands, edit demo, negative prompt
- fix colorize cmd. add test
- fix describe cmd. add test
- fix model-list cmd. add test
- fix stable studio
- hide stack grace for ValueErrors in cli
- set controlnet scale
- fix negative prompt to allow emptystring instead of replacing it with default
- adjust edit-demo parameters
- arg scheduler that works at click level (but disable it). works but not ideal experience.
6 months ago
Bryce c299cfffd9 fix: cache the controlnet models 6 months ago
Bryce 9b95e8b0b6 perf: improve cli startup time
- do not provide automatically imported api functions and objects in `imaginairy` root module
- horrible hack to overcome horrible design choices by easy_install/setuptools

The hack modifies the installed script to remove the __import__ pkg_resources line

If we don't do this then the scripts will be slow to start up because of
pkg_resources.require() which is called by setuptools to ensure the
"correct" version of the package is installed.

before modification example:
```
__requires__ = 'imaginAIry==14.0.0b5'
__import__('pkg_resources').require('imaginAIry==14.0.0b5')
__file__ = '/home/user/projects/imaginairy/imaginairy/bin/aimg'
with open(__file__) as f:
    exec(compile(f.read(), __file__, 'exec'))
```
6 months ago
Bryce 2bd6cb264b feature: large refactor
- add type hints
- size parameter
- ControlNetInput => ControlInput
- simplify imagineresult
6 months ago
Bryce db85f0898a feature: remove training feature 6 months ago
jaydrennan ef0f44646e feature: adds --control-strength as parameter for cli 6 months ago
Bryce 24f4af3482 feature: better torch installation experience 6 months ago
Bryce 71d4992dca feature: added `--size` parameter to allow using named sizes 6 months ago
Bryce 14ecf93c6a feature: add sliced self-attention for future use with video generation 6 months ago
Bryce 0fe3733933 fix: memory management issue
the dtype being used as a cache key wasn't consistent. this caused the model to be loaded twice
6 months ago
Bryce 82c30024c9 feature: DDIM now default sampler
better output quality
6 months ago
Bryce ba57393022 feature: patch refiners ScaledDotProductAttention for sliced attention 6 months ago
Bryce 1b15d6dcd4 feature: sliced image encoding for SD1Autoencoder 6 months ago
Bryce b61d06651c tests: fix tests
- disable details mode. needs more work done to support
6 months ago
jaydrennan cff17ef6f4
feature: adds text to video generation flag (#404)
Co-authored-by: jaydrennan
6 months ago
Bryce 8267482aad fix: remove padding approach
- padding didnt make animations better
- some changes to better support CPU generation (not yet working)
- better log output coloring
- better log messages when cuda not found
6 months ago
Bryce b9e245eb7d fix: remove cuda memory tracking 6 months ago
Bryce 3b2265f82d feature: add video progress bar 6 months ago
Bryce b5a0e65f35 fix: edit mode and some controlnet tests 6 months ago
Bryce b7fad562d0 feature: improved logging
- clean up some error messages
- add color
- indent tqdm bar
6 months ago
Bryce a126e1c1d7 feature: better error message when file not found 7 months ago
Bryce aa91d0a9c9 feature: autoresize and crop videos.
This means you can just stick any image into the video generator without worrying about the size.

- better generated video filenames
- output h264 video as well
7 months ago
Bryce c24ed1f33d feature: videogen improvements
- better filenames
- allow urls as image inputs
- better memory efficiency
- add timing information
7 months ago
Bryce 1da7043081 docs: update documentation 7 months ago
Bryce e8fe8d7d6c feature: stable diffusion video (SVD) 7 months ago
jaydrennan 80ff006604 fix: updates weights_url's for controlnet 7 months ago
jaydrennan e91a041a78 refactor: removes unused model configs 7 months ago
Bryce f97f6a3b4b feature: use refiners library for generation
BREAKING CHANGE

  - stable diffusion 1.5 + inpainting working
  - self-attention guidance working. improves image generation quality
  - tile-mode working
  - inpainting self-attention guidance working

disable/broken features:
  - sd 1.4, 2.0, 2.1
  - most of the samplers
  - pix2pix edit
  - most of the controlnets
  - memory management
  - python 3.8 support

wip
7 months ago
Bryce 6cd519cdb2 refactor: move code to avoid conflicts with "http" namespace 8 months ago
Bryce 558d3388e5 style: speed up linting and autoformatting. fix lints 8 months ago
Bryce 8243ed616d fix: pydantic models for http server working now. Fixes #380 8 months ago
Bryce 7c2004bfcc feature/fix: migrate to pydantic 2.3
- test: add schema tests/fuzzer and fixes
 - fix default prompt. add tests
 - fix outpaint and controlnet defaults
 - fix init image strength defaults
9 months ago
Bryce 8e956f5360 feature: add some helper functions 9 months ago
Bryce f243006236 fix: allow tile_mode to be set to True or False for backward compatibility 9 months ago
Bryce 477d161c91 build: better communicate lack of support for Python 3.11 9 months ago
Bryce 82d74c6b49 feature: switch to pydantic models
- allow prompt re-use by deferring random seed
1 year ago
Bryce 3fb0dcd891 fix: hide log warning 1 year ago
Bryce c5c90df337 feature: fix debug level logging 1 year ago
Bryce 8ffb0fac0e fix: add routes to match stablestudio routes 1 year ago
Bryce edafcc5529 feature: show full stack trace on server error 1 year ago
Bryce 671aa86ad7 version: 13.0.0 1 year ago
Bryce 7b032c8e9a feature: StableStudio web interface
run `aimg server` and visit http://127.0.0.1:8000/
1 year ago
Bryce 8e28a2ed02 feature: API support for StableStudio 1 year ago
Bryce e53459a50a build: check for torch version at runtime (fixes #329) 1 year ago
Bryce 2a26495653 fix: package will not try to install xformers on `aarch64` machines.
While this will allow the dockerfile to build on MacOS M1, [torch will not be able to use the M1 when generating images.](https://github.com/pytorch/pytorch/issues/81224#issuecomment-1499741152)
1 year ago
Bryce 14739bc90b feature: api server (alpha)
`aimg run-api-server`

Proof of concept for now
1 year ago
Bryce 38ac0b7f54 tests: fix tests 1 year ago
Bryce 39dffa9166 style: lintfix 1 year ago
Bryce dc8f8d5a3d feature: add colorization controlnet. improve `aimg colorize` command 1 year ago
Bryce df25936d6f feature: automatic use of inpainting
feature disabled since controlnet inpainting doesn't work great. Was disabled by setting `inpaint_method="finetune",`
1 year ago
Bryce d32e1060cd feature: multi-controlnet support at the command line
add controlnet option for edit demo
1 year ago
Bryce bcaa000d35 fix: model logging 1 year ago
Bryce 926692ad03 tests: "prime" the controlnets
Trying to get things working on m1. doesn't fix everything
1 year ago
Bryce fb19e34acc fix: allow use of upscaler on mps device 1 year ago
Bryce 3b066f8e29 fix: don't hide error messages during upscale 1 year ago
Bryce eca97a25a0 tests: adjust tests to pass 1 year ago
Bryce 4c77fd376b feature: improvements to memory management
not thoroughly tested on low-memory devices
1 year ago
Bryce d5a276584b fix: move normal map code inline
Fixes conda package. Fixes #317
1 year ago
Bryce 3258af7e02 fix: use correct device for depth images on mps 1 year ago
Bryce 17f3541d57 version: 12.0.0 1 year ago
Bryce c9fccc1757 feature: add openjourney-v4 1 year ago
Bryce db8d3b74ea feature: add "detail" control mode.
Add details to an image. Great for upscaling an image.
1 year ago
Bryce b5356b143f feature: partial add of inpainting controlnet
todo: figure out how to input "mask" for this mode
1 year ago
Bryce 9526a85a71 feature: add "edit" control mode
Edit images using text instructions with any SD 1.5 based model. Similar to instructPix2Pix.
1 year ago
Bryce 476a81a967 feature: add "shuffle" control mode
Image is generated from elements of control image. similar to style transfer
1 year ago
Bryce 750d4f7ea8 docs: cleanup 1 year ago
Bryce 832adf27bc feature: update controlnets to 1.1
- smaller filesizes for the controlnet weights
- fix: works with other 1.5 based models
- enables more control modes getting added
1 year ago
Bryce 9a82dc5e4c fix: raw control images are now properly loaded. fixes #296 1 year ago
Bryce 765e607c2c fix: file numbers start after latest image, even if some previous images were deleted 1 year ago
Luke Pearson 94728d978e fix: changed sample to True to generate caption using blip model 1 year ago
Bryce 95d3d08d27 fix: better input image path handling
throw exception for non-existent images
1 year ago
Bryce 37d6642c83 fix: fix model downloads that were broken
by [library change in transformers 4.27.0](8f3b4a1d5b)
1 year ago
Bryce eb26d5a7c5 feature: add art-scene, desktop-background, interior-style, painting-style phraselists
fix: file globbing works in the interactive shell
feature: make compilation animations simple slide shows
1 year ago
Bryce 52044c1073 fix: use model appropriate composition size 1 year ago
Bryce 3b777b98d8 fix: improved large images using composition 1 year ago
Bryce a449fbd5e2 feature: remove tiling message for upscaler 1 year ago