GIMP-ML

Semantics for GNU Image Manipulation Program.
Instagram: Link
Medium: Link
Preprint: Link
Updates:
[July 17] MonoDepth and Colorization models have been updated.

The plugins have been tested with GIMP 2.10 on the following machines:
[1] macOS Catalina 10.15.4
[2] ubuntu 18.04 LTS
[3] ubuntu 20.04 LTS
[4] Debian GNU/Linux 10 (buster)

Screenshot of Menu

Installation Steps

[1] Install GIMP.
[2] Clone this repository: git clone https://github.com/kritiksoman/GIMP-ML.git
[3] Open GIMP and go to Preferences -> Folders -> Plug-ins, add the folder gimp-plugins and close GIMP.
[4] Download weights.zip (1.22 GB) and save it in gimp-plugins folder.
[5] Open terminal and run :
bash installGimpML.sh
bash moveWeights.sh
[6] Open GIMP.

Demo videos on YouTube

Paper References

[1] Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network (https://arxiv.org/abs/1609.04802)
[2] DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Better (https://arxiv.org/abs/1908.03826)
[3] Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer (https://arxiv.org/abs/1907.01341v2)
[4] BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation (https://arxiv.org/abs/1808.00897)
[5] MaskGAN: Towards Diverse and Interactive Facial Image Manipulation (https://arxiv.org/abs/1907.11922)
[6] Real-Time User-Guided Image Colorization with Learned Deep Priors (https://arxiv.org/abs/1705.02999)
[7] Rethinking Atrous Convolution for Semantic Image Segmentation (https://arxiv.org/abs/1706.05587)

Code References

The following have been ported :
[1] https://github.com/switchablenorms/CelebAMask-HQ
[2] https://github.com/TAMU-VITA/DeblurGANv2
[3] https://github.com/zllrunning/face-parsing.PyTorch
[4] https://github.com/junyanz/interactive-deep-colorization
[5] https://github.com/intel-isl/MiDaS
[6] https://github.com/twtygqyy/pytorch-SRResNet

Common Issues

[1] No output on running plugin: Please right click on layer and remove alpha channel before using plugins.
[2] GIMP-ML menu not visible: Do following and restart GIMP.

sudo apt install gimp-python
cd gimp-plugins
chmod -x *
chmod +x *.py

[3] colorize plugin not working: Switch to grayscale mode before running plugin. (Image->Mode->Grayscale)

Citation

Please cite using the following bibtex entry:

@article{soman2020GIMPML,
  title={GIMP-ML: Python Plugins for using Computer Vision Models in GIMP},
  author={Soman, Kritik},
  journal={arXiv preprint arXiv:2004.13060},
  year={2020}
}