|
|
|
|
# Selfhosted-Apps-Docker
|
|
|
|
|
|
|
|
|
|
###### guide-by-example
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
* [caddy_v2](caddy_v2/) - reverse proxy
|
|
|
|
|
* [vaultwarden](vaultwarden/) - password manager
|
|
|
|
|
* [bookstack](bookstack/) - notes and documentation
|
|
|
|
|
* [borg_backup](borg_backup/) - backup utility
|
|
|
|
|
* [ddclient](ddclient/) - automatic DNS update
|
|
|
|
|
* [dnsmasq](dnsmasq/) - DNS and DHCP server
|
|
|
|
|
* [gotify / ntfy / signal](gotify-ntfy-signal/) - instant notifications apps
|
|
|
|
|
* [homer](homer/) - homepage
|
|
|
|
|
* [jellyfin](jellyfin/) - video and music streaming
|
|
|
|
|
* [kopia](kopia_backup/) - backup utility replacing borg
|
|
|
|
|
* [minecraft](minecraft/) - game server
|
|
|
|
|
* [meshcrentral](meshcrentral/) - web based remote desktop, like teamviewer or anydesk
|
|
|
|
|
* [rustdesk](rustdesk/) - remote desktop, like teamviewer or anydesk
|
|
|
|
|
* [nextcloud](nextcloud/) - file share & sync
|
|
|
|
|
* [opnsense](opnsense/) - a firewall, enterprise level
|
|
|
|
|
* [qbittorrent](qbittorrent/) - video and music streaming
|
|
|
|
|
* [portainer](portainer/) - docker management
|
|
|
|
|
* [prometheus_grafana](prometheus_grafana/) - monitoring
|
|
|
|
|
* [unifi](unifi/) - management utility for ubiquiti devices
|
|
|
|
|
* [snipeit](snipeit/) - IT inventory management
|
|
|
|
|
* [trueNAS scale](trueNASscale/) - network file sharing
|
|
|
|
|
* [watchtower](watchtower/) - automatic docker images update
|
|
|
|
|
* [wireguard](wireguard/) - the one and only VPN to ever consider
|
|
|
|
|
* [zammad](zammad/) - ticketing system
|
|
|
|
|
* [arch_linux_host_install](arch_linux_host_install)
|
|
|
|
|
|
|
|
|
|
Can also just check the directories listed at the top for work in progress
|
|
|
|
|
|
|
|
|
|
Check also [StarWhiz / docker_deployment_notes](https://github.com/StarWhiz/docker_deployment_notes/blob/master/README.md)<br>
|
|
|
|
|
Repo documents self hosted apps in similar format and also uses caddy for reverse proxy
|
|
|
|
|
|
|
|
|
|
# Core concepts
|
|
|
|
|
|
|
|
|
|
- `docker-compose.yml` do not need any editing to get started,
|
|
|
|
|
changes are to be done in the `.env` file.
|
|
|
|
|
- Not using `ports` directive if theres only web traffic for a container.<br>
|
|
|
|
|
Theres an expectation of running a reverse proxy which makes mapping ports
|
|
|
|
|
to a docker host unnecessary. Instead `expose` is used which is basically
|
|
|
|
|
just documentation.<br>
|
|
|
|
|
- For persistent storage bind mount `./whatever_data` is used.
|
|
|
|
|
No volumes, nor static path somewhere... just relative path next to compose file.
|
|
|
|
|
- no version is declared in compose, as the practice was
|
|
|
|
|
[deprecated](https://nickjanetakis.com/blog/docker-tip-51-which-docker-compose-api-version-should-you-use)
|
|
|
|
|
|
|
|
|
|
# Requirements
|
|
|
|
|
|
|
|
|
|
**Basic linux and basic docker-compose knowledge.**
|
|
|
|
|
The shit here is pretty hand holding and detailed, but it still should not be
|
|
|
|
|
your first time running a docker container.
|
|
|
|
|
|
|
|
|
|
# Some extra info
|
|
|
|
|
|
|
|
|
|
### Caddy
|
|
|
|
|
|
|
|
|
|
Kinda the core of the setup is Caddy reverse proxy.</br>
|
|
|
|
|
It's described in most details, it's really amazingly simple but robust software.
|
|
|
|
|
|
|
|
|
|
All guides have reverse proxy section with Caddyfile config for them.
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
### Docker network
|
|
|
|
|
|
|
|
|
|
You really want to create a custom docker bridge network and use it.
|
|
|
|
|
|
|
|
|
|
`docker network create caddy_net`
|
|
|
|
|
|
|
|
|
|
It can be named whatever, but what it does over default is that it provides
|
|
|
|
|
[automatic DNS resolution](https://docs.docker.com/network/bridge/)
|
|
|
|
|
between containers. Meaning one can exec in to caddy container and ping another
|
|
|
|
|
container on that custom docker network by its hostname.
|
|
|
|
|
|
|
|
|
|
So config files can just use hostnames and they will work.
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
### .env
|
|
|
|
|
|
|
|
|
|
Often the `.env` file is used as `env_file`,
|
|
|
|
|
which can be a bit difficult concept at a first glance.
|
|
|
|
|
|
|
|
|
|
`env_file: .env`
|
|
|
|
|
|
|
|
|
|
* `.env` - actual name of a file that is used only by compose.</br>
|
|
|
|
|
It is used automatically just by being in the directory
|
|
|
|
|
with the `docker-compose.yml`</br>
|
|
|
|
|
Variables in it are available during the building of a container,
|
|
|
|
|
but unless named in the `environment:` option, they are not available
|
|
|
|
|
once the container is running.
|
|
|
|
|
* `env_file` - an option in compose that defines an existing external file.</br>
|
|
|
|
|
Variables in this file will be available in the running container,
|
|
|
|
|
but not during building of the container.
|
|
|
|
|
|
|
|
|
|
So a compose file having `env_file: .env` mixes these two together.
|
|
|
|
|
|
|
|
|
|
Benefit is that you do not need to make changes at multiple places.
|
|
|
|
|
Adding variables or changing a name in `.env` does not require you
|
|
|
|
|
to also go in to compose to add/change it there... also the compose file
|
|
|
|
|
looks much cleaner, less cramped.
|
|
|
|
|
|
|
|
|
|
Only issue is that **all** variables from the `.env` file are available in
|
|
|
|
|
all containers that use this `env_file: .env` method.</br>
|
|
|
|
|
That can lead to potential issues if a container picks up environment
|
|
|
|
|
variable that is intended for a different container of the stack.
|
|
|
|
|
|
|
|
|
|
In the setups here it works and is tested, but if you start to use this
|
|
|
|
|
everywhere without understanding it, you can encounter issues.
|
|
|
|
|
So first troubleshooting step should be abandoning `.env` and write out
|
|
|
|
|
the variables directly in the compose file only under containers that want them.
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
### Docker images latest tag
|
|
|
|
|
|
|
|
|
|
Most of the time the images are without any tag,
|
|
|
|
|
which defaults to `latest` tag being used.</br>
|
|
|
|
|
This is [frowned upon](https://vsupalov.com/docker-latest-tag/),
|
|
|
|
|
and you should put there the current tags once things are going.
|
|
|
|
|
It will make updates easier when you know you can go back to a working version
|
|
|
|
|
with backups and knowing image version.<br>
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
### Cloudflare
|
|
|
|
|
|
|
|
|
|
For managing DNS records. The free tier provides lot of management options and
|
|
|
|
|
benefits. Like proxy between your domain and your server, so no one
|
|
|
|
|
can get your public IP just from your domain name. Or 5 firewall rules that allow
|
|
|
|
|
you to geoblock whole world except your country.
|
|
|
|
|
|
|
|
|
|
[How to move to cloudflare.](https://support.cloudflare.com/hc/en-us/articles/205195708-Changing-your-domain-nameservers-to-Cloudflare)
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
### ctop
|
|
|
|
|
|
|
|
|
|
[official site](https://github.com/bcicen/ctop)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
htop like utility for quick containers management.
|
|
|
|
|
|
|
|
|
|
It is absofuckinglutely amazing in how simple yet effective it is.
|
|
|
|
|
|
|
|
|
|
* hardware use overview, so you know which container uses how much cpu, ram, bandwidth, IO,...
|
|
|
|
|
* detailed info on a container, it's IP, published and exposed ports, when it was created,..
|
|
|
|
|
* quick management, quick exec in to a container, check logs, stop it,...
|
|
|
|
|
|
|
|
|
|
Written in Go, so its super fast and installation is trivial when it is a single binary.<br>
|
|
|
|
|
download `linux-amd64` version; make it executable with chmod +x; move it to `/usr/bin/`;
|
|
|
|
|
now you can ctop anywhere.
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
### Sendinblue
|
|
|
|
|
|
|
|
|
|
Services often need ability to send emails, for notification, registration,
|
|
|
|
|
password reset and such... Sendinblue is free, offers 300 mails a day
|
|
|
|
|
and is easy to setup.
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
EMAIL_HOST=smtp-relay.sendinblue.com
|
|
|
|
|
EMAIL_PORT=587
|
|
|
|
|
EMAIL_HOST_USER=whoever_example@gmail.com>
|
|
|
|
|
EMAIL_HOST_PASSWORD=xcmpwik-c31d9eykwewf2342df2fwfj04-FKLzpHgMjGqP23
|
|
|
|
|
EMAIL_USE_TLS=1
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
### Archlinux as a docker host
|
|
|
|
|
|
|
|
|
|
My go-to is archlinux as I know it the best.
|
|
|
|
|
Usually in a virtual machine with snapshots before updates.
|
|
|
|
|
|
|
|
|
|
For Arch installation I had [this notes](arch_linux_host_install/)
|
|
|
|
|
on how to install and what to do afterwards.<br>
|
|
|
|
|
But after [archinstall script](https://wiki.archlinux.org/title/archinstall)
|
|
|
|
|
started to be included with arch ISO I switched to that.<br>
|
|
|
|
|
For after the install setup I created
|
|
|
|
|
[Ansible-Arch repo](https://github.com/DoTheEvo/ansible-arch) that gets shit
|
|
|
|
|
done in few minutes without danger of forgetting something.<br>
|
|
|
|
|
Ansible is really easy to use and very easy to read and understand playbooks,
|
|
|
|
|
so it might be worth the time to check out the concept to setup own ansible scripts.
|
|
|
|
|
|
|
|
|
|
The best aspect of having such repo is that it is a dedicated place where
|
|
|
|
|
one can write solution to issues encountered,
|
|
|
|
|
or enable freshly discovered feature for all future deployments.
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
### Other guides
|
|
|
|
|
|
|
|
|
|
* [StarWhiz/docker_deployment_notes](https://github.com/StarWhiz/docker_deployment_notes)
|
|
|
|
|
- got inspired and wrote in similar way setup for various services
|
|
|
|
|
* [BaptisteBdn/docker-selfhosted-apps](https://github.com/BaptisteBdn/docker-selfhosted-apps)
|
|
|
|
|
- many services using traefik for reverse proxy
|
|
|
|
|
* [Awesome Docker Compose Examples](https://github.com/Haxxnet/Compose-Examples)
|
|
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
### For docker noobs
|
|
|
|
|
|
|
|
|
|
First, docker is easy. Like really.<br>
|
|
|
|
|
|
|
|
|
|
Second, there are two main uses.
|
|
|
|
|
|
|
|
|
|
* A developer who daily works on an app and docker eases everything about it, from testing to deployment
|
|
|
|
|
* A self-hosting / devops approach, where you just want to get a service running
|
|
|
|
|
|
|
|
|
|
This whole repo is obviously about the second use. So be careful that you wont
|
|
|
|
|
spend time on resources used to educate the developers. I mean if you get through
|
|
|
|
|
that you will know docker better. But theres always danger that after sinking
|
|
|
|
|
4 hours in to learning it, one cant even get nginx web server up and working.
|
|
|
|
|
And my personal preference in learning is getting something up as fast as possible
|
|
|
|
|
and then tinker with it and try to understand it.
|
|
|
|
|
|
|
|
|
|
So to solve this, when googling for guides, look for *docker compose*
|
|
|
|
|
rather than just docker tutorials and notice if they are talking fundamentals or
|
|
|
|
|
deployment.
|
|
|
|
|
|
|
|
|
|
* [This](https://youtu.be/DM65_JyGxCo) one is pretty good. That entire channel
|
|
|
|
|
has good stuff worth looking.
|
|
|
|
|
|
|
|
|
|
Will add stuff as I encounter it.
|
