Commit Graph

139 Commits

Author SHA1 Message Date
Jason Rhinelander
ca9d979361 Docker image updates
- split debian sid into base/sid/clang images
- similarly for debian stable
- add jsonnet to lint
- add `--pull` to docker build so that we always pull the latest images
  (otherwise we were building on whatever local cache we have for
  `debian:sid`, etc., which made the base image update layer much
  larger).
- don't install Recommends by default
- add libzmq3-dev
- split android into android (base) and flutter
- hard-code registry.oxen.rocks into the dockerfile stuff because that
  seems to be the only way to properly depend on other docker builds.
- update a few CI builds that should have been using our images but
  weren't.
- Update a few CI images to bullseye instead of buster

Add openssh-client (for sftp to upload builds)
2021-10-16 15:54:22 -03:00
Jason Rhinelander
6f58648161 Add libzmq3-dev; change deps into arrays
We're currently rebuilding libzmq3-dev all the time in most of the CI
jobs.
2021-10-16 15:16:55 -03:00
Jason Rhinelander
52492c6253 make format 2021-10-16 15:16:55 -03:00
Jason Rhinelander
497c62b586 Update clang build to 13; add full llvm-13 build 2021-10-16 15:16:55 -03:00
Jeff Becker
7d299d1c74
update ci to use main lokinet mobile repo 2021-09-24 17:23:51 -04:00
Jason Rhinelander
53b62857da Disable tests on static bionic
It's failing to link with LTO on bionic because of an internal compiler
error for some random reason, so just disable building the tests there
for now (keeping LTO on is more useful since that is also what gets used
for a static build).
2021-09-03 22:21:45 -03:00
jeff
1272a4fbe1
add dummy sign target for ci when we don't have signing keys
remove static macos from ci pipeline
2021-09-02 14:17:09 -04:00
jeff
d24221e67a
make ci run ./contrib/mac.sh with no codesigning 2021-09-02 14:17:09 -04:00
Jeff Becker
c39225b3b9
correct lokinet flutter url 2021-09-02 12:03:04 -04:00
Jeff Becker
f65ec8e79f
make ci try building the flutter apk in the android apk pipeline 2021-09-02 12:01:36 -04:00
Jeff Becker
2122463d98
pass VERBOSE=1 in ci jobs for full verbosity on builds 2021-06-19 09:35:50 -04:00
Jeff Becker
ae186f7000
use $(MAKE) only on makefile generator 2021-06-19 09:35:49 -04:00
Jeff Becker
e9a4081451
use make instead of build essential in ci so that it does not conflict with clang builds 2021-06-19 09:35:49 -04:00
Jeff Becker
b7485b4b25
* make android ABIS list configurable
* fix android ci jizz, correct typo, upload generated assets
2021-06-19 08:05:05 -04:00
Jeff Becker
e5bc34a7b1
[buildsystem] remove use of ninja entirely
* modify contrib/window.sh now uses makefiles
* create contrib/android.sh for building shared libs for android apk
* update drone ci jizz for android
* update cmake/StaticBuild.cmake to use $(MAKE) so that builds can parallelize (super epic)
* remove android directory as it is no longer needed
2021-06-18 11:48:23 -04:00
Jason Rhinelander
4b4d261c02 Limit builds to 6 jobs (4 for arm)
The CI runners don't use fixed CPU cores anymore, so that they can
better allocate jobs across idle cores, but this means ninja's default
is running an insane number of parallel compilations that likely just
makes things slower.

Add 6-job limiting to match the core limits that used to be in place.
2021-04-27 17:34:17 -03:00
Jeff Becker
0c37cc7f60
lokinet-bootstrap native binary 2021-04-15 13:39:45 -04:00
Jason Rhinelander
e5aa96ed7c Upgrade to clang-format 11
The formatting changes here are not too large and also nice: in
particular clang-format-11 appears to do better handling of `{...}`
constructor braces/arguments.
2021-03-05 13:36:31 -04:00
Jeff Becker
6c8e5256d6
catchAll -> testAll 2021-03-04 15:45:52 -05:00
lyyn
ece91e87fc
Migrate tests from gtest to catch2 2021-03-04 15:41:42 -05:00
Jeff Becker
849c8b6aa8
explicitly turn off setcap on ci builds so they pass 2021-03-04 06:00:03 -05:00
Jason Rhinelander
6c176330a4 Allow multiple gradles to run on the same box
/cache is shared among multiple runners that can potentiall run at
once, but gradle's cache is retarded and just completely blocks anything
from using the cache for the span of the entire build.  Work around it
by sticking the unique builder identifier in the cache path.
2021-03-02 21:23:37 -04:00
Jeff Becker
b8d7d0327f
disallow fail on ci pipeline for android builds 2021-03-02 15:21:39 -05:00
Jeff
f685d615bf
Merge pull request #1537 from majestrate/android-works-now-2021-02-11
Android
2021-03-02 14:08:40 -05:00
Thomas Winget
4c630e0437 Large collection of changes to make android work
- Previous android java and jni code updated to work, but with much love
  still needed to make it work nicely, e.g. handling when the VPN is
  turned off.

- DNS handling refactored to allow android to intercept and handle DNS
  requests as we can't set the system DNS to use a high port
  (and apparently Chrome ignores system DNS settings anyway)

- add packet router structure to allow separate handling of specific
  intercepted traffic, e.g. UDP traffic to port 53 gets handled by our
  DNS handler rather than being naively forwarded as exit traffic.

- For now, android lokinet is exit-only and hard-coded to use exit.loki
  as its exit.  The exit will be configurable before release, but
  allowing to not use exit-only mode is more of a challenge.

- some old gitignore remnants which were matching to things we don't
  want them to (and are no longer relevant) removed

- some minor changes to CI configuration
2021-03-02 13:18:22 -05:00
Jeff Becker
2655a64da0
redo ci pipeline:
* make cached docker containers for ci
* remove old docker files from root of repo
* use cached docker containers for ci
2021-03-02 07:21:57 -05:00
Jason Rhinelander
231674e5a5 Remove CMAKE_CROSSCOMPILE
We set CMAKE_CROSSCOMPILE in a few places, but that is just a typo for
CMAKE_CROSSCOMPILING.  However we don't need to set it at all: cmake
does so automatically whenever CMAKE_SYSTEM_NAME is set (which is why
our cross compiling actually works currently.)
2021-01-25 13:06:59 -04:00
Jason Rhinelander
60a267a136 Add automake+libtool for libuv static build 2021-01-25 12:58:20 -04:00
Jason Rhinelander
b3d2177e73
Fix build server name & path (#1516)
builds.lokinet.dev -> oxen.rocks
/loki-project/ -> /oxen-io/
2021-01-19 07:39:53 -05:00
Jeff Becker
f8c0195cfc
add ulimit -n 1024 to mac ci stuff because lol apple 2021-01-12 09:46:44 -05:00
Jason Rhinelander
7ad1030736
Add full-static-deps armhf build (+upload) (#1505)
* Add armhf static build + upload

* openssl build fix for static armhf build

Without this it tries building for arm64.

* Disable LTO for armhf static build

* Fix static lib check for arm
2021-01-04 16:17:29 -05:00
Jason Rhinelander
8e550091ab
Disable LTO on sid for now (#1472) 2020-11-13 09:00:04 -05:00
Jason Rhinelander
aa4c4e7453 Install less stuff on windows CI
mingw-w64 is a metapackage that pulls in 4 different compilers
{i686,x86_64}×{-posix,-win32} but we only need x86_64-posix, so just
install that package.
2020-11-10 20:11:29 -04:00
Jason Rhinelander
4eb275324d
Fix deb snapshot builds + misc other CI updates (#1462)
* Remove unneeded libcurl-dev build dep

* Make apt-get operations quieter

* apt repo updates

- store the apt repo gpg pubkey in the repo rather than having to fetch
it every time
- add the apt repo for all the deb builds
- update apt repo URL to deb.loki.network instead of
deb.imaginary.stream

* Use http so that we don't need ca-certificates

The repo packages are already signed so using https really isn't
important.

* Add hack to ignore jsonnet conflicts in deb builds

* Add build machine name to build output

* We don't install any shared libs currently
2020-11-10 05:25:37 -05:00
Jeff
6bca6b3582 Merge remote-tracking branch 'origin/stable' into dev 2020-11-06 13:48:28 -05:00
Jason Rhinelander
eea0929077
Move resolvconf from deb branches to contrib/ (#1439)
* Move resolvconf from deb branches to contrib/

This script gets invoked by the systemd service after startup to update
resolvconf with the lokinet dns server.

It was previously living in debian/lokinet-resolvconf in the
debian/ubuntu branches, but really belongs in contrib/ instead.

* Disable LTO on sid gcc/clang-11
2020-10-31 05:21:55 -04:00
Jeff
569bfe14b4
dont do native builds in static linux ci (#1434) 2020-10-30 05:30:23 -04:00
Jason Rhinelander
4f3775c28c
Crank clang version to 11 (#1422) 2020-10-23 18:17:48 -04:00
Jeff
a01a622fce
make drone ci use debian testing (#1413) 2020-10-21 17:31:42 -04:00
Jason Rhinelander
d507e44350
Don't use -march=native for static linux build (#1390) 2020-10-03 15:23:13 -04:00
Jason Rhinelander
4ac733c7e2 Shallow clone submodules 2020-10-02 18:36:52 -03:00
Jason Rhinelander
bbfbc1c1e7
Drone CI job shuffling (#1359)
- Disable bionic arm64 job to reduce the load on the ARM box a bit.
- Add bionic amd64 build so that we have a (normal) build on bionic.
- Remove sid/g++-10 job because g++ is now the default on sid (so the
  debian/sid build is already doing the same thing).
2020-09-22 16:10:38 -04:00
jeff
def8a9ce46 disable running router hive just build it 2020-08-28 13:59:29 +00:00
jeff
d973ce9089
upgrade alpine container 2020-08-24 20:21:18 -04:00
Stephen Shelton
8628212269
<3 jsonnet 2020-07-02 10:22:04 -06:00
Stephen Shelton
98171aad36
Add libsqlite3-dev to drone 2020-07-02 10:12:13 -06:00
Jason Rhinelander
3dff5931a2
Use imaginary repo for sodium on bionic/arm64
Building both sodium + libzmq is kind of a pain, so just use the
backport libsodium from the loki repo on deb.imaginary.stream.
2020-07-02 11:13:31 -04:00
Jeff Becker
eb0f29223a
add docs to gdb-filter.py
turn off thread logging in gdb
make sure everything runs in gdb when running test
add note in contrib/format.sh about a GNU-ism
2020-07-02 11:13:30 -04:00
Jeff Becker
b6a7b5ccfb
only run catch2 tests in gdb and add assert to unit test 2020-07-02 11:12:05 -04:00
Jeff Becker
52bc2facc2
add gdb to ci runners on debian to catch backtraces if they happen 2020-07-02 11:10:06 -04:00
Jeff Becker
5c039233db
remove the dreaded makefile and update docs 2020-07-02 11:10:06 -04:00
Jason Rhinelander
e2ad0e8f09 DRY out ci upload script 2020-06-22 11:30:38 -03:00
Jeff Becker
d096f5375f
pass in WINDOWS_BUILD_NAME to uploader to mark 64bit and 32bit builds distinctly 2020-06-18 07:30:07 -04:00
Jeff Becker
ad0b66ae02
use correct arch, probably 2020-06-18 07:25:14 -04:00
Jeff Becker
8f3f964ee6
change to i686 2020-06-18 07:24:27 -04:00
Jeff Becker
3b59288a42
fix typo 2020-06-18 07:23:59 -04:00
Jeff Becker
3860352a9a
set arch to be 32bit for 32bit windows builds so build artifacts are marked as such 2020-06-18 07:22:55 -04:00
Jeff Becker
1b10e69b10
update ci to use zip for windows 2020-06-17 11:45:36 -04:00
Jeff
4026051d36
add xz in drone ci because alpine sucks 2020-06-17 11:34:39 -04:00
Jeff Becker
52b5da33a3
fix dep 2020-06-17 11:20:19 -04:00
Jeff Becker
0dad53100a
add bash and sftp so exe uploads werk 2020-06-17 11:13:57 -04:00
Jeff Becker
fdfdd2a1d2
turn off lto, add patches 2020-06-17 10:37:41 -04:00
Jeff Becker
48c7d6fbe5
consolidate windows ci drone jizz 2020-06-17 09:42:11 -04:00
Thomas Winget
9905a2bd4b static build flag for win/mac static builds in drone config 2020-06-16 20:53:36 -04:00
Thomas Winget
0ecdf60777 static build fixes in cmake stuff
I hate cmake so much.
2020-06-16 18:52:20 -04:00
Thomas Winget
755b4d89b6 libunbound deps in drone config 3: dependency boogaloo 2020-06-15 18:32:57 -04:00
Thomas Winget
4ee95d4ad0 libunbound deps in drone config...watch *them* have deps too 2020-06-15 18:32:57 -04:00
Thomas Winget
f58c7df54d add libunbound-dev dep to drone config 2020-06-15 18:32:57 -04:00
Rick V
b2fcf6c896 sodium requires stack protection on windows (-D_FORTIFY_SOURCE works
now!)
2020-06-12 18:17:07 -05:00
Rick V
2efc884acf 64-bit LTO cursed for ages 2020-06-12 17:50:25 -05:00
Rick V
052bc25c4f
install make 2020-06-12 16:51:41 -05:00
Rick V
1f5df55443
don't use builtin patch 2020-06-12 16:41:30 -05:00
Rick V
8ac5213b42
windows builds on alpine lunix 2020-06-12 15:55:24 -05:00
Jeff
f8bec34f80
Merge pull request #1309 from jagerman/drone-submodules-step
Add tags/submodules as separate step
2020-06-12 14:33:03 -04:00
Jason Rhinelander
f4b4e4799f Add tags/submodules as separate step
Drone's initial clone doesn't include tags or submodules; add a step to
fetch both (rather than doing this in the build step).
2020-06-12 14:20:02 -03:00
Jason Rhinelander
b3f38883b8 Fix static distro drone typo
Static build runs on bionic, not focal.
2020-06-12 02:17:37 -03:00
Jeff Becker
6984cda3a6
add pybind and router hive to ci 2020-06-08 15:50:12 -04:00
Jason Rhinelander
8851766c5d macos static build & upload 2020-05-23 14:21:05 -03:00
Jason Rhinelander
cf447dc3a4 Build (and upload) debs by merging into the deb branches
Similar to the static files, the debs also end up under
builds.lokinet.dev/deb.
2020-05-23 11:33:50 -03:00
Jason Rhinelander
f54beadaa9 Add tar+upload to builds.lokinet.dev of static build
Relies on an SSH_KEY secret being set in the repository.

Also move the linked library check to a bash script because escaping a
value in jsonnet (escape once) that gets passed through yaml (escape
twice) and then bash (escape again) is too painful.
2020-05-23 00:36:30 -03:00
Jason Rhinelander
861f83c9cc drone tweaks
- add some comments
- exclude commits to the debian/ubuntu branches from getting built
- disable "Updating man-db" which chews up several seconds during
package install
2020-05-23 00:32:00 -03:00
Jason Rhinelander
9e1e11825e Fix the static build linked libs output check
- The `grep` had a typo of `-e` instead of `-E` which made it not work

- Made the command actually fail the pipeline if unwanted linked libs
were found.

- Print in green if everything is okay.

- Add librt.so to the whitelist
2020-05-21 11:47:05 -03:00
Jason Rhinelander
7d5a99d820
Merge pull request #1284 from majestrate/toggle-lto-2020-05-20
add WITH_LTO option to disble lto on compile time
2020-05-20 20:45:36 -03:00
Jason Rhinelander
e4e6fc205e Disable lto for most linux builds
Keeps it on for the first three (sid/release, sid/debug, and clang) and
turns them off for the rest.
2020-05-20 20:35:25 -03:00
Jason Rhinelander
ab02519a40 Add missing quote to static build linked libs test 2020-05-20 19:48:29 -03:00
Jason Rhinelander
1d11456d26 Move specify CLICOLOR_FORCE=1 to the drone backend 2020-05-20 19:18:28 -03:00
Jason Rhinelander
4d34ee82c9 Move Catalina build to drone (on lokinet-mini) 2020-05-20 19:18:27 -03:00
Jason Rhinelander
b1281cd9d3 Add gcc-10 build
This is temporary (until the `g++` metapackage switches from gcc 9 to
gcc 10).
2020-05-19 17:34:32 -03:00
Jason Rhinelander
7f8698ce44 Add several drone ci builds 2020-05-17 23:31:41 -03:00