Commit Graph

469 Commits

Author SHA1 Message Date
Jason Rhinelander
09372994bb macOS system extension support
Adds support for building Lokinet as a system extension, and fixes
various problems in the macos implementation found during development of
the system extension support.
2022-08-12 21:13:38 -03:00
Jason Rhinelander
93421c6eaf Change permissions for system extension 2022-08-12 20:23:00 -03:00
majestrate
db961ac728
Merge pull request #1943 from majestrate/keygen-script-2022-06-26
simple keygen script
2022-07-26 12:07:06 -04:00
Jeff
23fd46c0db
add directory specific readmes 2022-07-26 09:26:28 -04:00
Jeff
b819ed21d2
clean up build helper scripts:
* cleanup of android build shims
* cleanup of windows build shims
2022-07-20 13:36:04 -04:00
Jeff
8cde7c7e7a
fix win32 and android builds 2022-07-19 11:31:14 -04:00
Jeff
a3725284e4
simple keygen script 2022-06-26 10:02:59 -04:00
Jeff
73a49f5473
do not build liblokinet in windows, exe gets too big 2022-05-30 17:08:08 -03:00
majestrate
608dced827
typofix 2022-05-24 12:56:55 -04:00
majestrate
f16c2ecd43
use oxenc submodule in android 2022-05-24 12:56:37 -04:00
Jeff
7396eb7f3b
bump oxenc submodule and force oxenc submodule on win32 2022-05-18 17:40:55 -04:00
majestrate
65ef0e4bfb
Merge pull request #1849 from majestrate/dry-cross-2022-02-02
dry cross compile
2022-03-30 16:48:00 -04:00
majestrate
1fc901330c
Merge pull request #1851 from majestrate/ci-docs-generation-2022-02-04
ci docs generation
2022-03-30 16:45:53 -04:00
Jeff
7251944adc redo contrib/cross.sh to take cmake arguments 2022-03-16 14:21:40 -04:00
Jeff
66b7c3698e remove unneeded line from contrib/cross.sh 2022-03-16 14:21:40 -04:00
Jeff
56492c88ac dry cross compile 2022-03-16 14:21:40 -04:00
Jeff
ae96458f8a remove old dead code 2022-02-27 11:10:15 -05:00
Jeff
c70f1866f8 include mkdocs.yml in ci artifacts for docs 2022-02-17 18:01:53 -05:00
Jeff
97f4545fd5 make CI pipline generate docs with doxygen, doxybook2 and mkdocs. 2022-02-17 18:01:53 -05:00
majestrate
838183e36e
Merge pull request #1748 from majestrate/liblokinet-udp-api-2021-09-19
liblokinet updates
2022-02-06 13:19:08 -05:00
Jeff
48559bd282 fix up ppc64le cross target 2022-02-02 08:34:58 -05:00
Jeff
eae4d3cf74 fixup armhf target 2022-02-02 08:10:03 -05:00
Jeff
f543f6962d fix up ppc64le toolchain, remove suffix 2022-02-02 07:41:10 -05:00
Jeff
24811aff37 fix up contrib/cross.sh to put everything in build-cross 2022-02-02 07:40:52 -05:00
Jeff
08a9e0ad39 add cross compile helpers and update/add toolchains 2022-02-02 07:35:39 -05:00
Jeff Becker
5286d442fb updates:
* add udptest example
* fix up udp codepath in liblokinet
2022-01-31 10:53:48 -05:00
Jeff
82ffa2f02c Update mac.sh
disable liblokinet on mac by default in mac.sh
2022-01-31 10:53:48 -05:00
Jeff Becker
50b8056491 enable liblokinet on macos 2022-01-31 10:53:48 -05:00
Jeff
996de3d4c6 make it so github sees the repo is gpl3 2022-01-28 11:20:22 -05:00
Jeff
e0df1875fb
drop x86 for android as flutter does not support it 2021-12-05 14:17:58 -05:00
Jeff Becker
8c6bf31c52
paralellize android build much better
* split up configure step and build step so that build steps goes all at once
* update ci to use new build structure for android
2021-11-23 12:43:54 -05:00
Jason Rhinelander
5de5091e8d docker CI: Fix error message 2021-11-16 20:24:47 -04:00
Jeff Becker
e7d282993a
in static linux ci pipeline disable building lokinet-bootstrap and bundle a bootstrap.signed 2021-11-16 09:43:08 -05:00
Jason Rhinelander
e6622c1d46 Install g++-8 on bionic 2021-10-28 13:49:37 -03:00
Jason Rhinelander
cd49031bd2 Fix race condition in interactive output 2021-10-28 13:49:20 -03:00
Jason Rhinelander
0b4c56dff5 Add hacks; add --distro to rebuild just one
Bionic is broken and needs a hack to create some dumb pgm include
directory.

Add --distro cli argument so that you can rebuild just one distro.
2021-10-26 17:38:17 -03:00
Jason Rhinelander
0572713533 Fix i386 builds 2021-10-26 15:10:54 -03:00
Jason Rhinelander
09e97eef77 Make it snazzy
Shows statuses that "fill in" when run interactively.
2021-10-26 14:57:58 -03:00
Jason Rhinelander
2064ca049d Parallelize builds 2021-10-26 14:05:35 -03:00
Jason Rhinelander
9b7ec7dd50 Add --no-cache option; fix manifest generation 2021-10-26 10:59:24 -03:00
Jason Rhinelander
1c4332ad6a Replace dockerfiles with a Python script 2021-10-26 03:28:49 -03:00
Jason Rhinelander
cbbee59774 Add a bunch of base CI images for building debs
Installs just the base tools (which are quite substantial), but not the
deps (which get installed as part of the build).
2021-10-26 03:25:26 -03:00
Jason Rhinelander
f3bac4ae72 Pass DOCKER_BUILD_OPTS env var to docker build 2021-10-22 19:15:46 -03:00
Jason Rhinelander
c7410660c8 Make sure we apt-get update in the build
The base image can get out of date.
2021-10-22 19:15:46 -03:00
Jason Rhinelander
78e829a03f Add python build deps to ci images 2021-10-22 19:15:46 -03:00
Jason Rhinelander
b64a38ff2c Add missing xz-utils to buster 2021-10-17 23:42:13 -03:00
Jason Rhinelander
76d69a3d70 Add cached images with debhelper & related tools for deb pipelines 2021-10-17 17:27:40 -03:00
Jason Rhinelander
4351611859 Add automake, libtool, libjemalloc-dev 2021-10-17 17:22:26 -03:00
Jason Rhinelander
d64e2ae0af Reformat RUN commands to make editing easier
- split them on multiple lines
- sort the installed package deps
- don't use extra unnecessary `bash` invocation
2021-10-17 15:20:52 -03:00
Jason Rhinelander
326670b959 Docker package updates:
- add `make`
- add `patch`
2021-10-17 15:13:36 -03:00
Jason Rhinelander
47d8c95e68 CI docker multiarch
Adds multiarch docker images and starts using them.
2021-10-17 14:46:30 -03:00
Jason Rhinelander
1dccbb5814 Update deb repo dns name 2021-10-16 16:00:27 -03:00
Jason Rhinelander
ca9d979361 Docker image updates
- split debian sid into base/sid/clang images
- similarly for debian stable
- add jsonnet to lint
- add `--pull` to docker build so that we always pull the latest images
  (otherwise we were building on whatever local cache we have for
  `debian:sid`, etc., which made the base image update layer much
  larger).
- don't install Recommends by default
- add libzmq3-dev
- split android into android (base) and flutter
- hard-code registry.oxen.rocks into the dockerfile stuff because that
  seems to be the only way to properly depend on other docker builds.
- update a few CI builds that should have been using our images but
  weren't.
- Update a few CI images to bullseye instead of buster

Add openssh-client (for sftp to upload builds)
2021-10-16 15:54:22 -03:00
Jason Rhinelander
1526b2a2eb which => command -v; different format.sh exit codes
`which` is a debian tool that is being deprecated in favour of
posix-standard `command -v`, so which to that to avoid deprecation
warnings.

Change the exit codes of `contrib/format.sh verify` to be unique for
each formatting program.
2021-10-16 15:16:55 -03:00
Jason Rhinelander
9b0b9fe67b Add jsonnet formatting (if jsonnet is installed) 2021-10-16 15:16:55 -03:00
Jason Rhinelander
62d7192a50 Add mainnet/testnet bootstrap files into repo
We use them everywhere now (include the debs) so it makes sense to have
them bundled here rather than needing a download during package build
(in particular for debs that's considered a bad thing).
2021-09-10 19:38:32 -03:00
Jason Rhinelander
12e00b7a99 Remove advertising of big crappy company 2021-09-02 19:14:33 -03:00
Jason Rhinelander
92c7fb9872 LOKINET_VERSION -> built in lokinet_VERSION 2021-09-02 19:11:41 -03:00
Jason Rhinelander
8aef5d742d Re-enable LTO; target macos 10.12+ 2021-09-02 19:07:40 -03:00
Jason Rhinelander
3527c9cdb5
Remove more unused dns-proxy files 2021-09-02 14:17:10 -04:00
Jason Rhinelander
e39c473c88
format.sh: support macports clang-format
macports names it clang-format-mp-N to avoid clashing with a
system-installed one.
2021-09-02 14:17:09 -04:00
Jason Rhinelander
329da951b7
Apple OS interface cleanup & refactoring
- Add a C callback interface (context_wrapper.h) between lokinet and the
  objective-C code so that:
  - we can use objective-C (rather than objective-C++), which seems more
    likely to be supported by Apple into the future;
  - we minimize the amount of code that needs to be aware of the Apple
    APIs.
  - this replaces apple logger objective c++ implementation with a plain
    c++ implementation that takes a very simple C callback (provided
    from the obj-c code) to actually make the call to NSLog.

- Add various documentation to the code of what is going on.

- Send all DNS traffic to the primary IP on the tun interface.  The
  match prefixes simply don't work as advertised, and have weird shit
  (like even if you get it working for some domains, "instagram.com"
  still doesn't because of god-knows-what Apple internal politics).

- Drop the dns proxy code as we don't need it anymore.

- Don't use 9.9.9.9 for default DNS.  (We might consider the unfiltered
  9.9.9.10 as an alternative default, but if we do it should be a global
  lokinet change rather than a Mac-specific change).

- Parse a lokinet.ini in the data directory, if it exists.  (Since we
  are sandboxed, it is an app-specific "home" directory so is probably
  buried god knows where, but at least the GUI ought to be able to get
  it to let users add things to it).

- This commit also adds a swift version of the PacketTunnelProvider
  glue, which ought to work in theory, but the *tooling* for cmake is so
  underdeveloped that I couldn't find any way to actually get the damn
  thing working.  So I'm committing it here anyway (and will revert it
  away in the next commit) in case we someday want to switch to it.

-
2021-09-02 14:17:09 -04:00
jeff
1272a4fbe1
add dummy sign target for ci when we don't have signing keys
remove static macos from ci pipeline
2021-09-02 14:17:09 -04:00
jeff
7db2459469
macos sort of works now 2021-09-02 14:17:09 -04:00
Jason Rhinelander
81d27c35c1
Default CODESIGN_APPEX to CODESIGN_APP
Sometimes (e.g. dev builds) these can apparently be the same; sometimes
it seems they need to be different, because Apple.
2021-09-02 14:17:08 -04:00
Jason Rhinelander
3ab117a03b
Switch extension from a framework to an appex 2021-09-02 14:17:08 -04:00
Jason Rhinelander
faf8a699a6
Set version into Info.plist, don't manually configure
cmake already treats the info plist as a file to be configured (not
merely copied) so we don't need to configure_file ourselves to a temp
file.
2021-09-02 14:17:08 -04:00
Jason Rhinelander
0bb00baacf
Various cmake build cleanups/refactors
- Added contrib/macos/README.txt with description of the cancer
  happening here.
- Add provisioningprofiles that Apple wants to make things work properly
- Made the entitlements files match the provisioningprofiles
- Remove configured entitlements files; we *can't* change any of the
  things here because they are closedly tied to the provisioningprofiles
  -- which means if someone wants to build their own Lokinet, they have
  to replace a bunch of crap and change application IDs throughout.
  This is the hostile-to-open-source Apple way.
- Remove unused old lokinet binary, as we're no longer using it on macos
- Use a POST_BUILD rather than install to copy things around into the
  right places
- Convert all the configure_file's to consistently use @ONLY
- Misc cleanups
2021-09-02 14:17:08 -04:00
jeff
5edd045c9b
add swift version bullshit file and additional bullshittery 2021-09-02 14:17:08 -04:00
jeff
0708a0d897
initial network extension code for macos
probably does not work
2021-09-02 14:17:08 -04:00
Jeff Becker
63ed5c16ed
upload bare apk as ci artifact 2021-09-02 13:11:29 -04:00
Jeff Becker
92cfa8a558
dont bundle raw jni libs 2021-09-02 13:05:16 -04:00
Jeff Becker
f65ec8e79f
make ci try building the flutter apk in the android apk pipeline 2021-09-02 12:01:36 -04:00
Jason Rhinelander
29418f7a7b bencode-dump.py: support reading from stdin
So that you can pipe bt-encoded output into it, e.g. from the
in-progress oxend bt-rpc interface.
2021-08-06 14:25:32 -03:00
Jeff Becker
8f4c23ef47
add option to invert regex filter results 2021-07-05 09:09:21 -04:00
Jeff Becker
3893a94e07
better time formatting for future times 2021-07-05 09:09:21 -04:00
Jeff Becker
6df1d6412d
unify introset-filter and path-filter 2021-07-05 09:09:21 -04:00
Jeff Becker
264616c8ba
fix unicode char 2021-07-05 09:09:21 -04:00
Jeff Becker
63c601b0c0
fixes for lokinetmon filters 2021-07-05 09:09:21 -04:00
Jeff Becker
91f6ca9869
typofix 2021-07-05 09:09:21 -04:00
Jeff Becker
383312a74d
make filters consistent for localhost.loki 2021-07-05 09:09:21 -04:00
Jeff Becker
30848165e7
add path filter in lokinetmon 2021-07-05 09:09:21 -04:00
Jeff Becker
d918e1edda
add age to outbound contexts in lokinetmon
better time foratting in lokinetmon
2021-07-05 09:09:20 -04:00
Jeff Becker
32a94c73e2
update lokinetmon
* add --introset-filter option to filter results in introset inspection mode by regex
2021-07-05 09:09:20 -04:00
Jeff Becker
a316f5f787
add wine as dependancy because god made windows so that man may suffer 2021-07-05 07:26:04 -04:00
Jeff Becker
da985c4c44
add docker image for nodejs 2021-07-05 07:26:03 -04:00
Jeff
058e358b5c
Merge pull request #1669 from majestrate/inbound-convo-wrong-path-fix-2021-06-14
[bugfix] make inbound convotags reply on the correct path
2021-06-22 13:04:28 -04:00
Jason Rhinelander
d2dc3b8c1b Fix program name in bencode-dump.py --help 2021-06-22 12:27:04 -03:00
Jason Rhinelander
4b0a10328a Add bencoded file dumper 2021-06-22 12:18:55 -03:00
Jeff Becker
ae36fd42bb
remove badIntros from lokinetmon as rpc no longer has them in it 2021-06-21 15:16:27 -04:00
Jeff Becker
00d4942d85
more 2021-06-21 15:16:26 -04:00
Jeff Becker
71d17dc2c9
format and logging
ignore outbound session auth messages
2021-06-21 15:16:26 -04:00
Jeff Becker
5924ca5b3f
update android ci docker jizz 2021-06-21 11:49:04 -04:00
Jeff Becker
ff796cd142
if git describe fails fall back to a placeholder 2021-06-21 07:52:25 -04:00
Jeff Becker
9e65f262f9
update docker ci jizz to include flutter on android 2021-06-21 07:48:07 -04:00
Jeff Becker
6f9f527f50
ccache android builds in ci 2021-06-19 09:35:49 -04:00
Jeff Becker
0a1cc0fc90
fix android ci output path name so that it does not conflict 2021-06-19 09:35:49 -04:00
Jeff Becker
300638163b
typofix 2021-06-19 09:35:49 -04:00
Jeff Becker
79d881689d
fix windows static ci upload for windows 2021-06-19 09:35:49 -04:00
Jeff Becker
b7485b4b25
* make android ABIS list configurable
* fix android ci jizz, correct typo, upload generated assets
2021-06-19 08:05:05 -04:00