Commit Graph

162 Commits

Author SHA1 Message Date
Dev Random
e9741525ca Merge pull request #73 from theuni/cache
cache: define cache paths and GBUILD_CACHE_ENABLED conditionally
2014-11-11 15:41:54 -08:00
Cory Fields
b1e59cf0a1 cache: define cache paths and GBUILD_CACHE_ENABLED only if caching is enabled 2014-11-11 01:24:32 -05:00
Dev Random
02f4440473 Merge pull request #72 from theuni/git-minimize-upload
git: minimize uploaded git files
2014-11-10 10:37:36 -08:00
Dev Random
b484557029 Merge pull request #71 from theuni/cache
cache: define variables for cache paths
2014-11-10 10:21:20 -08:00
Cory Fields
66015b9f14 cache: define variables for cache paths 2014-11-10 01:48:19 -05:00
Cory Fields
dcf28c8b86 git: minimize uploaded git files
Rather than uploading every checked-out file of a repository and the
repository objects themselves, skip the checkout and instruct git to compact
before upload. The result is that only a handful of files are transferred,
rather than hundreds or thousands for large repositories.

The HEAD ref is updated before upload so that a hard reset works as before on
the target. The reflog is also disabled in order to avoid uploading useless log
files.

This change is backwards-compatible, but it will only have an effect on new
repositories.
2014-11-10 01:48:04 -05:00
Devrandom
300a2d6faa Merge branch 'virtio-kvm' 2014-11-06 14:18:33 -08:00
Lunar
c4c8348dff Use virtio for disk in KVM instead of emulating real hardware
This should improve I/O performance.
2014-11-06 11:33:10 +01:00
Lunar
56bd00ea39 Copy target image as a sparse file in LXC mode
This will save us from writing a lot of zeros on disk.
2014-11-06 11:31:28 +01:00
Dev Random
ace5bf3e58 Merge pull request #70 from theuni/cache
Enable cache option
2014-09-22 17:30:54 -07:00
Cory Fields
25fbf7d7a8 update docs for enable_cache option 2014-09-22 20:10:33 -04:00
Cory Fields
00d5b9849c cache: require the enable_cache key to be set to true in order to use cache functionality 2014-09-22 20:10:33 -04:00
Devrandom
07108c4eeb Default back to lxc-start, with option for lxc-execute 2014-09-22 15:10:33 -07:00
Devrandom
95362be81e Add warning in release notes about lxc-execute 2014-09-05 15:30:21 -07:00
Dev Random
27bd5b3869 Merge pull request #69 from gurnec/lxc-execute
Fix issue #63: use lxc-execute instead of lxc-start
2014-09-05 15:20:30 -07:00
Christopher Gurnee
63fe5d1de2 Fix issue #63: use lxc-execute instead of lxc-start 2014-09-04 16:54:05 -04:00
Dev Random
3a0e9024b8 Merge pull request #68 from theuni/cache
fix: use don't use methods that require new ruby version
2014-08-22 17:21:12 -07:00
Cory Fields
923ea1055d fix: use don't use methods that require new ruby version
This is a regression from ea24af10. Dir.exists isn't available in ruby 1.8
2014-08-22 19:41:44 -04:00
Dev Random
8e907adcc4 Merge pull request #58 from laanwj/master
Extend gverify comparison
2014-08-21 14:36:52 -07:00
Dev Random
611292cdcb Merge pull request #64 from theuni/cache
cache fixes
2014-08-12 19:05:39 -07:00
Cory Fields
00114ee98f fix: Separate cache from output files in yml report
Otherwise the output may look non-deterministic if there are stale files in
the cache.
2014-08-12 18:23:10 -04:00
Cory Fields
6a64b48d69 fix: create cache dirs to avoid file copy errors
This fixes builds that don't use caching.
2014-08-12 17:54:35 -04:00
Dev Random
9092f98825 Merge pull request #62 from theuni/cache
Add common cache and per-build cache
2014-08-07 10:42:14 -07:00
Cory Fields
b57286ab91 doc: add quick cache readme 2014-08-07 13:01:45 -04:00
Cory Fields
ea24af1043 Add common cache and per-build cache
Allow each builder to cache some files for re-use in the next build. This
allows for poor-man's dependency chaining.

Additionally, add a common cache pool for all builds. This can be used for
saving (for example) downloaded files to be shared between builds.
2014-08-07 13:01:37 -04:00
Dev Random
93b39496c4 Merge pull request #61 from brossi/master
Allow @ in URLs
2014-07-25 09:46:22 -07:00
Ben Rossi
feef35616b Allow @ in URLs so Gitian-Builder works against source stored on BitBucket. 2014-07-25 11:54:43 -04:00
Dev Random
ffd04a46a2 Merge pull request #60 from stefanha/readme-typo-fix
Fix typo in README.md setup instructions
2014-07-15 13:55:34 -07:00
Stefan Hajnoczi
f51c4cbfdd Fix typo in README.md setup instructions
Signed-off-by: Stefan Hajnoczi <stefanha@gmail.com>
2014-07-12 09:10:05 +02:00
Dev Random
ae83ac0c74 Merge pull request #59 from gdm85/master
Use a clean environment when building VMs
2014-06-11 08:42:20 -07:00
Giuseppe Mazzotta
25db707b34 Use a clean environment when building VMs 2014-06-11 16:52:41 +02:00
Wladimir J. van der Laan
449bc5b243 Extend gverify comparison
- Allow comparing to a sepcific 'golden' manifest with `--compare-to`
- By default pick the first manifest to compare to, instead of always
  comparing against the previous one, which is confusing
- Show line-by-line difference if `-v` given
2014-06-11 09:37:03 +02:00
Dev Random
7a01e8ac9c Merge pull request #57 from gdm85/master
Fix issue #56: clean up environment before gbuild'ing
2014-06-10 15:05:31 -07:00
gdm85
1504c76f11 Fix issue #56: clean up environment before gbuild'ing
Originally proposed by cfields
2014-06-11 00:00:16 +02:00
Dev Random
e81f4145c2 Merge pull request #52 from laanwj/master
Un-hardcode host/guest IP
2014-04-09 12:42:43 -04:00
Wladimir J. van der Laan
4e90888bcf Make it possible to override bridge if for LXC
For example Ubuntu installs a bridge called `virbr0` by default for LXC.
Using this system-provided bridge avoids having to configure one
specifically before gitian building.

This commits makes it possible to override the bridge used by gitian
using the environment variable LXC_BRIDGE. The default is still to use
`br0` as before.
2014-04-04 09:56:25 +02:00
Wladimir J. van der Laan
5785dfc3ae Un-hardcode host/guest IP
I was running into trouble using gitian LXC INSIDE a VirtualBox VM, because
the 10.0.2.x IP range overlaps with the range that VirtualBox uses for
its internal NAT network.

This commit makes it possible to override the host and guest IP that
is used during LXC image creation and the build, using environment variables:

- `GITIAN_HOST_IP` (default=10.0.2.2, host IP from the viewpoint of the
   VM, can be used for both LXC and KVM)
- `LXC_GUEST_IP` (default=10.0.2.5, guest IP from the viewpoint of the
   host, effective for LXC only)

When these are not defined the behavior remains the same as before.
2014-04-02 16:24:52 +02:00
Dev Random
c9e62adc21 Merge pull request #50 from simondlr/increase_time
Increase time for checking if a target has started.
2014-04-01 11:14:14 -07:00
Dev Random
f0ec85e788 Merge pull request #51 from laanwj/master
Make it possible to override source URL
2014-04-01 08:57:45 -07:00
Wladimir J. van der Laan
534248d236 Make it possible to override source URL
To make test builds it can be useful to point gitian at an
alternative repository.

This commit makes this possible by adding a `--url PAIRS` command line
option, that allows to optionally specify where to fetch the code, for
example:

    gbuild --url bitcoin=https://github.com/laanwj/bitcoin.git --commit bitcoin=2014_03_...
2014-04-01 10:36:50 +02:00
Simon de la Rouviere
d8d01f7bad Increase time for checking if a target has started. 2014-02-11 17:18:30 +02:00
Dev Random
69de033bf4 Merge pull request #46 from tlrobinson/master
Add VirtualBox support to make-base-vm via Vagrant
2014-02-03 16:03:01 -08:00
devrandom
af10dad1fd Fix sanity checking in README 2014-02-03 10:27:02 -08:00
Tom Robinson
a6fdc28839 Add VirtualBox support to make-base-vm via Vagrant 2014-02-01 19:23:44 -08:00
devrandom
ac4f77bcd1 Initialize umask to a known value (002) 2013-12-04 14:16:44 -08:00
Dev Random
bdcbce6a0d Merge pull request #37 from TheBlueMatt/master
Fix bug + increase disk size
2013-10-31 19:25:59 -07:00
Matt Corallo
4e8ea08ee3 Fix gitian_updater checksum matching. 2013-10-31 21:35:51 -04:00
Matt Corallo
95e09ae608 Increase disk size for things like Firefox that need it. 2013-10-31 21:35:37 -04:00
devrandom
54f74f9c23 qemu-utils are required 2013-10-31 15:22:43 -07:00
devrandom
79c1217cb1 make passing env vars work across guest OS suites 2013-09-29 10:58:33 -07:00