Commit Graph

66 Commits (b1e59cf0a1489074b2a5adf8db8b346dacf66c15)

Author SHA1 Message Date
Cory Fields b1e59cf0a1 cache: define cache paths and GBUILD_CACHE_ENABLED only if caching is enabled 10 years ago
Dev Random 02f4440473 Merge pull request #72 from theuni/git-minimize-upload
git: minimize uploaded git files
10 years ago
Cory Fields 66015b9f14 cache: define variables for cache paths 10 years ago
Cory Fields dcf28c8b86 git: minimize uploaded git files
Rather than uploading every checked-out file of a repository and the
repository objects themselves, skip the checkout and instruct git to compact
before upload. The result is that only a handful of files are transferred,
rather than hundreds or thousands for large repositories.

The HEAD ref is updated before upload so that a hard reset works as before on
the target. The reflog is also disabled in order to avoid uploading useless log
files.

This change is backwards-compatible, but it will only have an effect on new
repositories.
10 years ago
Cory Fields 00d5b9849c cache: require the enable_cache key to be set to true in order to use cache functionality 10 years ago
Christopher Gurnee 63fe5d1de2 Fix issue #63: use lxc-execute instead of lxc-start 10 years ago
Cory Fields 923ea1055d fix: use don't use methods that require new ruby version
This is a regression from ea24af10. Dir.exists isn't available in ruby 1.8
10 years ago
Dev Random 8e907adcc4 Merge pull request #58 from laanwj/master
Extend gverify comparison
10 years ago
Cory Fields 00114ee98f fix: Separate cache from output files in yml report
Otherwise the output may look non-deterministic if there are stale files in
the cache.
10 years ago
Cory Fields 6a64b48d69 fix: create cache dirs to avoid file copy errors
This fixes builds that don't use caching.
10 years ago
Cory Fields ea24af1043 Add common cache and per-build cache
Allow each builder to cache some files for re-use in the next build. This
allows for poor-man's dependency chaining.

Additionally, add a common cache pool for all builds. This can be used for
saving (for example) downloaded files to be shared between builds.
10 years ago
Ben Rossi feef35616b Allow @ in URLs so Gitian-Builder works against source stored on BitBucket. 10 years ago
Giuseppe Mazzotta 25db707b34 Use a clean environment when building VMs 10 years ago
Wladimir J. van der Laan 449bc5b243 Extend gverify comparison
- Allow comparing to a sepcific 'golden' manifest with `--compare-to`
- By default pick the first manifest to compare to, instead of always
  comparing against the previous one, which is confusing
- Show line-by-line difference if `-v` given
10 years ago
gdm85 1504c76f11 Fix issue #56: clean up environment before gbuild'ing
Originally proposed by cfields
10 years ago
Wladimir J. van der Laan 5785dfc3ae Un-hardcode host/guest IP
I was running into trouble using gitian LXC INSIDE a VirtualBox VM, because
the 10.0.2.x IP range overlaps with the range that VirtualBox uses for
its internal NAT network.

This commit makes it possible to override the host and guest IP that
is used during LXC image creation and the build, using environment variables:

- `GITIAN_HOST_IP` (default=10.0.2.2, host IP from the viewpoint of the
   VM, can be used for both LXC and KVM)
- `LXC_GUEST_IP` (default=10.0.2.5, guest IP from the viewpoint of the
   host, effective for LXC only)

When these are not defined the behavior remains the same as before.
10 years ago
Dev Random c9e62adc21 Merge pull request #50 from simondlr/increase_time
Increase time for checking if a target has started.
10 years ago
Wladimir J. van der Laan 534248d236 Make it possible to override source URL
To make test builds it can be useful to point gitian at an
alternative repository.

This commit makes this possible by adding a `--url PAIRS` command line
option, that allows to optionally specify where to fetch the code, for
example:

    gbuild --url bitcoin=https://github.com/laanwj/bitcoin.git --commit bitcoin=2014_03_...
10 years ago
Simon de la Rouviere d8d01f7bad Increase time for checking if a target has started. 11 years ago
Tom Robinson a6fdc28839 Add VirtualBox support to make-base-vm via Vagrant 11 years ago
devrandom ac4f77bcd1 Initialize umask to a known value (002) 11 years ago
Matt Corallo 95e09ae608 Increase disk size for things like Firefox that need it. 11 years ago
devrandom 79c1217cb1 make passing env vars work across guest OS suites 11 years ago
Arlo Breault d9cc3d14b9 Don't warn in if LXC. 11 years ago
Dev Random 5512bb3cec Merge pull request #35 from luke-jr/no_recommends
Don't install package recommends implicitly
11 years ago
Dev Random 41c3545e3b Merge pull request #34 from luke-jr/bugfix_noninteractive
Bugfix: Use noninteractive frontend for apt-get
11 years ago
Luke Dashjr f43ff49fa7 Don't install package recommends implicitly (require yml to specify them) 11 years ago
Luke Dashjr ffe46ca40b Bugfix: Use noninteractive frontend for apt-get 11 years ago
Luke Dashjr 46b75df3d3 Bugfix: Pass --update-head-ok to git fetch to avoid problems overwriting checked out branch 11 years ago
Luke Dashjr 9512784622 Bugfix: git fetch directly from the remote URL, rather than only setting a default the first time
- Fixes problem where the gitian URL varies for different branches of the same repository
- Explicitly fetching tags using + allows repository to overwrite existing tags (changed tag)
- Fetching branch heads to local heads correctly makes branch names available for commit option
- Fetching both branches and tags at the same time optimizes things slightly
11 years ago
devrandom 5746af15e0 setarch on guest for LXC
Some packages use uname -m, which is not set to i386 on LXC on a 64 bit
host.

fixes #24
12 years ago
Dev Random 93d443077e Merge pull request #22 from TheBlueMatt/master
Make using an invalid tag/commit an error
12 years ago
Matt Corallo e27f2a7bce Make using an invalid tag/commit an error 12 years ago
devrandom 9c95b90ca3 Fix git-fetch and brctl doc 12 years ago
devrandom e82c0b4760 Work around cron issue during make-base-vm 12 years ago
Matt Corallo 46a5199a24 Update for Ruby 1.9 12 years ago
devrandom 9b082abbdb Utility to canonicalize a zip file. 12 years ago
devrandom 74652f1881 Better transport from host to target and resolve commitish on host. 12 years ago
devrandom 8ad9e0dfaf Allow + in urls 12 years ago
devrandom f9d155c3ac Fix loop device detection 12 years ago
devrandom ba55f0d896 Use git-reset to ensure that git repo copy is not dirty 12 years ago
devrandom 0bc83c5f44 Use image file for lxc 12 years ago
devrandom 28bb421156 First pass lxc support 12 years ago
devrandom cff169537c Add "optionals" array to descriptor/assertion YAML files - allow them to be missing on verify 13 years ago
devrandom 5a2986fd17 gitian-updater - remove dep on sha256sum binary 13 years ago
devrandom 10b40d5ad5 improve quietness flag 13 years ago
devrandom d60397616d add -j and -m flags to control VM processors, make procs and VM memory 13 years ago
Matt Corallo 73d8868c8a Use server kernel for Hardy amd64.
Hardy (and probably others) doesnt have a linux-image-virtual for
amd64, thus we use the server kernel.
13 years ago
devrandom 758e78fc6e allow spaces in assert paths 13 years ago
devrandom fee4a94e39 check if kvm is available and warn if not 13 years ago