2019-03-06 22:01:59 +00:00
git-secret - bash tool to store private data inside a git repo.
=============================================
2018-06-10 14:05:49 +00:00
## Usage: Setting up git-secret in a repository
2017-06-01 11:01:41 +00:00
2016-02-23 21:11:37 +00:00
These steps cover the basic process of using `git-secret` :
2016-02-24 11:24:07 +00:00
2020-09-20 18:46:48 +00:00
0. Before starting, [make sure you have created a `gpg` RSA key-pair ](#using-gpg ): a public and a secret key identified by your email address.
2018-06-10 14:05:49 +00:00
2020-01-29 13:26:25 +00:00
1. Begin with an existing or new git repository. You'll use the 'git secret' commands to add the keyrings and information
2020-09-20 18:46:48 +00:00
to make `git-secret` hide and reveal files in this repository.
2018-06-10 14:05:49 +00:00
2020-09-20 18:46:48 +00:00
2. Initialize the `git-secret` repository by running `git secret init` command. The `.gitsecret/` folder will be created.
**Note** all the contents of the `.gitsecret/` folder should be checked in, ** /except/** the `random_seed` file.
In other words, of all the files in `.gitsecret/` , only the `random_seed` file should be mentioned in your `.gitignore` file.
By default, `git secret init` will add the file `.gitsecret/keys/random_seed` to your `.gitignore` file.
2018-06-10 14:05:49 +00:00
2020-09-20 18:46:48 +00:00
3. Add the first user to the `git-secret` repo keyring by running `git secret tell your@gpg.email` .
2018-06-10 14:05:49 +00:00
2020-01-29 13:26:25 +00:00
4. Now it's time to add files you wish to encrypt inside the `git-secret` repository.
2020-09-20 18:46:48 +00:00
This can be done by running `git secret add <filenames...>` command. Make sure these files are ignored by mentions in
`.gitignore` , otherwise `git-secret` won't allow you to add them, as these files could be stored unencrypted. In the default configuration, `git-secret add` will automatically add the unencrypted versions of the files to `.gitignore` for you.
2018-06-10 14:05:49 +00:00
2020-01-29 13:26:25 +00:00
5. When done, run `git secret hide` to encrypt all files which you have added by the `git secret add` command.
The data will be encrypted with the public-keys described by the `git secret tell` command.
After using `git secret hide` to encrypt your data, it is safe to commit your changes.
2020-09-20 18:46:48 +00:00
**NOTE:** It's recommended to add the `git secret hide` command to your `pre-commit` hook, so you won't miss any changes.
2018-06-10 14:05:49 +00:00
2020-09-20 18:46:48 +00:00
6. Later you can decrypt files with the `git secret reveal` command, or just print their contents to stdout with the
2020-01-29 13:26:25 +00:00
`git secret cat` command. If you used a password on your GPG key (always recommended), it will ask you for your password.
2018-04-17 03:43:57 +00:00
And you're done!
2016-02-23 21:11:37 +00:00
2018-06-10 14:05:49 +00:00
### Usage: Adding someone to a repository using git-secret
2017-06-01 11:01:41 +00:00
2020-01-29 13:26:25 +00:00
1. [Get their `gpg` public-key ](#using-gpg ). **You won't need their secret key.**
2018-06-10 14:05:49 +00:00
2020-09-20 18:46:48 +00:00
2. Import this key into your `gpg` keyring (in `~/.gnupg` or similar) by running `gpg --import KEY_NAME.txt`
2018-06-10 14:05:49 +00:00
2020-01-29 13:26:25 +00:00
3. Now add this person to your secrets repo by running `git secret tell persons@email.id`
2018-06-21 12:21:52 +00:00
(this will be the email address associated with the public key)
2018-06-10 14:05:49 +00:00
2020-01-29 13:26:25 +00:00
4. The newly added user cannot yet read the encrypted files. Now, re-encrypt the files using
`git secret reveal; git secret hide -d` , and then commit and push the newly encrypted files.
(The -d options deletes the unencrypted file after re-encrypting it).
2020-09-20 18:46:48 +00:00
Now the newly added user will be able to decrypt the files in the repo using `git-secret reveal` .
2016-02-23 21:11:37 +00:00
2020-01-29 13:26:25 +00:00
Note that it is possible to add yourself to the git-secret repo without decrypting existing files.
It will be possible to decrypt them after re-encrypting them with the new keyring. So, if you don't
2018-04-17 15:20:01 +00:00
want unexpected keys added, you can configure some server-side security policy with the `pre-receive` hook.
2016-02-23 21:11:37 +00:00
2020-01-29 13:26:25 +00:00
### Using gpg
2020-09-20 18:46:48 +00:00
You can follow a quick `gpg` tutorial at [devdungeon ](https://www.devdungeon.com/content/gpg-tutorial ). Here are the most useful commands to get started:
2020-01-29 13:26:25 +00:00
To generate a RSA key-pair, run:
```shell
gpg --gen-key
```
To export your public key, run:
```shell
gpg --export your.email@address.com --armor > public-key.gpg
```
To import the public key of someone else (to share the secret with them for instance), run:
```shell
gpg --import public-key.gpg
```
2020-09-20 18:46:48 +00:00
To make sure you get the original public keys of the indicated persons, be sure to use a secure channel to transfer it, or use a service you trust, preferably one that uses encryption such as Keybase, to retrieve their public key. Otherwise you could grant the wrong person access to your secrets by mistake!
2020-01-29 13:26:25 +00:00
### Using git-secret for Continuous Integration / Continuous Deployment (CI/CD)
2020-09-20 18:46:48 +00:00
When using `git-secret` for CI/CD, you get the benefit that any deployment is necessarily done with the correct configuration, since it is collocated
2020-01-29 13:26:25 +00:00
with the changes in your code.
One way of doing it is the following:
1. [create a gpg key ](#using-gpg ) for your CI/CD environment. You can chose any name and email address you want: for instance `MyApp CodeShip <myapp@codeship.com>`
if your app is called MyApp and your CI/CD provider is CodeShip. It is easier not to define a password for that key.
2. run `gpg --export-secret-key myapp@codeship.com --armor` to get your private key value
3. Create an env var on your CI/CD server `GPG_PRIVATE_KEY` and assign it the private key value.
4. Then write your Continuous Deployment build script. For instance:
```shell
2021-05-06 08:34:30 +00:00
# As the first step: install git-secret,
# see: https://git-secret.io/installation
2020-01-29 13:26:25 +00:00
# Create private key file
echo $GPG_PRIVATE_KEY > ./private_key.gpg
# Import private key
gpg --import ./private_key.gpg
# Reveal secrets
git secret reveal
# carry on with your build script, secret files are available ...
```
Note: your CI/CD might not allow you to create a multiline value. In that case, you can export it on one line with
```shell
gpg --export-secret-key myapp@codeship.com --armor | tr '\n' ','
```
You can then create your private key file with:
```shell
echo $GPG_PRIVATE_KEY | tr ',' '\n' > ./private_key.gpg
```
2019-03-08 01:25:06 +00:00
## Environment Variables and Configuration
2017-06-01 11:01:41 +00:00
2020-09-20 18:46:48 +00:00
You can configure the version of `gpg` used, or the extension your encrypted files use, to suit your workflow better.
2020-01-29 13:26:25 +00:00
To do so, just set the required variable to the value you need.
2018-04-17 03:43:57 +00:00
This can be done in your shell environment file or with each `git-secret` command.
2020-09-20 18:46:48 +00:00
See below, or the man page of `git-secret` for an explanation of the environment variables `git-secret` uses.
2016-05-14 11:03:33 +00:00
2018-04-17 03:43:57 +00:00
The settings available to be changed are:
2019-03-08 01:25:06 +00:00
* `$SECRETS_VERBOSE` - sets the verbose flag to on for all `git-secret` commands; is identical
to using `-v` on each command that supports it.
2020-01-29 13:26:25 +00:00
* `$SECRETS_GPG_COMMAND` - sets the `gpg` alternatives, defaults to `gpg` .
It can be changed to `gpg` , `gpg2` , `pgp` , `/usr/local/gpg` or any other value.
2018-04-17 03:43:57 +00:00
After doing so rerun the tests to be sure that it won't break anything. Tested to be working with: `gpg` , `gpg2` .
2016-05-14 11:03:33 +00:00
* `$SECRETS_EXTENSION` - sets the secret files extension, defaults to `.secret` . It can be changed to any valid file extension.
2017-06-01 11:01:41 +00:00
2020-01-29 13:26:25 +00:00
* `$SECRETS_DIR` - sets the directory where git-secret stores its files, defaults to .gitsecret.
2018-08-26 17:24:39 +00:00
It can be changed to any valid directory name.
2020-01-29 13:26:25 +00:00
* `$SECRETS_PINENTRY` - allows user to specify a setting for `gpg` 's --pinentry option.
2019-08-16 20:53:57 +00:00
See `gpg` docs for details about gpg's --pinentry option.
2018-08-26 17:24:39 +00:00
## The `.gitsecret` folder (can be overridden with SECRETS_DIR)
2017-06-01 11:01:41 +00:00
2020-01-29 13:26:25 +00:00
This folder contains information about the files encrypted by git-secret,
and about which public/private key sets can access the encrypted data.
2018-06-10 14:05:49 +00:00
2018-08-26 17:24:39 +00:00
You can change the name of this directory using the SECRETS_DIR environment variable.
2020-01-29 13:26:25 +00:00
Use the various 'git secret' commands to manipulate the files in `.gitsecret` ,
2018-04-17 03:43:57 +00:00
you should not change the data in these files directly.
2017-06-01 11:01:41 +00:00
2018-08-26 17:24:39 +00:00
Exactly which files exist in the `.gitsecret` folder and what their contents are
2018-06-10 14:05:49 +00:00
vary slightly across different versions of gpg. Thus it is best to use
2020-01-29 13:26:25 +00:00
git-secret with the same version of gpg being used by all users.
2018-06-12 16:08:00 +00:00
This can be forced using SECRETS_GPG_COMMAND environment variable.
2018-06-10 14:05:49 +00:00
2018-06-11 12:07:03 +00:00
Specifically, there is an issue between gpg version 2.1.20 and later versions
2020-01-29 13:26:25 +00:00
which can cause problems reading and writing keyring files between systems
2018-06-11 12:07:03 +00:00
(this shows up in errors like 'gpg: skipped packet of type 12 in keybox').
2018-06-10 14:05:49 +00:00
2018-04-16 21:42:36 +00:00
The git-secret internal data is separated into two directories:
2017-06-01 11:01:41 +00:00
2018-04-16 20:07:56 +00:00
### `.gitsecret/paths`
2017-06-01 11:01:41 +00:00
2018-04-17 03:43:57 +00:00
This directory currently contains only the file `mapping.cfg` , which lists all the files your storing encrypted.
2018-04-16 20:07:56 +00:00
In other words, the path mappings: what files are tracked to be hidden and revealed.
All the other internal data is stored in the directory:
### `.gitsecret/keys`
2020-01-29 13:26:25 +00:00
This directory contains data used by git-secret and PGP to allow and maintain the correct encryption and access rights for the permitted parties.
2018-04-16 20:07:56 +00:00
2020-01-29 13:26:25 +00:00
Generally speaking, all the files in this directory *except* `random_seed` should be checked into your repo.
2020-09-20 18:46:48 +00:00
By default, `git secret init` will add the file `.gitsecret/keys/random_seed` to your `.gitignore` file.
2018-08-26 17:24:39 +00:00
Again, you can change the name of this directory using the SECRETS_DIR environment variable.