2018-12-11 20:21:49 +01:00
# Collection of git hooks for Terraform to be used with [pre-commit framework](http://pre-commit.com/)
2016-09-27 19:47:26 +02:00
2020-01-21 05:19:46 -05:00
[](https://github.com/antonbabenko/pre-commit-terraform/releases)  [](https://www.codetriage.com/antonbabenko/pre-commit-terraform)
2018-01-03 22:26:39 -06:00
2018-12-11 20:21:49 +01:00
## How to install
2018-01-24 15:46:37 +01:00
2019-10-17 14:50:16 +03:00
### 1. Install dependencies
2016-09-27 19:47:26 +02:00
2020-01-21 05:19:46 -05:00
* [`pre-commit` ](https://pre-commit.com/#install )
2020-08-19 06:06:55 -04:00
* [`terraform-docs` ](https://github.com/terraform-docs/terraform-docs ) required for `terraform_docs` hooks. `GNU awk` is required if using `terraform-docs` older than 0.8.0 with Terraform 0.12.
2020-01-21 05:19:46 -05:00
* [`TFLint` ](https://github.com/terraform-linters/tflint ) required for `terraform_tflint` hook.
2020-04-23 09:56:33 -05:00
* [`TFSec` ](https://github.com/liamg/tfsec ) required for `terraform_tfsec` hook.
2020-04-29 10:35:31 +01:00
* [`coreutils` ](https://formulae.brew.sh/formula/coreutils ) required for `terraform_validate` hook on macOS (due to use of `realpath` ).
2020-09-08 15:10:56 +02:00
* [`checkov` ](https://github.com/bridgecrewio/checkov ) required for `checkov` hook.
2019-10-17 14:50:16 +03:00
##### MacOS
```bash
2020-04-29 10:35:31 +01:00
brew install pre-commit gawk terraform-docs tflint tfsec coreutils
2019-10-17 14:50:16 +03:00
```
##### Ubuntu
2018-12-11 20:21:49 +01:00
```bash
2021-02-25 17:03:46 +01:00
sudo apt install python3-pip gawk unzip &&\
2019-10-17 14:50:16 +03:00
pip3 install pre-commit
2021-02-25 17:03:46 +01:00
curl -L "$(curl -s https://api.github.com/repos/terraform-docs/terraform-docs/releases/latest | grep -o -E "https://.+?-linux-amd64.tar.gz")" > terraform-docs.tgz && tar xzf terraform-docs.tgz && chmod +x terraform-docs && sudo mv terraform-docs /usr/bin/
2020-01-21 05:19:46 -05:00
curl -L "$(curl -s https://api.github.com/repos/terraform-linters/tflint/releases/latest | grep -o -E "https://.+?_linux_amd64.zip")" > tflint.zip && unzip tflint.zip && rm tflint.zip && sudo mv tflint /usr/bin/
2021-02-25 17:03:46 +01:00
env GO111MODULE=on go get -u github.com/tfsec/tfsec/cmd/tfsec
2018-12-11 20:21:49 +01:00
```
2018-05-16 20:04:48 +02:00
2019-10-17 14:50:16 +03:00
### 2. Install the pre-commit hook globally
```bash
DIR=~/.git-template
git config --global init.templateDir ${DIR}
pre-commit init-templatedir -t pre-commit ${DIR}
```
2018-05-16 20:04:48 +02:00
2019-10-17 14:50:16 +03:00
### 3. Add configs and hooks
2018-05-16 20:04:48 +02:00
2018-12-11 20:21:49 +01:00
Step into the repository you want to have the pre-commit hooks installed and run:
2016-09-27 19:47:26 +02:00
2018-12-11 20:21:49 +01:00
```bash
2019-10-17 14:50:16 +03:00
git init
2018-12-11 20:21:49 +01:00
cat <<EOF > .pre-commit-config.yaml
2020-04-29 15:06:02 -05:00
repos:
2018-01-15 16:12:51 +01:00
- repo: git://github.com/antonbabenko/pre-commit-terraform
2020-01-21 05:19:46 -05:00
rev: <VERSION> # Get the latest from: https://github.com/antonbabenko/pre-commit-terraform/releases
2018-01-15 16:12:51 +01:00
hooks:
- id: terraform_fmt
2019-06-17 12:47:06 +02:00
- id: terraform_docs
2018-12-11 20:21:49 +01:00
EOF
```
2019-10-17 14:50:16 +03:00
### 4. Run
2018-12-11 20:21:49 +01:00
After pre-commit hook has been installed you can run it manually on all files in the repository
```bash
pre-commit run -a
2016-09-27 19:47:26 +02:00
```
2018-12-11 20:21:49 +01:00
## Available Hooks
2020-01-21 05:19:46 -05:00
There are several [pre-commit ](https://pre-commit.com/ ) hooks to keep Terraform configurations (both `*.tf` and `*.tfvars` ) and Terragrunt configurations (`*.hcl` ) in a good shape:
2019-10-17 14:50:16 +03:00
| Hook name | Description |
| ------------------------------------------------ | -------------------------------------------------------------------------------------------------------------------------- |
| `terraform_fmt` | Rewrites all Terraform configuration files to a canonical format. |
| `terraform_validate` | Validates all Terraform configuration files. |
| `terraform_docs` | Inserts input and output documentation into `README.md` . Recommended. |
| `terraform_docs_without_aggregate_type_defaults` | Inserts input and output documentation into `README.md` without aggregate type defaults. |
2020-11-12 05:55:53 -05:00
| `terraform_docs_replace` | Runs `terraform-docs` and pipes the output directly to README.md (requires terraform-docs v0.10.0 or later) |
2020-01-21 05:19:46 -05:00
| `terraform_tflint` | Validates all Terraform configuration files with [TFLint ](https://github.com/terraform-linters/tflint ). |
2019-10-17 14:50:16 +03:00
| `terragrunt_fmt` | Rewrites all [Terragrunt ](https://github.com/gruntwork-io/terragrunt ) configuration files (`*.hcl` ) to a canonical format. |
2020-08-19 20:01:42 +10:00
| `terragrunt_validate` | Validates all [Terragrunt ](https://github.com/gruntwork-io/terragrunt ) configuration files (`*.hcl` ) |
2020-04-23 09:56:33 -05:00
| `terraform_tfsec` | [TFSec ](https://github.com/liamg/tfsec ) static analysis of terraform templates to spot potential security issues. |
2020-09-08 15:10:56 +02:00
| `checkov` | [checkov ](https://github.com/bridgecrewio/checkov ) static analysis of terraform templates to spot potential security issues. |
2018-12-11 20:21:49 +01:00
Check the [source file ](https://github.com/antonbabenko/pre-commit-terraform/blob/master/.pre-commit-hooks.yaml ) to know arguments used for each hook.
2019-10-17 14:50:16 +03:00
## Notes about terraform_docs hooks
2018-12-11 20:21:49 +01:00
2020-08-19 06:06:55 -04:00
1. `terraform_docs` and `terraform_docs_without_aggregate_type_defaults` will insert/update documentation generated by [terraform-docs ](https://github.com/terraform-docs/terraform-docs ) framed by markers:
2019-10-17 14:50:16 +03:00
```txt
<!-- BEGINNING OF PRE-COMMIT-TERRAFORM DOCS HOOK -->
<!-- END OF PRE-COMMIT-TERRAFORM DOCS HOOK -->
```
if they are present in `README.md` .
2018-12-11 20:21:49 +01:00
2020-11-12 05:55:53 -05:00
1. `terraform_docs_replace` replaces the entire README.md rather than doing string replacement between markers. Put your additional documentation at the top of your `main.tf` for it to be pulled in. The optional `--dest` argument lets you change the name of the file that gets created/modified. This hook requires terraform-docs v0.10.0 or later.
2018-12-13 22:16:01 -05:00
1. Example:
```yaml
hooks:
- id: terraform_docs_replace
2020-11-12 05:55:53 -05:00
args: ['--sort-by-required', '--dest=TEST.md']
2018-12-13 22:16:01 -05:00
```
2018-12-11 20:21:49 +01:00
1. It is possible to pass additional arguments to shell scripts when using `terraform_docs` and `terraform_docs_without_aggregate_type_defaults` . Send pull-request with the new hook if there is something missing.
2019-11-16 18:37:23 +00:00
## Notes about terraform_tflint hooks
1. `terraform_tflint` supports custom arguments so you can enable module inspection, deep check mode etc.
1. Example:
```yaml
hooks:
- id: terraform_tflint
2020-08-27 10:57:45 +01:00
args: ['--args=--deep']
2020-03-02 14:48:53 +00:00
```
In order to pass multiple args, try the following:
```yaml
- id: terraform_tflint
2020-05-27 10:35:15 +02:00
args:
2020-08-27 10:57:45 +01:00
- '--args=--deep'
- '--args=--enable-rule=terraform_documented_variables'
2019-11-16 18:37:23 +00:00
```
2020-09-22 14:20:27 +02:00
1. When you have multiple directories and want to run `tflint` in all of them and share single config file it is impractical to hard-code the path to `.tflint.hcl` file. The solution is to use `__GIT_WORKING_DIR__` placeholder which will be replaced by `terraform_tflint` hooks with Git working directory (repo root) at run time. For example:
```yaml
hooks:
- id: terraform_tflint
args:
- '--args=--config=__GIT_WORKING_DIR__/.tflint.hcl'
```
2020-04-23 09:56:33 -05:00
## Notes about terraform_tfsec hooks
2020-09-01 01:07:08 -07:00
1. `terraform_tfsec` will consume modified files that pre-commit
passes to it, so you can perform whitelisting of directories
or files to run against via [files ](https://pre-commit.com/#config-files )
pre-commit flag
1. Example:
```yaml
hooks:
- id: terraform_tfsec
files: ^prd-infra/
```
The above will tell pre-commit to pass down files from the `prd-infra/` folder
only such that the underlying `tfsec` tool can run against changed files in this
directory, ignoring any other folders at the root level
2020-04-23 09:56:33 -05:00
1. To ignore specific warnings, follow the convention from the
[documentation ](https://github.com/liamg/tfsec#ignoring-warnings ).
1. Example:
```hcl
resource "aws_security_group_rule" "my-rule" {
type = "ingress"
cidr_blocks = ["0.0.0.0/0"] #tfsec:ignore:AWS006
}
```
2020-08-27 10:57:45 +01:00
## Notes about terraform_validate hooks
1. `terraform_validate` supports custom arguments so you can pass supported no-color or json flags.
1. Example:
```yaml
hooks:
- id: terraform_validate
args: ['--args=-json']
```
In order to pass multiple args, try the following:
```yaml
- id: terraform_validate
args:
- '--args=-json'
- '--args=-no-color'
```
1. `terraform_validate` also supports custom environment variables passed to the pre-commit runtime
1. Example:
```yaml
hooks:
- id: terraform_validate
args: ['--envs=AWS_DEFAULT_REGION="us-west-2"']
```
In order to pass multiple args, try the following:
```yaml
- id: terraform_validate
args:
- '--envs=AWS_DEFAULT_REGION="us-west-2"'
- '--envs=AWS_ACCESS_KEY_ID="anaccesskey"'
- '--envs=AWS_SECRET_ACCESS_KEY="asecretkey"'
```
2020-04-23 09:56:33 -05:00
2020-11-02 21:44:54 +01:00
1. It may happen that Terraform working directory (`.terraform` ) already exists but not in the best condition (eg, not initialized modules, wrong version of Terraform, etc). To solve this problem you can find and delete all `.terraform` directories in your repository using this command:
```shell
find . -type d -name ".terraform" -print0 | xargs -0 rm -r
```
`terraform_validate` hook will try to reinitialize them before running `terraform validate` command.
2018-12-14 16:16:42 -05:00
## Notes for developers
1. Python hooks are supported now too. All you have to do is:
2019-06-19 06:10:21 -04:00
1. add a line to the `console_scripts` array in `entry_points` in `setup.py`
2018-12-14 16:16:42 -05:00
1. Put your python script in the `pre_commit_hooks` folder
2020-11-02 21:44:54 +01:00
Enjoy the clean, valid, and documented code!
2018-12-11 20:21:49 +01:00
## Authors
This repository is managed by [Anton Babenko ](https://github.com/antonbabenko ) with help from [these awesome contributors ](https://github.com/antonbabenko/pre-commit-terraform/graphs/contributors ).
## License
MIT licensed. See LICENSE for full details.