2024-01-17 00:18:19 +01:00
# Collection of git hooks for OpenTofu to be used with [pre-commit framework](http://pre-commit.com/)
2016-09-27 19:47:26 +02:00
2024-01-21 21:01:18 +01:00
[](https://github.com/tofuutils/pre-commit-opentofu/releases)  [](https://www.codetriage.com/tofuutils/pre-commit-opentofu)
2021-09-09 12:38:43 +03:00
2024-01-17 00:18:19 +01:00
Want to contribute? Check [open issues ](https://github.com/tofuutils/pre-commit-opentofu/issues?q=label%3A%22good+first+issue%22+is%3Aopen+sort%3Aupdated-desc ) and [contributing notes ](/.github/CONTRIBUTING.md ).
2021-10-01 19:31:14 +03:00
2021-10-26 17:40:24 +02:00
## Sponsors
2024-01-17 00:44:43 +01:00
If you are using `pre-commit-opentofu` already or want to support its development and [many other open-source projects ](https://github.com/tofuutils ), please become a [GitHub Sponsor ](https://github.com/sponsors/tofuutils )!
2021-10-26 17:40:24 +02:00
2021-12-08 21:03:04 +02:00
2021-10-26 17:40:24 +02:00
## Table of content
2021-11-08 22:28:02 +02:00
* [Table of content ](#table-of-content )
2021-09-09 12:38:43 +03:00
* [How to install ](#how-to-install )
* [1. Install dependencies ](#1-install-dependencies )
* [2. Install the pre-commit hook globally ](#2-install-the-pre-commit-hook-globally )
* [3. Add configs and hooks ](#3-add-configs-and-hooks )
* [4. Run ](#4-run )
* [Available Hooks ](#available-hooks )
2021-09-29 14:36:55 +03:00
* [Hooks usage notes and examples ](#hooks-usage-notes-and-examples )
2023-11-01 17:05:24 +02:00
* [Known limitations ](#known-limitations )
2022-04-26 13:33:58 +03:00
* [All hooks: Usage of environment variables in `--args` ](#all-hooks-usage-of-environment-variables-in---args )
2022-07-05 19:07:01 +03:00
* [All hooks: Set env vars inside hook at runtime ](#all-hooks-set-env-vars-inside-hook-at-runtime )
2022-07-06 15:34:13 +03:00
* [All hooks: Disable color output ](#all-hooks-disable-color-output )
2024-01-17 01:10:38 +01:00
* [checkov (deprecated) and tofu\_checkov ](#checkov-deprecated-and-tofu_checkov )
2022-11-26 20:35:58 +02:00
* [infracost\_breakdown ](#infracost_breakdown )
2024-01-17 01:10:38 +01:00
* [tofu\_docs ](#tofu_docs )
* [tofu\_docs\_replace (deprecated) ](#tofu_docs_replace-deprecated )
* [tofu\_fmt ](#tofu_fmt )
* [tofu\_providers\_lock ](#tofu_providers_lock )
* [tofu\_tflint ](#tofu_tflint )
* [tofu\_tfsec (deprecated) ](#tofu_tfsec-deprecated )
* [tofu\_trivy ](#tofu_trivy )
* [tofu\_validate ](#tofu_validate )
* [tofu\_wrapper\_module\_for\_each ](#tofu_wrapper_module_for_each )
2021-12-22 19:44:53 +01:00
* [terrascan ](#terrascan )
2022-04-13 10:25:04 -07:00
* [tfupdate ](#tfupdate )
2023-05-08 14:44:55 +01:00
* [Docker Usage ](#docker-usage )
* [File Permissions ](#file-permissions )
2024-01-17 01:10:38 +01:00
* [Download OpenTofu modules from private GitHub repositories ](#download-tofu-modules-from-private-github-repositories )
2021-09-09 12:38:43 +03:00
* [Authors ](#authors )
* [License ](#license )
2018-01-03 22:26:39 -06:00
2018-12-11 20:21:49 +01:00
## How to install
2018-01-24 15:46:37 +01:00
2019-10-17 14:50:16 +03:00
### 1. Install dependencies
2016-09-27 19:47:26 +02:00
2021-09-09 22:29:33 +03:00
<!-- markdownlint-disable no-inline-html -->
2022-11-07 15:38:07 +02:00
* [`pre-commit` ](https://pre-commit.com/#install ),
2024-01-21 21:01:18 +01:00
<sub><sup>[`opentofu` ](https://opentofu.org/docs/intro/install/ ),
2022-11-07 15:38:07 +02:00
<sub><sup>[`git` ](https://git-scm.com/downloads ),
<sub><sup>POSIX compatible shell,
<sub><sup>Internet connection (on first run),
2023-05-08 14:10:06 +03:00
<sub><sup>x86_64 or arm64 compatible operation system,
2022-11-07 15:38:07 +02:00
<sub><sup>Some hardware where this OS will run,
<sub><sup>Electricity for hardware and internet connection,
<sub><sup>Some basic physical laws,
<sub><sup>Hope that it all will work.
</sup></sub></sup></sub></sup></sub></sup></sub></sup></sub></sup></sub></sup></sub></sup></sub></sup></sub><br><br>
2024-01-21 21:01:18 +01:00
* [`checkov` ](https://github.com/bridgecrewio/checkov ) required for `tofu_checkov` hook.
* [`terraform-docs` ](https://github.com/terraform-docs/terraform-docs ) required for `tofu_docs` hook.
2021-09-11 10:47:56 +03:00
* [`terragrunt` ](https://terragrunt.gruntwork.io/docs/getting-started/install/ ) required for `terragrunt_validate` hook.
2022-05-16 14:03:56 +03:00
* [`terrascan` ](https://github.com/tenable/terrascan ) required for `terrascan` hook.
2024-01-21 21:01:18 +01:00
* [`TFLint` ](https://github.com/terraform-linters/tflint ) required for `tofu_tflint` hook.
* [`TFSec` ](https://github.com/liamg/tfsec ) required for `tofu_tfsec` hook.
* [`Trivy` ](https://github.com/aquasecurity/trivy ) required for `tofu_trivy` hook.
2021-10-26 14:12:01 +03:00
* [`infracost` ](https://github.com/infracost/infracost ) required for `infracost_breakdown` hook.
2024-01-17 01:10:38 +01:00
* [`jq` ](https://github.com/stedolan/jq ) required for `tofu_validate` with `--retry-once-with-cleanup` flag, and for `infracost_breakdown` hook.
2022-04-13 10:25:04 -07:00
* [`tfupdate` ](https://github.com/minamijoyo/tfupdate ) required for `tfupdate` hook.
2024-01-21 21:01:18 +01:00
* [`hcledit` ](https://github.com/minamijoyo/hcledit ) required for `tofu_wrapper_module_for_each` hook.
2021-09-09 22:29:33 +03:00
<details><summary><b>Docker</b></summary><br>
2021-12-08 21:03:04 +02:00
**Pull docker image with all hooks**:
```bash
TAG=latest
2024-06-14 17:32:43 +03:00
docker pull tofuutils/pre-commit-opentofu:$TAG
2021-12-08 21:03:04 +02:00
```
2024-01-17 00:18:19 +01:00
All available tags [here ](https://github.com/tofuutils/pre-commit-opentofu/pkgs/container/pre-commit-opentofu/versions ).
2021-12-08 21:03:04 +02:00
**Build from scratch**:
2023-04-28 12:53:31 -04:00
> **Note**: To build image you need to have [`docker buildx`](https://docs.docker.com/build/install-buildx/) enabled as default builder.
> Otherwise - provide `TARGETOS` and `TARGETARCH` as additional `--build-arg`'s to `docker build`.
2024-01-21 21:01:18 +01:00
When hooks-related `--build-arg` s are not specified, only the latest version of `pre-commit` and `opentofu` will be installed.
2021-09-09 22:29:33 +03:00
```bash
2024-01-17 00:18:19 +01:00
git clone git@github .com:tofuutils/pre-commit-opentofu.git
2024-01-17 00:44:43 +01:00
cd pre-commit-opentofu
2021-10-26 14:39:23 +02:00
# Install the latest versions of all the tools
2024-01-17 00:44:43 +01:00
docker build -t pre-commit-opentofu --build-arg INSTALL_ALL=true .
2021-09-09 22:29:33 +03:00
```
2021-10-26 14:39:23 +02:00
To install a specific version of individual tools, define it using `--build-arg` arguments or set it to `latest` :
2021-09-09 22:29:33 +03:00
```bash
2024-01-17 00:44:43 +01:00
docker build -t pre-commit-opentofu \
2021-09-09 22:29:33 +03:00
--build-arg PRE_COMMIT_VERSION=latest \
2024-01-17 01:14:36 +01:00
--build-arg TOFU_VERSION=latest \
2021-09-09 22:29:33 +03:00
--build-arg CHECKOV_VERSION=2.0.405 \
2021-10-26 14:12:01 +03:00
--build-arg INFRACOST_VERSION=latest \
2021-09-09 22:29:33 +03:00
--build-arg TERRAFORM_DOCS_VERSION=0.15.0 \
--build-arg TERRAGRUNT_VERSION=latest \
--build-arg TERRASCAN_VERSION=1.10.0 \
--build-arg TFLINT_VERSION=0.31.0 \
--build-arg TFSEC_VERSION=latest \
2023-12-15 15:54:13 +01:00
--build-arg TRIVY_VERSION=latest \
2022-04-13 10:25:04 -07:00
--build-arg TFUPDATE_VERSION=latest \
2022-05-02 19:59:08 +02:00
--build-arg HCLEDIT_VERSION=latest \
2021-09-09 22:29:33 +03:00
.
```
2019-10-17 14:50:16 +03:00
2021-10-26 14:39:23 +02:00
Set `-e PRE_COMMIT_COLOR=never` to disable the color output in `pre-commit` .
2021-03-12 15:35:21 +01:00
2021-09-09 22:29:33 +03:00
</details>
<details><summary><b>MacOS</b></summary><br>
2019-10-17 14:50:16 +03:00
```bash
2023-12-15 15:54:13 +01:00
brew install pre-commit terraform-docs tflint tfsec trivy checkov terrascan infracost tfupdate minamijoyo/hcledit/hcledit jq
2019-10-17 14:50:16 +03:00
```
2021-09-09 22:29:33 +03:00
</details>
<details><summary><b>Ubuntu 18.04</b></summary><br>
2018-12-11 20:21:49 +01:00
```bash
2021-03-12 10:32:41 +01:00
sudo apt update
2021-09-10 22:33:03 +03:00
sudo apt install -y unzip software-properties-common
2021-03-12 10:32:41 +01:00
sudo add-apt-repository ppa:deadsnakes/ppa
sudo apt install -y python3.7 python3-pip
2021-09-09 12:38:43 +03:00
python3 -m pip install --upgrade pip
2021-09-09 22:29:33 +03:00
pip3 install --no-cache-dir pre-commit
python3.7 -m pip install -U checkov
2021-09-10 22:33:03 +03:00
curl -L "$(curl -s https://api.github.com/repos/terraform-docs/terraform-docs/releases/latest | grep -o -E -m 1 "https://.+?-linux-amd64.tar.gz")" > terraform-docs.tgz && tar -xzf terraform-docs.tgz && rm terraform-docs.tgz && chmod +x terraform-docs && sudo mv terraform-docs /usr/bin/
curl -L "$(curl -s https://api.github.com/repos/terraform-linters/tflint/releases/latest | grep -o -E -m 1 "https://.+?_linux_amd64.zip")" > tflint.zip && unzip tflint.zip && rm tflint.zip && sudo mv tflint /usr/bin/
curl -L "$(curl -s https://api.github.com/repos/aquasecurity/tfsec/releases/latest | grep -o -E -m 1 "https://.+?tfsec-linux-amd64")" > tfsec && chmod +x tfsec && sudo mv tfsec /usr/bin/
2023-12-15 15:54:13 +01:00
curl -L "$(curl -s https://api.github.com/repos/aquasecurity/trivy/releases/latest | grep -o -E -i -m 1 "https://.+?/trivy_.+?_Linux-64bit.tar.gz")" > trivy.tar.gz && tar -xzf trivy.tar.gz trivy && rm trivy.tar.gz && sudo mv trivy /usr/bin
2022-05-16 14:03:56 +03:00
curl -L "$(curl -s https://api.github.com/repos/tenable/terrascan/releases/latest | grep -o -E -m 1 "https://.+?_Linux_x86_64.tar.gz")" > terrascan.tar.gz && tar -xzf terrascan.tar.gz terrascan && rm terrascan.tar.gz && sudo mv terrascan /usr/bin/ && terrascan init
2021-10-26 14:12:01 +03:00
sudo apt install -y jq && \
curl -L "$(curl -s https://api.github.com/repos/infracost/infracost/releases/latest | grep -o -E -m 1 "https://.+?-linux-amd64.tar.gz")" > infracost.tgz && tar -xzf infracost.tgz && rm infracost.tgz && sudo mv infracost-linux-amd64 /usr/bin/infracost && infracost register
2022-04-13 10:25:04 -07:00
curl -L "$(curl -s https://api.github.com/repos/minamijoyo/tfupdate/releases/latest | grep -o -E -m 1 "https://.+?_linux_amd64.tar.gz")" > tfupdate.tar.gz && tar -xzf tfupdate.tar.gz tfupdate && rm tfupdate.tar.gz && sudo mv tfupdate /usr/bin/
2022-05-02 19:59:08 +02:00
curl -L "$(curl -s https://api.github.com/repos/minamijoyo/hcledit/releases/latest | grep -o -E -m 1 "https://.+?_linux_amd64.tar.gz")" > hcledit.tar.gz && tar -xzf hcledit.tar.gz hcledit && rm hcledit.tar.gz && sudo mv hcledit /usr/bin/
2018-12-11 20:21:49 +01:00
```
2018-05-16 20:04:48 +02:00
2021-09-09 22:29:33 +03:00
</details>
<details><summary><b>Ubuntu 20.04</b></summary><br>
2021-09-09 12:38:43 +03:00
```bash
sudo apt update
2021-09-10 22:33:03 +03:00
sudo apt install -y unzip software-properties-common python3 python3-pip
2021-09-09 12:38:43 +03:00
python3 -m pip install --upgrade pip
2021-09-09 22:29:33 +03:00
pip3 install --no-cache-dir pre-commit
pip3 install --no-cache-dir checkov
2021-09-10 22:33:03 +03:00
curl -L "$(curl -s https://api.github.com/repos/terraform-docs/terraform-docs/releases/latest | grep -o -E -m 1 "https://.+?-linux-amd64.tar.gz")" > terraform-docs.tgz && tar -xzf terraform-docs.tgz terraform-docs && rm terraform-docs.tgz && chmod +x terraform-docs && sudo mv terraform-docs /usr/bin/
2022-05-16 14:03:56 +03:00
curl -L "$(curl -s https://api.github.com/repos/tenable/terrascan/releases/latest | grep -o -E -m 1 "https://.+?_Linux_x86_64.tar.gz")" > terrascan.tar.gz && tar -xzf terrascan.tar.gz terrascan && rm terrascan.tar.gz && sudo mv terrascan /usr/bin/ && terrascan init
2021-09-10 22:33:03 +03:00
curl -L "$(curl -s https://api.github.com/repos/terraform-linters/tflint/releases/latest | grep -o -E -m 1 "https://.+?_linux_amd64.zip")" > tflint.zip && unzip tflint.zip && rm tflint.zip && sudo mv tflint /usr/bin/
curl -L "$(curl -s https://api.github.com/repos/aquasecurity/tfsec/releases/latest | grep -o -E -m 1 "https://.+?tfsec-linux-amd64")" > tfsec && chmod +x tfsec && sudo mv tfsec /usr/bin/
2023-12-15 15:54:13 +01:00
curl -L "$(curl -s https://api.github.com/repos/aquasecurity/trivy/releases/latest | grep -o -E -i -m 1 "https://.+?/trivy_.+?_Linux-64bit.tar.gz")" > trivy.tar.gz && tar -xzf trivy.tar.gz trivy && rm trivy.tar.gz && sudo mv trivy /usr/bin
2021-10-26 14:12:01 +03:00
sudo apt install -y jq && \
curl -L "$(curl -s https://api.github.com/repos/infracost/infracost/releases/latest | grep -o -E -m 1 "https://.+?-linux-amd64.tar.gz")" > infracost.tgz && tar -xzf infracost.tgz && rm infracost.tgz && sudo mv infracost-linux-amd64 /usr/bin/infracost && infracost register
2022-04-13 10:25:04 -07:00
curl -L "$(curl -s https://api.github.com/repos/minamijoyo/tfupdate/releases/latest | grep -o -E -m 1 "https://.+?_linux_amd64.tar.gz")" > tfupdate.tar.gz && tar -xzf tfupdate.tar.gz tfupdate && rm tfupdate.tar.gz && sudo mv tfupdate /usr/bin/
2022-05-02 19:59:08 +02:00
curl -L "$(curl -s https://api.github.com/repos/minamijoyo/hcledit/releases/latest | grep -o -E -m 1 "https://.+?_linux_amd64.tar.gz")" > hcledit.tar.gz && tar -xzf hcledit.tar.gz hcledit && rm hcledit.tar.gz && sudo mv hcledit /usr/bin/
2021-09-09 12:38:43 +03:00
```
2021-09-09 22:29:33 +03:00
</details>
2024-01-21 21:01:18 +01:00
<details><summary><b>Ubuntu 22.04</b></summary><br>
```bash
sudo apt update
sudo apt install -y unzip software-properties-common python3 python3-pip
python3 -m pip install --upgrade pip
pip3 install --no-cache-dir pre-commit
pip3 install --no-cache-dir checkov
curl -L "$(curl -s https://api.github.com/repos/terraform-docs/terraform-docs/releases/latest | grep -o -E -m 1 "https://.+?-linux-amd64.tar.gz")" > terraform-docs.tgz && tar -xzf terraform-docs.tgz terraform-docs && rm terraform-docs.tgz && chmod +x terraform-docs && sudo mv terraform-docs /usr/bin/
curl -L "$(curl -s https://api.github.com/repos/tenable/terrascan/releases/latest | grep -o -E -m 1 "https://.+?_Linux_x86_64.tar.gz")" > terrascan.tar.gz && tar -xzf terrascan.tar.gz terrascan && rm terrascan.tar.gz && sudo mv terrascan /usr/bin/ && terrascan init
curl -L "$(curl -s https://api.github.com/repos/terraform-linters/tflint/releases/latest | grep -o -E -m 1 "https://.+?_linux_amd64.zip")" > tflint.zip && unzip tflint.zip && rm tflint.zip && sudo mv tflint /usr/bin/
curl -L "$(curl -s https://api.github.com/repos/aquasecurity/tfsec/releases/latest | grep -o -E -m 1 "https://.+?tfsec-linux-amd64")" > tfsec && chmod +x tfsec && sudo mv tfsec /usr/bin/
curl -L "$(curl -s https://api.github.com/repos/aquasecurity/trivy/releases/latest | grep -o -E -i -m 1 "https://.+?/trivy_.+?_Linux-64bit.tar.gz")" > trivy.tar.gz && tar -xzf trivy.tar.gz trivy && rm trivy.tar.gz && sudo mv trivy /usr/bin
sudo apt install -y jq && \
curl -L "$(curl -s https://api.github.com/repos/infracost/infracost/releases/latest | grep -o -E -m 1 "https://.+?-linux-amd64.tar.gz")" > infracost.tgz && tar -xzf infracost.tgz && rm infracost.tgz && sudo mv infracost-linux-amd64 /usr/bin/infracost && infracost register
curl -L "$(curl -s https://api.github.com/repos/minamijoyo/tfupdate/releases/latest | grep -o -E -m 1 "https://.+?_linux_amd64.tar.gz")" > tfupdate.tar.gz && tar -xzf tfupdate.tar.gz tfupdate && rm tfupdate.tar.gz && sudo mv tfupdate /usr/bin/
curl -L "$(curl -s https://api.github.com/repos/minamijoyo/hcledit/releases/latest | grep -o -E -m 1 "https://.+?_linux_amd64.tar.gz")" > hcledit.tar.gz && tar -xzf hcledit.tar.gz hcledit && rm hcledit.tar.gz && sudo mv hcledit /usr/bin/
```
</details>
2022-06-07 13:04:00 +03:00
<details><summary><b>Windows 10/11</b></summary>
We highly recommend using [WSL/WSL2 ](https://docs.microsoft.com/en-us/windows/wsl/install ) with Ubuntu and following the Ubuntu installation guide. Or use Docker.
2023-04-28 12:53:31 -04:00
> **Note**: We won't be able to help with issues that can't be reproduced in Linux/Mac.
2022-06-07 13:04:00 +03:00
> So, try to find a working solution and send PR before open an issue.
Otherwise, you can follow [this gist ](https://gist.github.com/etiennejeanneaurevolve/1ed387dc73c5d4cb53ab313049587d09 ):
1. Install [`git` ](https://git-scm.com/downloads ) and [`gitbash` ](https://gitforwindows.org/ )
2. Install [Python 3 ](https://www.python.org/downloads/ )
3. Install all prerequisites needed (see above)
Ensure your PATH environment variable looks for `bash.exe` in `C:\Program Files\Git\bin` (the one present in `C:\Windows\System32\bash.exe` does not work with `pre-commit.exe` )
For `checkov` , you may need to also set your `PYTHONPATH` environment variable with the path to your Python modules.
E.g. `C:\Users\USERNAME\AppData\Local\Programs\Python\Python39\Lib\site-packages`
</details>
2021-09-09 22:29:33 +03:00
<!-- markdownlint-enable no-inline-html -->
2021-09-09 12:38:43 +03:00
2019-10-17 14:50:16 +03:00
### 2. Install the pre-commit hook globally
2021-09-09 12:38:43 +03:00
2023-04-28 12:53:31 -04:00
> **Note**: not needed if you use the Docker image
2019-10-17 14:50:16 +03:00
```bash
DIR=~/.git-template
git config --global init.templateDir ${DIR}
pre-commit init-templatedir -t pre-commit ${DIR}
```
2018-05-16 20:04:48 +02:00
2019-10-17 14:50:16 +03:00
### 3. Add configs and hooks
2018-05-16 20:04:48 +02:00
2018-12-11 20:21:49 +01:00
Step into the repository you want to have the pre-commit hooks installed and run:
2016-09-27 19:47:26 +02:00
2018-12-11 20:21:49 +01:00
```bash
2019-10-17 14:50:16 +03:00
git init
2018-12-11 20:21:49 +01:00
cat <<EOF > .pre-commit-config.yaml
2020-04-29 15:06:02 -05:00
repos:
2024-01-17 00:18:19 +01:00
- repo: https://github.com/tofuutils/pre-commit-opentofu
rev: <VERSION> # Get the latest from: https://github.com/tofuutils/pre-commit-opentofu/releases
2018-01-15 16:12:51 +01:00
hooks:
2024-01-17 01:15:52 +01:00
- id: tofu_fmt
- id: tofu_docs
2018-12-11 20:21:49 +01:00
EOF
```
2019-10-17 14:50:16 +03:00
### 4. Run
2018-12-11 20:21:49 +01:00
2021-10-26 14:39:23 +02:00
Execute this command to run `pre-commit` on all files in the repository (not only changed files):
2018-12-11 20:21:49 +01:00
```bash
pre-commit run -a
2016-09-27 19:47:26 +02:00
```
2024-01-17 00:18:19 +01:00
Or, using Docker ([available tags ](https://github.com/tofuutils/pre-commit-opentofu/pkgs/container/pre-commit-opentofu/versions )):
2021-09-09 12:38:43 +03:00
2023-05-08 14:44:55 +01:00
> **Note**: This command uses your user id and group id for the docker container to use to access the local files. If the files are owned by another user, update the `USERID` environment variable. See [File Permissions section](#file-permissions) for more information.
2022-09-07 07:19:52 -05:00
2021-03-12 15:35:21 +01:00
```bash
2021-12-08 21:03:04 +02:00
TAG=latest
2024-06-14 18:49:55 +03:00
docker run -e "USERID=$(id -u):$(id -g)" -v $(pwd):/lint -w /lint tofuutils/pre-commit-opentofu:$TAG run -a
2021-03-12 15:35:21 +01:00
```
2021-10-26 14:39:23 +02:00
Execute this command to list the versions of the tools in Docker:
2021-12-08 21:03:04 +02:00
2021-10-26 14:39:23 +02:00
```bash
2021-12-08 21:03:04 +02:00
TAG=latest
2024-06-14 18:49:55 +03:00
docker run --rm --entrypoint cat tofuutils/pre-commit-opentofu:$TAG /usr/bin/tools_versions_info
2021-10-26 14:39:23 +02:00
```
2021-09-11 10:47:56 +03:00
2018-12-11 20:21:49 +01:00
## Available Hooks
2024-01-21 21:01:18 +01:00
There are several [pre-commit ](https://pre-commit.com/ ) hooks to keep OpenTofu configurations (both `*.tf` and `*.tfvars` ) and Terragrunt configurations (`*.hcl` ) in a good shape:
2019-10-17 14:50:16 +03:00
2021-10-15 15:08:26 +03:00
<!-- markdownlint-disable no-inline-html -->
2021-11-08 22:28:02 +02:00
| Hook name | Description | Dependencies<br><sup>[Install instructions here ](#1-install-dependencies )</sup> |
2022-11-26 20:38:21 +02:00
| ------------------------------------------------------ | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------ |
2024-01-17 01:15:52 +01:00
| `checkov` and `tofu_checkov` | [checkov ](https://github.com/bridgecrewio/checkov ) static analysis of OpenTofu templates to spot potential security issues. [Hook notes ](#checkov-deprecated-and-tofu_checkov ) | `checkov` <br>Ubuntu deps: `python3` , `python3-pip` |
2021-11-08 22:28:02 +02:00
| `infracost_breakdown` | Check how much your infra costs with [infracost ](https://github.com/infracost/infracost ). [Hook notes ](#infracost_breakdown ) | `infracost` , `jq` , [Infracost API key ](https://www.infracost.io/docs/#2-get-api-key ) |
2024-01-21 21:01:18 +01:00
| `tofu_docs` | Inserts input and output documentation into `README.md` . Recommended. [Hook notes ](#terraform_docs ) | `terraform-docs` |
2024-01-21 21:19:16 +01:00
| `tofu_docs_replace` | Runs `terraform-docs` and pipes the output directly to README.md. **DEPRECATED ** . [Hook notes ](#terraform_docs_replace-deprecated ) | `python3` , `terraform-docs` |
| `tofu_docs_without_` <br>`aggregate_type_defaults` | Inserts input and output documentation into `README.md` without aggregate type defaults. Hook notes same as for [tofu_docs ](#terraform_docs ) | `tofu-docs` |
2024-01-21 21:11:37 +01:00
| `tofu_fmt` | Reformat all OpenTofu configuration files to a canonical format. [Hook notes ](#terraform_fmt ) | - |
| `tofu_providers_lock` | Updates provider signatures in [dependency lock files ](https://www.terraform.io/docs/cli/commands/providers/lock.html ). [Hook notes ](#terraform_providers_lock ) | - |
| `tofu_tflint` | Validates all OpenTofu configuration files with [TFLint ](https://github.com/terraform-linters/tflint ). [Available TFLint rules ](https://github.com/terraform-linters/tflint/tree/master/docs/rules#rules ). [Hook notes ](#terraform_tflint ). | `tflint` |
| `tofu_tfsec` | [TFSec ](https://github.com/aquasecurity/tfsec ) static analysis of terraform templates to spot potential security issues. **DEPRECATED ** , use `tofu_trivy` . [Hook notes ](#terraform_tfsec-deprecated ) | `tfsec` |
2024-01-21 21:19:16 +01:00
| `tofu_trivy` | [Trivy ](https://github.com/aquasecurity/trivy ) static analysis of terraform templates to spot potential security issues. [Hook notes ](#terraform_trivy ) | `trivy` |
2024-01-17 01:10:38 +01:00
| `tofu_validate` | Validates all Terraform configuration files. [Hook notes ](#tofu_validate ) | `jq` , only for `--retry-once-with-cleanup` flag |
2021-11-08 22:28:02 +02:00
| `terragrunt_fmt` | Reformat all [Terragrunt ](https://github.com/gruntwork-io/terragrunt ) configuration files (`*.hcl` ) to a canonical format. | `terragrunt` |
| `terragrunt_validate` | Validates all [Terragrunt ](https://github.com/gruntwork-io/terragrunt ) configuration files (`*.hcl` ) | `terragrunt` |
2024-01-17 01:14:36 +01:00
| `tofu_wrapper_module_for_each` | Generates OpenTofu wrappers with `for_each` in module. [Hook notes ](#terraform_wrapper_module_for_each ) | `hcledit` |
2022-11-26 20:38:21 +02:00
| `terrascan` | [terrascan ](https://github.com/tenable/terrascan ) Detect compliance and security violations. [Hook notes ](#terrascan ) | `terrascan` |
2024-01-21 21:19:16 +01:00
| `tfupdate` | [tfupdate ](https://github.com/minamijoyo/tfupdate ) Update version constraints of OpenTofu core, providers, and modules. [Hook notes ](#tfupdate ) | `tfupdate` |
2021-10-15 15:08:26 +03:00
<!-- markdownlint-enable no-inline-html -->
2018-12-11 20:21:49 +01:00
2024-01-17 00:18:19 +01:00
Check the [source file ](https://github.com/tofuutils/pre-commit-opentofu/blob/master/.pre-commit-hooks.yaml ) to know arguments used for each hook.
2018-12-11 20:21:49 +01:00
2021-09-29 14:36:55 +03:00
## Hooks usage notes and examples
2023-11-01 17:05:24 +02:00
### Known limitations
2024-01-21 21:19:16 +01:00
OpenTofu operates on a per-dir basis, while `pre-commit` framework only supports files and files that exist. This means if you only remove the TF-related file without any other changes in the same dir, checks will be skipped. Example and details [here ](https://github.com/pre-commit/pre-commit/issues/3048 ).
2023-11-01 17:05:24 +02:00
2022-04-26 13:33:58 +03:00
### All hooks: Usage of environment variables in `--args`
2024-01-17 01:14:36 +01:00
> All, except deprecated hooks: `checkov`, `tofu_docs_replace`
2022-04-26 13:33:58 +03:00
2022-11-26 20:38:21 +02:00
You can use environment variables for the `--args` section.
> **Warning**: You _must_ use the `${ENV_VAR}` definition, `$ENV_VAR` will not expand.
2022-04-26 13:33:58 +03:00
Config example:
```yaml
2024-01-17 01:10:38 +01:00
- id: tofu_tflint
2022-04-26 13:33:58 +03:00
args:
- --args=--config=${CONFIG_NAME}.${CONFIG_EXT}
- --args=--module
```
If for config above set up `export CONFIG_NAME=.tflint; export CONFIG_EXT=hcl` before `pre-commit run` , args will be expanded to `--config=.tflint.hcl --module` .
2022-07-05 19:07:01 +03:00
### All hooks: Set env vars inside hook at runtime
2024-01-17 01:14:36 +01:00
> All, except deprecated hooks: `checkov`, `tofu_docs_replace`
2022-07-05 19:07:01 +03:00
You can specify environment variables that will be passed to the hook at runtime.
Config example:
```yaml
2024-01-17 01:10:38 +01:00
- id: tofu_validate
2022-07-05 19:07:01 +03:00
args:
2022-07-06 15:41:28 +03:00
- --env-vars=AWS_DEFAULT_REGION="us-west-2"
- --env-vars=AWS_ACCESS_KEY_ID="anaccesskey"
- --env-vars=AWS_SECRET_ACCESS_KEY="asecretkey"
2022-07-05 19:07:01 +03:00
```
2022-07-06 15:34:13 +03:00
### All hooks: Disable color output
2024-01-17 01:14:36 +01:00
> All, except deprecated hooks: `checkov`, `tofu_docs_replace`
2022-07-06 15:34:13 +03:00
To disable color output for all hooks, set `PRE_COMMIT_COLOR=never` var. Eg:
```bash
PRE_COMMIT_COLOR=never pre-commit run
```
2024-01-17 01:14:36 +01:00
### checkov (deprecated) and tofu_checkov
2022-04-15 18:26:33 +01:00
2024-01-17 01:14:36 +01:00
> `checkov` hook is deprecated, please use `tofu_checkov`.
2022-04-15 18:26:33 +01:00
2024-01-17 01:14:36 +01:00
Note that `tofu_checkov` runs recursively during `-d .` usage. That means, for example, if you change `.tf` file in repo root, all existing `.tf` files in the repo will be checked.
2022-04-15 18:26:33 +01:00
1. You can specify custom arguments. E.g.:
```yaml
2024-01-17 01:14:36 +01:00
- id: tofu_checkov
2022-04-15 18:26:33 +01:00
args:
- --args=--quiet
- --args=--skip-check CKV2_AWS_8
```
Check all available arguments [here ](https://www.checkov.io/2.Basics/CLI%20Command%20Reference.html ).
2021-09-29 14:36:55 +03:00
2022-04-15 18:26:33 +01:00
For deprecated hook you need to specify each argument separately:
2021-09-29 14:36:55 +03:00
```yaml
- id: checkov
args: [
"-d", ".",
"--skip-check", "CKV2_AWS_8",
]
```
2021-09-09 12:38:43 +03:00
2024-01-21 21:19:16 +01:00
2. When you have multiple directories and want to run `tofu_checkov` in all of them and share a single config file - use the `__GIT_WORKING_DIR__` placeholder. It will be replaced by `tofu_checkov` hooks with the Git working directory (repo root) at run time. For example:
2022-06-28 02:57:09 +10:00
```yaml
2024-01-21 21:19:16 +01:00
- id: tofu_checkov
2022-06-28 02:57:09 +10:00
args:
- --args=--config-file __GIT_WORKING_DIR __ /.checkov.yml
```
2021-10-26 14:12:01 +03:00
### infracost_breakdown
2024-01-21 21:19:16 +01:00
`infracost_breakdown` executes `infracost breakdown` command and compare the estimated costs with those specified in the hook-config. `infracost breakdown` parses OpenTofu HCL code, and calls Infracost Cloud Pricing API (remote version or [self-hosted version ](https://www.infracost.io/docs/cloud_pricing_api/self_hosted )).
2021-10-26 14:12:01 +03:00
2021-10-26 14:39:23 +02:00
Unlike most other hooks, this hook triggers once if there are any changed files in the repository.
2021-10-26 14:12:01 +03:00
2022-06-09 13:05:35 -07:00
1. `infracost_breakdown` supports all `infracost breakdown` arguments (run `infracost breakdown --help` to see them). The following example only shows costs:
2021-10-26 14:12:01 +03:00
```yaml
- id: infracost_breakdown
args:
- --args=--path=./env/dev
verbose: true # Always show costs
```
<!-- markdownlint-disable-next-line no-inline-html -->
<details><summary>Output</summary>
```bash
Running in "env/dev"
Summary: {
"unsupportedResourceCounts": {
"aws_sns_topic_subscription": 1
}
}
Total Monthly Cost: 86.83 USD
Total Monthly Cost (diff): 86.83 USD
```
<!-- markdownlint-disable-next-line no-inline-html -->
</details>
2022-05-27 11:00:37 +02:00
2. Note that spaces are not allowed in `--args` , so you need to split it, like this:
2022-04-16 15:51:12 +03:00
```yaml
- id: infracost_breakdown
args:
- --args=--path=./env/dev
2022-05-27 11:00:37 +02:00
- --args=--terraform-var-file="terraform.tfvars"
- --args=--terraform-var-file="../terraform.tfvars"
2022-04-16 15:51:12 +03:00
```
2023-05-27 23:59:45 +03:00
3. (Optionally) Define `cost constraints` the hook should evaluate successfully in order to pass:
2021-10-26 14:12:01 +03:00
```yaml
- id: infracost_breakdown
args:
- --args=--path=./env/dev
2021-10-27 14:45:25 +03:00
- --hook-config='.totalHourlyCost|tonumber > 0.1'
- --hook-config='.totalHourlyCost|tonumber > 1'
- --hook-config='.projects[].diff.totalMonthlyCost|tonumber != 10000'
- --hook-config='.currency == "USD"'
2021-10-26 14:12:01 +03:00
```
<!-- markdownlint-disable-next-line no-inline-html -->
<details><summary>Output</summary>
```bash
Running in "env/dev"
Passed: .totalHourlyCost|tonumber > 0.1 0.11894520547945205 > 0.1
Failed: .totalHourlyCost|tonumber > 1 0.11894520547945205 > 1
Passed: .projects[].diff.totalMonthlyCost|tonumber !=10000 86.83 != 10000
Passed: .currency == "USD" "USD" == "USD"
Summary: {
"unsupportedResourceCounts": {
2021-10-26 14:39:23 +02:00
"aws_sns_topic_subscription": 1
2021-10-26 14:12:01 +03:00
}
}
Total Monthly Cost: 86.83 USD
Total Monthly Cost (diff): 86.83 USD
```
<!-- markdownlint-disable-next-line no-inline-html -->
</details>
2021-10-26 14:39:23 +02:00
* Only one path per one hook (`- id: infracost_breakdown` ) is allowed.
* Set `verbose: true` to see cost even when the checks are passed.
* Hook uses `jq` to process the cost estimation report returned by `infracost breakdown` command
* Expressions defined as `--hook-config` argument should be in a jq-compatible format (e.g. `.totalHourlyCost` , `.totalMonthlyCost` )
To study json output produced by `infracost` , run the command `infracost breakdown -p PATH_TO_TF_DIR --format json` , and explore it on [jqplay.org ](https://jqplay.org/ ).
2021-10-26 14:12:01 +03:00
* Supported comparison operators: `<` , `<=` , `==` , `!=` , `>=` , `>` .
* Most useful paths and checks:
2021-10-26 14:39:23 +02:00
* `.totalHourlyCost` (same as `.projects[].breakdown.totalHourlyCost` ) - show total hourly infra cost
* `.totalMonthlyCost` (same as `.projects[].breakdown.totalMonthlyCost` ) - show total monthly infra cost
* `.projects[].diff.totalHourlyCost` - show the difference in hourly cost for the existing infra and tf plan
* `.projects[].diff.totalMonthlyCost` - show the difference in monthly cost for the existing infra and tf plan
* `.diffTotalHourlyCost` (for Infracost version 0.9.12 or newer) or `[.projects[].diff.totalMonthlyCost | select (.!=null) | tonumber] | add` (for Infracost older than 0.9.12)
2021-10-26 14:12:01 +03:00
2022-04-16 15:51:12 +03:00
4. **Docker usage ** . In `docker build` or `docker run` command:
2021-10-26 14:39:23 +02:00
* You need to provide [Infracost API key ](https://www.infracost.io/docs/integrations/environment_variables/#infracost_api_key ) via `-e INFRACOST_API_KEY=<your token>` . By default, it is saved in `~/.config/infracost/credentials.yml`
* Set `-e INFRACOST_SKIP_UPDATE_CHECK=true` to [skip the Infracost update check ](https://www.infracost.io/docs/integrations/environment_variables/#infracost_skip_update_check ) if you use this hook as part of your CI/CD pipeline.
2021-10-26 14:12:01 +03:00
2024-01-21 21:19:16 +01:00
### tofu_docs
2018-12-11 20:21:49 +01:00
2024-01-21 21:19:16 +01:00
1. `tofu_docs` and `tofu_docs_without_aggregate_type_defaults` will insert/update documentation generated by [terraform-docs ](https://github.com/terraform-docs/terraform-docs ) framed by markers:
2019-10-17 14:50:16 +03:00
2021-09-09 12:38:43 +03:00
```txt
2024-01-17 00:44:43 +01:00
<!-- BEGINNING OF PRE-COMMIT-OPENTOFU DOCS HOOK -->
2021-09-09 12:38:43 +03:00
2024-01-17 00:44:43 +01:00
<!-- END OF PRE-COMMIT-OPENTOFU DOCS HOOK -->
2021-09-09 12:38:43 +03:00
```
if they are present in `README.md` .
2018-12-11 20:21:49 +01:00
2024-01-17 01:10:38 +01:00
2. It is possible to pass additional arguments to shell scripts when using `tofu_docs` and `tofu_docs_without_aggregate_type_defaults` .
2021-09-09 12:38:43 +03:00
2021-10-15 15:26:23 +03:00
3. It is possible to automatically:
2021-12-08 21:03:04 +02:00
* create a documentation file
2021-10-26 14:39:23 +02:00
* extend existing documentation file by appending markers to the end of the file (see item 1 above)
* use different filename for the documentation (default is `README.md` )
2023-12-21 20:00:20 +00:00
* use the same insertion markers as `terraform-docs` by default. It will be default in `v2.0` .
To migrate to `terraform-docs` insertion markers, run in repo root:
```bash
2024-01-17 00:44:43 +01:00
grep -rl 'BEGINNING OF PRE-COMMIT-OPENTOFU DOCS HOOK' . | xargs sed -i 's/BEGINNING OF PRE-COMMIT-OPENTOFU DOCS HOOK/BEGIN_TF_DOCS/g'
grep -rl 'END OF PRE-COMMIT-OPENTOFU DOCS HOOK' . | xargs sed -i 's/END OF PRE-COMMIT-OPENTOFU DOCS HOOK/END_TF_DOCS/g'
2023-12-21 20:00:20 +00:00
```
2018-12-13 22:16:01 -05:00
2021-10-15 15:26:23 +03:00
```yaml
2024-01-17 01:10:38 +01:00
- id: tofu_docs
2021-10-15 15:26:23 +03:00
args:
- --hook-config=--path-to-file=README.md # Valid UNIX path. I.e. ../TFDOC.md or docs/README.md etc.
2021-11-17 19:16:38 +01:00
- --hook-config=--add-to-existing-file=true # Boolean. true or false
2021-10-15 15:26:23 +03:00
- --hook-config=--create-file-if-not-exist=true # Boolean. true or false
2023-12-21 20:00:20 +00:00
- --hook-config=--use-standard-markers=true # Boolean. Defaults in v1.x to false. Set to true for compatibility with terraform-docs
2021-10-15 15:26:23 +03:00
```
2024-01-17 01:10:38 +01:00
4. You can provide [any configuration available in `tofu-docs` ](https://terraform-docs.io/user-guide/configuration/ ) as an argument to `tofu_doc` hook, for example:
2021-10-15 15:26:23 +03:00
```yaml
2024-01-17 01:10:38 +01:00
- id: tofu_docs
2021-10-15 15:26:23 +03:00
args:
- --args=--config=.terraform-docs.yml
2022-05-18 19:00:39 +03:00
```
2021-10-15 15:26:23 +03:00
2022-11-26 20:38:21 +02:00
> **Warning**: Avoid use `recursive.enabled: true` in config file, that can cause unexpected behavior.
2022-05-11 19:31:47 +03:00
2021-10-26 14:12:01 +03:00
5. If you need some exotic settings, it can be done too. I.e. this one generates HCL files:
2021-10-15 15:26:23 +03:00
```yaml
2024-01-17 01:10:38 +01:00
- id: tofu_docs
2021-10-26 14:39:23 +02:00
args:
2021-10-15 15:26:23 +03:00
- tfvars hcl --output-file terraform.tfvars.model .
```
2021-09-29 14:36:55 +03:00
2024-01-17 01:02:15 +01:00
### tofu_docs_replace (deprecated)
2021-11-08 22:28:02 +02:00
2024-01-17 01:02:15 +01:00
**DEPRECATED**. Will be merged in [`tofu_docs` ](#tofu_docs ).
2018-12-13 22:16:01 -05:00
2024-01-17 01:02:15 +01:00
`tofu_docs_replace` replaces the entire `README.md` rather than doing string replacement between markers. Put your additional documentation at the top of your `main.tf` for it to be pulled in.
2021-09-29 14:36:55 +03:00
2024-01-17 01:02:15 +01:00
To replicate functionality in `tofu_docs` hook:
2021-09-29 14:36:55 +03:00
2022-11-26 20:35:58 +02:00
1. Create `.terraform-docs.yml` in the repo root with the following content:
```yaml
formatter: "markdown"
output:
file: "README.md"
mode: replace
template: |-
{{/** End of file fixer */}}
```
2024-01-17 01:02:15 +01:00
2. Replace `tofu_docs_replace` hook config in `.pre-commit-config.yaml` with:
2022-11-26 20:35:58 +02:00
```yaml
2024-01-17 01:02:15 +01:00
- id: tofu_docs
2022-11-26 20:35:58 +02:00
args:
- --args=--config=.terraform-docs.yml
```
2018-12-11 20:21:49 +01:00
2024-01-17 01:02:15 +01:00
### terraftofu_fmtorm_fmt
2021-10-14 16:25:45 +03:00
2024-01-17 01:02:15 +01:00
1. `tofu_fmt` supports custom arguments so you can pass [supported flags ](https://www.terraform.io/docs/cli/commands/fmt.html#usage ). Eg:
2021-10-14 16:25:45 +03:00
```yaml
2024-01-17 01:02:15 +01:00
- id: tofu_fmt
2021-10-14 16:25:45 +03:00
args:
- --args=-no-color
- --args=-diff
- --args=-write=false
```
2024-01-17 01:02:15 +01:00
### tofu_providers_lock
2021-10-14 16:25:45 +03:00
2024-01-17 01:02:15 +01:00
> **Note**: The hook requires OpenTofu 1.6.0 or later.
2023-05-30 19:02:16 +03:00
2024-01-17 01:02:15 +01:00
> **Note**: The hook can invoke `tofu providers lock` that can be really slow and requires fetching metadata from remote OpenTofu registries - not all of that metadata is currently being cached by OpenTofu.
2023-05-30 19:02:16 +03:00
> <details><summary><b>Note</b>: Read this if you used this hook before v1.80.0 | Planned breaking changes in v2.0</summary>
> We introduced '--mode' flag for this hook. If you'd like to continue using this hook as before, please:
>
> * Specify `--hook-config=--mode=always-regenerate-lockfile` in `args:`
2024-01-17 01:02:15 +01:00
> * Before `tofu_providers_lock`, add `tofu_validate` hook with `--hook-config=--retry-once-with-cleanup=true`
> * Move `--tf-init-args=` to `tofu_validate` hook
2023-05-30 19:02:16 +03:00
>
> In the end, you should get config like this:
>
> ```yaml
2024-01-17 01:02:15 +01:00
> - id: tofu_validate
2023-05-30 19:02:16 +03:00
> args:
> - --hook-config=--retry-once-with-cleanup=true
> # - --tf-init-args=-upgrade
>
2024-01-17 01:02:15 +01:00
> - id: tofu_providers_lock
2023-05-30 19:02:16 +03:00
> args:
> - --hook-config=--mode=always-regenerate-lockfile
> ```
>
> Why? When v2.x will be introduced - the default mode will be changed, probably, to `only-check-is-current-lockfile-cross-platform`.
>
> You can check available modes for hook below.
> </details>
2024-01-17 01:02:15 +01:00
1. The hook can work in a few different modes: `only-check-is-current-lockfile-cross-platform` with and without [tofu_validate hook ](#tofu_validate ) and `always-regenerate-lockfile` - only with tofu_validate hook.
2023-05-30 19:02:16 +03:00
2024-01-17 01:02:15 +01:00
* `only-check-is-current-lockfile-cross-platform` without tofu_validate - only checks that lockfile has all required SHAs for all providers already added to lockfile.
2023-05-30 19:02:16 +03:00
```yaml
2024-01-17 01:02:15 +01:00
- id: tofu_providers_lock
2023-05-30 19:02:16 +03:00
args:
- --hook-config=--mode=only-check-is-current-lockfile-cross-platform
```
2024-01-17 01:02:15 +01:00
* `only-check-is-current-lockfile-cross-platform` with [tofu_validate hook ](#tofu_validate ) - make up-to-date lockfile by adding/removing providers and only then check that lockfile has all required SHAs.
2023-05-30 19:02:16 +03:00
2024-01-17 01:02:15 +01:00
> **Note**: Next `tofu_validate` flag requires additional dependency to be installed: `jq`. Also, it could run another slow and time consuming command - `tofu init`
2023-05-30 19:02:16 +03:00
```yaml
2024-01-17 01:02:15 +01:00
- id: tofu_validate
2023-05-30 19:02:16 +03:00
args:
- --hook-config=--retry-once-with-cleanup=true
2024-01-17 01:02:15 +01:00
- id: tofu_providers_lock
2023-05-30 19:02:16 +03:00
args:
- --hook-config=--mode=only-check-is-current-lockfile-cross-platform
```
2024-01-17 01:02:15 +01:00
* `always-regenerate-lockfile` only with [tofu_validate hook ](#tofu_validate ) - regenerate lockfile from scratch. Can be useful for upgrading providers in lockfile to latest versions
2023-05-30 19:02:16 +03:00
```yaml
2024-01-17 01:02:15 +01:00
- id: tofu_validate
2023-05-30 19:02:16 +03:00
args:
- --hook-config=--retry-once-with-cleanup=true
- --tf-init-args=-upgrade
2024-01-17 01:02:15 +01:00
- id: tofu_providers_lock
2023-05-30 19:02:16 +03:00
args:
- --hook-config=--mode=always-regenerate-lockfile
```
2021-10-14 16:25:45 +03:00
2024-01-17 01:02:15 +01:00
3. `tofu_providers_lock` supports custom arguments:
2021-10-14 16:25:45 +03:00
```yaml
2024-01-17 01:02:15 +01:00
- id: tofu_providers_lock
2021-10-14 16:25:45 +03:00
args:
2021-10-27 14:45:25 +03:00
- --args=-platform=windows_amd64
- --args=-platform=darwin_amd64
2021-10-14 16:25:45 +03:00
```
2024-01-17 01:02:15 +01:00
4. It may happen that OpenTofu working directory (`.terraform` ) already exists but not in the best condition (eg, not initialized modules, wrong version of OpenTofu, etc.). To solve this problem, you can find and delete all `.terraform` directories in your repository:
2021-10-14 16:25:45 +03:00
```bash
echo "
2024-01-17 01:02:15 +01:00
function rm_tofu {
2022-02-22 12:30:53 -05:00
find . \( -iname ".terraform*" ! -iname ".terraform-docs*" \) -print0 | xargs -0 rm -r
2021-10-14 16:25:45 +03:00
}
" >>~/.bashrc
2024-01-17 01:02:15 +01:00
# Reload shell and use `rm_tofu` command in the repo root
2021-10-14 16:25:45 +03:00
```
2024-01-17 01:02:15 +01:00
`tofu_providers_lock` hook will try to reinitialize directories before running the `tofu providers lock` command.
2021-10-14 16:25:45 +03:00
2024-01-17 01:02:15 +01:00
5. `tofu_providers_lock` support passing custom arguments to its `tofu init` :
2022-07-05 15:25:30 +03:00
2024-01-17 01:02:15 +01:00
> **Warning** - DEPRECATION NOTICE: This is available only in `no-mode` mode, which will be removed in v2.0. Please provide this keys to [`tofu_validate`](#tofu_validate) hook, which, to take effect, should be called before `tofu_providers_lock`
2023-05-30 19:02:16 +03:00
2022-07-05 15:25:30 +03:00
```yaml
2024-01-17 01:02:15 +01:00
- id: tofu_providers_lock
2022-07-05 15:25:30 +03:00
args:
2022-07-05 15:49:10 +03:00
- --tf-init-args=-upgrade
2022-07-05 15:25:30 +03:00
```
2024-01-17 00:52:58 +01:00
### tofu_tflint
2019-11-16 18:37:23 +00:00
2024-01-17 00:52:58 +01:00
1. `tofu_tflint` supports custom arguments so you can enable module inspection, enable / disable rules, etc.
2019-11-16 18:37:23 +00:00
2021-09-09 12:38:43 +03:00
Example:
2019-11-16 18:37:23 +00:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_tflint
2021-09-29 14:36:55 +03:00
args:
2022-09-01 09:59:39 +03:00
- --args=--module
2021-09-29 14:36:55 +03:00
- --args=--enable-rule=terraform_documented_variables
2019-11-16 18:37:23 +00:00
```
2024-01-17 00:52:58 +01:00
2. When you have multiple directories and want to run `tflint` in all of them and share a single config file, it is impractical to hard-code the path to the `.tflint.hcl` file. The solution is to use the `__GIT_WORKING_DIR__` placeholder which will be replaced by `tofu_tflint` hooks with the Git working directory (repo root) at run time. For example:
2020-09-22 14:20:27 +02:00
2021-09-09 12:38:43 +03:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_tflint
2021-09-29 14:36:55 +03:00
args:
- --args=--config=__GIT_WORKING_DIR__/.tflint.hcl
2021-09-09 12:38:43 +03:00
```
2020-09-22 14:20:27 +02:00
2024-01-21 21:19:16 +01:00
3. By default, pre-commit-opentofu performs directory switching into the OpenTofu modules for you. If you want to delgate the directory changing to the binary - this will allow tflint to determine the full paths for error/warning messages, rather than just module relative paths. * Note: this requires `tflint>=0.44.0`. * For example:
2023-05-08 11:32:06 -04:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_tflint
2023-05-08 11:32:06 -04:00
args:
- --hook-config=--delegate-chdir
```
2020-09-22 14:20:27 +02:00
2024-01-17 00:52:58 +01:00
### tofu_tfsec (deprecated)
2023-12-15 15:54:13 +01:00
2024-01-17 00:52:58 +01:00
**DEPRECATED**. [tfsec was replaced by trivy ](https://github.com/aquasecurity/tfsec/discussions/1994 ), so please use [`tofu_trivy` ](#tofu_trivy ).
2020-04-23 09:56:33 -05:00
2024-01-17 00:52:58 +01:00
1. `tofu_tfsec` will consume modified files that pre-commit
2020-09-01 01:07:08 -07:00
passes to it, so you can perform whitelisting of directories
or files to run against via [files ](https://pre-commit.com/#config-files )
pre-commit flag
2021-09-09 12:38:43 +03:00
Example:
2020-09-01 01:07:08 -07:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_tfsec
2021-09-29 14:36:55 +03:00
files: ^prd-infra/
2020-09-01 01:07:08 -07:00
```
The above will tell pre-commit to pass down files from the `prd-infra/` folder
only such that the underlying `tfsec` tool can run against changed files in this
directory, ignoring any other folders at the root level
2021-09-09 12:38:43 +03:00
2. To ignore specific warnings, follow the convention from the
2021-10-26 14:39:23 +02:00
[documentation ](https://github.com/aquasecurity/tfsec#ignoring-warnings ).
2021-09-09 12:38:43 +03:00
Example:
2020-04-23 09:56:33 -05:00
```hcl
resource "aws_security_group_rule" "my-rule" {
type = "ingress"
cidr_blocks = ["0.0.0.0/0"] #tfsec:ignore:AWS006
}
```
2024-01-17 00:52:58 +01:00
3. `tofu_tfsec` supports custom arguments, so you can pass supported `--no-color` or `--format` (output), `-e` (exclude checks) flags:
2021-10-01 21:52:35 +03:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_tfsec
2021-10-01 21:52:35 +03:00
args:
- >
--args=--format json
--no-color
-e aws-s3-enable-bucket-logging,aws-s3-specify-public-access-block
```
2024-01-17 00:52:58 +01:00
4. When you have multiple directories and want to run `tfsec` in all of them and share a single config file - use the `__GIT_WORKING_DIR__` placeholder. It will be replaced by `tofu_tfsec` hooks with Git working directory (repo root) at run time. For example:
2021-10-26 15:35:55 +03:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_tfsec
2021-10-26 15:35:55 +03:00
args:
- --args=--config-file=__GIT_WORKING_DIR__/.tfsec.json
```
Otherwise, will be used files that located in sub-folders:
2021-10-21 15:13:34 +01:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_tfsec
2021-10-26 15:35:55 +03:00
args:
- --args=--config-file=.tfsec.json
2021-10-21 15:13:34 +01:00
```
2021-10-01 21:52:35 +03:00
2024-01-17 00:52:58 +01:00
### tofu_trivy
2023-12-15 15:54:13 +01:00
2024-01-17 00:52:58 +01:00
1. `tofu_trivy` will consume modified files that pre-commit
2023-12-15 15:54:13 +01:00
passes to it, so you can perform whitelisting of directories
or files to run against via [files ](https://pre-commit.com/#config-files )
pre-commit flag
Example:
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_trivy
2023-12-15 15:54:13 +01:00
files: ^prd-infra/
```
The above will tell pre-commit to pass down files from the `prd-infra/` folder
only such that the underlying `trivy` tool can run against changed files in this
directory, ignoring any other folders at the root level
2. To ignore specific warnings, follow the convention from the
[documentation ](https://aquasecurity.github.io/trivy/latest/docs/configuration/filtering/ ).
Example:
```hcl
#trivy:ignore:AVD -AWS-0107
#trivy:ignore:AVD -AWS-0124
resource "aws_security_group_rule" "my-rule" {
type = "ingress"
cidr_blocks = ["0.0.0.0/0"]
}
```
2024-01-17 00:52:58 +01:00
3. `tofu_trivy` supports custom arguments, so you can pass supported `--format` (output), `--skip-dirs` (exclude directories) and other flags:
2023-12-15 15:54:13 +01:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_trivy
2023-12-15 15:54:13 +01:00
args:
- >
--args=--format json
--skip-dirs="**/.terragrunt-cache"
```
2024-01-17 00:52:58 +01:00
### tofu_validate
2020-08-27 10:57:45 +01:00
2024-01-17 00:52:58 +01:00
1. `tofu_validate` supports custom arguments so you can pass supported `-no-color` or `-json` flags:
2021-09-09 12:38:43 +03:00
2020-08-27 10:57:45 +01:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_validate
2020-08-27 10:57:45 +01:00
args:
2021-09-29 14:36:55 +03:00
- --args=-json
- --args=-no-color
2020-08-27 10:57:45 +01:00
```
2024-01-17 00:52:58 +01:00
2. `tofu_validate` also supports passing custom arguments to its `tofu init` :
2021-12-11 05:33:22 -08:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_validate
2021-12-11 05:33:22 -08:00
args:
2023-05-27 23:59:45 +03:00
- --tf-init-args=-upgrade
2022-07-05 15:49:10 +03:00
- --tf-init-args=-lockfile=readonly
2021-12-11 05:33:22 -08:00
```
2024-01-17 00:52:58 +01:00
3. It may happen that OpenTofu working directory (`.terraform` ) already exists but not in the best condition (eg, not initialized modules, wrong version of OpenTofu, etc.). To solve this problem, you can delete broken `.terraform` directories in your repository:
2022-11-26 20:38:21 +02:00
**Option 1 **
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_validate
2022-11-26 20:38:21 +02:00
args:
- --hook-config=--retry-once-with-cleanup=true # Boolean. true or false
```
2023-04-28 12:53:31 -04:00
> **Note**: The flag requires additional dependency to be installed: `jq`.
2022-11-26 20:38:21 +02:00
2024-01-17 00:52:58 +01:00
> **Note**: Reinit can be very slow and require downloading data from remote OpenTofu registries, and not all of that downloaded data or meta-data is currently being cached by OpenTofu.
2023-05-27 23:59:45 +03:00
2024-01-17 00:52:58 +01:00
When `--retry-once-with-cleanup=true` , in each failed directory the cached modules and providers from the `.terraform` directory will be deleted, before retrying once more. To avoid unnecessary deletion of this directory, the cleanup and retry will only happen if OpenTofu produces any of the following error messages:
2022-11-26 20:38:21 +02:00
* "Missing or corrupted provider plugins"
* "Module source has changed"
* "Module version requirements have changed"
* "Module not installed"
* "Could not load plugin"
2023-04-28 12:53:31 -04:00
**Warning ** : When using `--retry-once-with-cleanup=true` , problematic `.terraform/modules/` and `.terraform/providers/` directories will be recursively deleted without prompting for consent. Other files and directories will not be affected, such as the `.terraform/environment` file.
2022-11-26 20:38:21 +02:00
**Option 2 **
An alternative solution is to find and delete all `.terraform` directories in your repository:
2021-09-09 12:38:43 +03:00
2021-09-29 14:36:55 +03:00
```bash
echo "
2024-01-17 00:52:58 +01:00
function rm_tofu {
2022-02-22 12:30:53 -05:00
find . \( -iname ".terraform*" ! -iname ".terraform-docs*" \) -print0 | xargs -0 rm -r
2021-09-29 14:36:55 +03:00
}
" >>~/.bashrc
2020-11-02 21:44:54 +01:00
2024-01-17 00:52:58 +01:00
# Reload shell and use `rm_tofu` command in the repo root
2020-11-02 21:44:54 +01:00
```
2024-01-17 00:52:58 +01:00
`tofu_validate` hook will try to reinitialize them before running the `tofu validate` command.
2020-11-02 21:44:54 +01:00
2024-01-17 01:02:15 +01:00
**Warning ** : If you use OpenTofu workspaces, DO NOT use this option ([details ](https://github.com/tofuutils/pre-commit-opentofu/issues/203#issuecomment-918791847 )). Consider the first option, or wait for [`force-init` ](https://github.com/tofuutils/pre-commit-opentofu/issues/224 ) option implementation.
2021-09-29 14:36:55 +03:00
2024-01-21 21:19:16 +01:00
4. `tofu_validate` in a repo with OpenTofu module, written using OpenTofu 1.6.0+ and which uses provider `configuration_aliases` ([Provider Aliases Within Modules ](https://www.terraform.io/language/modules/develop/providers#provider-aliases-within-modules )), errors out.
2022-02-03 14:23:59 -06:00
2024-01-17 00:52:58 +01:00
When running the hook against OpenTofu code where you have provider `configuration_aliases` defined in a `required_providers` configuration block, OpenTofu will throw an error like:
2022-11-26 20:38:21 +02:00
2022-02-03 14:23:59 -06:00
> Error: Provider configuration not present
2022-11-26 20:38:21 +02:00
> To work with `<resource>` its original provider configuration at provider `["registry.terraform.io/hashicorp/aws"].<provider_alias>` is required, but it has been removed. This occurs when a provider configuration is removed while
> objects created by that provider still exist in the state. Re-add the provider configuration to destroy `<resource>`, after which you can remove the provider configuration again.
2022-02-03 14:23:59 -06:00
2024-01-17 00:52:58 +01:00
This is a [known issue ](https://github.com/hashicorp/terraform/issues/28490 ) with OpenTofu and how providers are initialized in OpenTofu 1.6.0 and later. To work around this you can add an `exclude` parameter to the configuration of `tofu_validate` hook like this:
2022-11-26 20:38:21 +02:00
2022-02-03 14:23:59 -06:00
```yaml
2024-01-17 00:52:58 +01:00
- id: tofu_validate
2022-08-02 21:46:23 +03:00
exclude: '^[^/]+$'
2022-02-03 14:23:59 -06:00
```
2022-11-26 20:38:21 +02:00
2022-02-03 14:23:59 -06:00
This will exclude the root directory from being processed by this hook. Then add a subdirectory like "examples" or "tests" and put an example implementation in place that defines the providers with the proper aliases, and this will give you validation of your module through the example. If instead you are using this with multiple modules in one repository you'll want to set the path prefix in the regular expression, such as `exclude: modules/offendingmodule/[^/]+$` .
Alternately, you can use [terraform-config-inspect ](https://github.com/hashicorp/terraform-config-inspect ) and use a variant of [this script ](https://github.com/bendrucker/terraform-configuration-aliases-action/blob/main/providers.sh ) to generate a providers file at runtime:
```bash
terraform-config-inspect --json . | jq -r '
[.required_providers[].aliases]
| flatten
| del(.[] | select(. == null))
| reduce .[] as $entry (
{};
.provider[$entry.name] //= [] | .provider[$entry.name] += [{"alias": $entry.alias}]
)
' | tee aliased-providers.tf.json
```
Save it as `.generate-providers.sh` in the root of your repository and add a `pre-commit` hook to run it before all other hooks, like so:
2022-11-26 20:38:21 +02:00
2022-02-03 14:23:59 -06:00
```yaml
- repos:
- repo: local
hooks:
2024-01-17 01:02:15 +01:00
- id: generate-tofu-providers
name: generate-tofu-providers
2022-02-03 14:23:59 -06:00
require_serial: true
entry: .generate-providers.sh
language: script
files: \.tf(vars)?$
pass_filenames: false
- repo: https://github.com/pre-commit/pre-commit-hooks
[...]
```
2022-11-26 20:38:21 +02:00
> Note: The latter method will leave an "aliased-providers.tf.json" file in your repo. You will either want to automate a way to clean this up or add it to your `.gitignore` or both.
2022-02-03 14:23:59 -06:00
2024-01-17 01:02:15 +01:00
### tofu_wrapper_module_for_each
2022-05-02 19:59:08 +02:00
2024-01-17 01:02:15 +01:00
`tofu_wrapper_module_for_each` generates module wrappers for OpenTofu modules (useful for Terragrunt where `for_each` is not supported). When using this hook without arguments it will create wrappers for the root module and all modules available in "modules" directory.
2022-05-02 19:59:08 +02:00
You may want to customize some of the options:
1. `--module-dir=...` - Specify a single directory to process. Values: "." (means just root module), "modules/iam-user" (a single module), or empty (means include all submodules found in "modules/*").
2. `--module-repo-org=...` - Module repository organization (e.g. "terraform-aws-modules").
3. `--module-repo-shortname=...` - Short name of the repository (e.g. "s3-bucket").
4. `--module-repo-provider=...` - Name of the repository provider (e.g. "aws" or "google").
Sample configuration:
```yaml
2024-01-17 01:02:15 +01:00
- id: tofu_wrapper_module_for_each
2022-05-02 19:59:08 +02:00
args:
- --args=--module-dir=. # Process only root module
- --args=--dry-run # No files will be created/updated
- --args=--verbose # Verbose output
```
2022-09-07 07:19:52 -05:00
**If you use hook inside Docker:**
2024-01-17 01:02:15 +01:00
The `tofu_wrapper_module_for_each` hook attempts to determine the module's short name to be inserted into the generated `README.md` files for the `source` URLs. Since the container uses a bind mount at a static location, it can cause this short name to be incorrect.
2022-09-07 07:19:52 -05:00
If the generated name is incorrect, set them by providing the `module-repo-shortname` option to the hook:
```yaml
2024-01-17 01:02:15 +01:00
- id: tofu_wrapper_module_for_each
2022-09-07 07:19:52 -05:00
args:
- '--args=--module-repo-shortname=ec2-instance'
```
2021-12-22 19:44:53 +01:00
### terrascan
1. `terrascan` supports custom arguments so you can pass supported flags like `--non-recursive` and `--policy-type` to disable recursive inspection and set the policy type respectively:
```yaml
- id: terrascan
args:
2024-01-17 00:52:58 +01:00
- --args=--non-recursive # avoids scan errors on subdirectories without OpenTofu config files
2021-12-22 19:44:53 +01:00
- --args=--policy-type=azure
```
See the `terrascan run -h` command line help for available options.
2022-11-26 20:38:21 +02:00
2. Use the `--args=--verbose` parameter to see the rule ID in the scanning output. Useful to skip validations.
2021-12-22 19:44:53 +01:00
3. Use `--skip-rules="ruleID1,ruleID2"` parameter to skip one or more rules globally while scanning (e.g.: `--args=--skip-rules="ruleID1,ruleID2"` ).
4. Use the syntax `#ts:skip=RuleID optional_comment` inside a resource to skip the rule for that resource.
2021-09-09 12:38:43 +03:00
2022-04-13 10:25:04 -07:00
### tfupdate
2024-01-17 00:52:58 +01:00
1. Out of the box `tfupdate` will pin the OpenTofu version:
2022-04-13 10:25:04 -07:00
```yaml
- id: tfupdate
2024-01-17 00:52:58 +01:00
name: Autoupdate OpenTofu versions
2022-04-13 10:25:04 -07:00
```
2. If you'd like to pin providers, etc., use custom arguments, i.e `provider=PROVIDER_NAME` :
```yaml
- id: tfupdate
name: Autoupdate AWS provider versions
args:
- --args=provider aws # Will be pined to latest version
- id: tfupdate
name: Autoupdate Helm provider versions
args:
- --args=provider helm
- --args=--version 2.5.0 # Will be pined to specified version
```
Check [`tfupdate` usage instructions ](https://github.com/minamijoyo/tfupdate#usage ) for other available options and usage examples.
No need to pass `--recursive .` as it is added automatically.
2023-05-08 14:44:55 +01:00
## Docker Usage
### File Permissions
2022-09-07 07:19:52 -05:00
A mismatch between the Docker container's user and the local repository file ownership can cause permission issues in the repository where `pre-commit` is run. The container runs as the `root` user by default, and uses a `tools/entrypoint.sh` script to assume a user ID and group ID if specified by the environment variable `USERID` .
The [recommended command ](#4-run ) to run the Docker container is:
```bash
TAG=latest
2024-06-14 18:49:55 +03:00
docker run -e "USERID=$(id -u):$(id -g)" -v $(pwd):/lint -w /lint tofuutils/pre-commit-opentofu:$TAG run -a
2022-09-07 07:19:52 -05:00
```
which uses your current session's user ID and group ID to set the variable in the run command. Without this setting, you may find files and directories owned by `root` in your local repository.
If the local repository is using a different user or group for permissions, you can modify the `USERID` to the user ID and group ID needed. **Do not use the username or groupname in the environment variable, as it has no meaning in the container. ** You can get the current directory's owner user ID and group ID from the 3rd (user) and 4th (group) columns in `ls` output:
```bash
$ ls -aldn .
drwxr-xr-x 9 1000 1000 4096 Sep 1 16:23 .
```
2024-01-17 00:52:58 +01:00
### Download OpenTofu modules from private GitHub repositories
2023-05-08 14:44:55 +01:00
2024-01-17 00:52:58 +01:00
If you use a private Git repository as your OpenTofu module source, you are required to authenticate to GitHub using a [Personal Access Token ](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/creating-a-personal-access-token ).
2023-05-08 14:44:55 +01:00
When running pre-commit on Docker, both locally or on CI, you need to configure the [~/.netrc ](https://www.gnu.org/software/inetutils/manual/html_node/The-_002enetrc-file.html ) file, which contains login and initialization information used by the auto-login process.
This can be achieved by firstly creating the `~/.netrc` file including your `GITHUB_PAT` and `GITHUB_SERVER_HOSTNAME`
```bash
# set GH values (replace with your own values)
GITHUB_PAT=ghp_bl481aBlabl481aBla
GITHUB_SERVER_HOSTNAME=github.com
# create .netrc file
echo -e "machine $GITHUB_SERVER_HOSTNAME\n\tlogin $GITHUB_PAT" >> ~/.netrc
```
The `~/.netrc` file will look similar to the following:
```
machine github.com
login ghp_bl481aBlabl481aBla
```
> **Note**: The value of `GITHUB_SERVER_HOSTNAME` can also refer to a GitHub Enterprise server (i.e. `github.my-enterprise.com`).
Finally, you can execute `docker run` with an additional volume mount so that the `~/.netrc` is accessible within the container
```bash
2024-01-17 00:44:43 +01:00
# run pre-commit-opentofu with docker
2023-05-08 14:44:55 +01:00
# adding volume for .netrc file
# .netrc needs to be in /root/ dir
2024-06-14 18:49:55 +03:00
docker run --rm -e "USERID=$(id -u):$(id -g)" -v ~/.netrc:/root/.netrc -v $(pwd):/lint -w /lint tofuutils/pre-commit-opentofu:latest run -a
2023-05-08 14:44:55 +01:00
```
2018-12-11 20:21:49 +01:00
## Authors
2024-01-17 00:29:39 +01:00
This repository is managed by [Alexander Sharov ](https://github.com/kvendingoldo ), [Nikolay Mishin ](https://github.com/Nmishin ), and [Anastasiia Kozlova ](https://github.com/anastasiiakozlova245 ) with help from these awesome contributors:
2021-10-01 19:53:53 +03:00
2021-10-15 15:08:26 +03:00
<!-- markdownlint-disable no-inline-html -->
2024-01-17 00:18:19 +01:00
<a href="https://github.com/tofuutils/pre-commit-opentofu/graphs/contributors">
<img src="https://contrib.rocks/image?repo=tofuutils/pre-commit-opentofu" />
2021-10-01 19:53:53 +03:00
</a>
2023-10-23 16:33:43 +03:00
2024-01-17 00:18:19 +01:00
<a href="https://star-history.com/#tofuutils/pre -commit-opentofu&Date">
2023-10-23 16:33:43 +03:00
<picture>
2024-01-17 00:18:19 +01:00
<source media="(prefers-color-scheme: dark)" srcset="https://api.star-history.com/svg?repos=tofuutils/pre-commit-opentofu&type=Date&theme=dark" />
<source media="(prefers-color-scheme: light)" srcset="https://api.star-history.com/svg?repos=tofuutils/pre-commit-opentofu&type=Date" />
<img alt="Star History Chart" src="https://api.star-history.com/svg?repos=tofuutils/pre-commit-opentofu&type=Date" />
2023-10-23 16:33:43 +03:00
</picture>
</a>
2021-10-15 15:08:26 +03:00
<!-- markdownlint-enable no-inline-html -->
2018-12-11 20:21:49 +01:00
## License
2021-10-15 15:08:26 +03:00
MIT licensed. See [LICENSE ](LICENSE ) for full details.