terraform

History

Martin Atkins e70ab09bf1 command: new cache directory .terraform/providers for providers Terraform v0.10 introduced .terraform/plugins as a cache directory for automatically-installed plugins, Terraform v0.13 later reorganized the directory structure inside but retained its purpose as a cache. The local cache used to also serve as a record of specifically which packages were selected in a particular working directory, with the intent that a second run of "terraform init" would always select the same packages again. That meant that in some sense it behaved a bit like a local filesystem mirror directory, even though that wasn't its intended purpose. Due to some unfortunate miscommunications, somewhere a long the line we published some documentation that _recommended_ using the cache directory as if it were a filesystem mirror directory when working with Terraform Cloud. That was really only working as an accident of implementation details, and Terraform v0.14 is now going to break that because the source of record for the currently-selected provider versions is now the public-facing dependency lock file rather than the contents of an existing local cache directory on disk. After some consideration of how to move forward here, this commit implements a compromise that tries to avoid silently doing anything surprising while still giving useful guidance to folks who were previously using the unsupported strategy. Specifically: - The local cache directory will now be .terraform/providers rather than .terraform/plugins, because .terraform/plugins is effectively "poisoned" by the incorrect usage that we can't reliably distinguish from prior version correct usage. - The .terraform/plugins directory is now the "legacy cache directory". It is intentionally _not_ now a filesystem mirror directory, because that would risk incorrectly interpreting providers automatically installed by Terraform v0.13 as if they were a local mirror, and thus upgrades and checksum fetches from the origin registry would be blocked. - Because of the previous two points, someone who _was_ trying to use the legacy cache directory as a filesystem mirror would see installation fail for any providers they manually added to the legacy directory. To avoid leaving that user stumped as to what went wrong, there's a heuristic for the case where a non-official provider fails installation and yet we can see it in the legacy cache directory. If that heuristic matches then we'll produce a warning message hinting to move the provider under the terraform.d/plugins directory, which is a _correct_ location for "bundled" provider plugins that belong only to a single configuration (as opposed to being installed globally on a system). This does unfortunately mean that anyone who was following the incorrectly-documented pattern will now encounter an error (and the aforementioned warning hint) after upgrading to Terraform v0.14. This seems like the safest compromise because Terraform can't automatically infer the intent of files it finds in .terraform/plugins in order to decide automatically how best to handle them. The internals of the .terraform directory are always considered implementation detail for a particular Terraform version and so switching to a new directory for the _actual_ cache directory fits within our usual set of guarantees, though it's definitely non-ideal in isolation but okay when taken in the broader context of this problem, where the alternative would be silent misbehavior when upgrading.		5 years ago
..
013upgrade-existing-versions-tf	command: Change 0.13upgrade default to versions.tf	6 years ago
013upgrade-explicit-providers	command/013upgrade: detect builtin terraform provider (#25215 )	6 years ago
013upgrade-file-exists	command: Change 0.13upgrade default to versions.tf	6 years ago
013upgrade-implicit-not-found	command: Change 0.13upgrade default to versions.tf	6 years ago
013upgrade-implicit-providers	command/013upgrade: detect builtin terraform provider (#25215 )	6 years ago
013upgrade-multiple-blocks	command: Fix 0.13upgrade bug with multiple blocks	6 years ago
013upgrade-multiple-files	command: Change 0.13upgrade default to versions.tf	6 years ago
013upgrade-no-providers	command: Rework 0.13upgrade sub-command	6 years ago
013upgrade-preserves-comments	command: Fix 0.13upgrade to preserve more comments	6 years ago
013upgrade-provider-not-found	command: Change 0.13upgrade default to versions.tf	6 years ago
013upgrade-provider-redirect	command: Add redirect support to 0.13upgrade	6 years ago
013upgrade-provider-redirect-version-unavailable	command: Add redirect support to 0.13upgrade	6 years ago
013upgrade-providers-with-source	command: Change 0.13upgrade default to versions.tf	6 years ago
013upgrade-skipped-files	command: Change 0.13upgrade default to versions.tf	6 years ago
013upgrade-submodule	command: Change 0.13upgrade default to versions.tf	6 years ago
013upgrade-unsupported-version	command: Check required_version before upgrading	6 years ago
apply	…
apply-config-invalid	…
apply-destroy-targeted	…
apply-error	…
apply-input	…
apply-input-partial	…
apply-plan-no-module	…
apply-sensitive-output	…
apply-shutdown	…
apply-terraform-env	…
apply-vars	fix command tests	6 years ago
backend-change	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-change-multi-default-to-single	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-change-multi-to-multi	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-change-multi-to-no-default-with-default	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-change-multi-to-no-default-without-default	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-change-multi-to-single	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-change-single-to-single	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-changed-with-legacy	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-from-state	command: use backend config from state when backend=false is used. (#23802 )	6 years ago
backend-inmem-locked	…
backend-new	…
backend-new-interp	…
backend-new-legacy	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-new-migrate	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-new-migrate-existing	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-plan-backend-empty	…
backend-plan-backend-empty-config	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-plan-backend-match	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-plan-backend-mismatch	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-plan-legacy	…
backend-plan-legacy-data	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-plan-local	…
backend-plan-local-match	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-plan-local-mismatch-lineage	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-plan-local-newer	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-unchanged	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-unchanged-with-legacy	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-unset	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
backend-unset-with-legacy	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
empty	…
fmt	command/fmt: Restore some opinionated behaviors	5 years ago
get	…
graph	…
import-missing-resource-config	…
import-module-input-variable	terraform: Eval module call arguments for import	6 years ago
import-module-var-file	reproduction test	6 years ago
import-provider	…
import-provider-aliased	…
import-provider-datasource	command/import: attach references before validating provider (#22862 )	6 years ago
import-provider-implicit	…
import-provider-invalid	command: Fix stale lock when exiting early	6 years ago
import-provider-remote-state	…
import-provider-var	…
import-provider-var-default	…
import-provider-var-file	…
init	…
init-backend	…
init-backend-config-file	command: Fix backend config override validation	6 years ago
init-backend-config-file-change	…
init-backend-config-kv	…
init-backend-empty	…
init-check-required-version	terraform: Fix required version constraint diags	6 years ago
init-get	…
init-get-provider-detected-legacy	command/init: Improve diags for legacy providers	6 years ago
init-get-provider-invalid-package	command/init: Display provider validation errors	6 years ago
init-get-provider-legacy-from-state	command: Better in-house provider install errors	6 years ago
init-get-provider-source	command/init: Use full config for provider reqs	6 years ago
init-get-providers	vendor: go get github.com/apparentlymart/go-versions@v1.0.0	6 years ago
init-internal	…
init-internal-invalid	internal/providercache: Handle built-in providers	6 years ago
init-legacy-provider-cache	command: new cache directory .terraform/providers for providers	5 years ago
init-legacy-rc	…
init-provider-lock-file	…
init-providers-lock	…
init-required-providers	provider source tests: added test suite to exercise hyphenated providers (#24685 )	6 years ago
inmem-backend	…
login-oauth-server	command: Fix OAuth2 PKCE arguments	6 years ago
login-tfe-server	Add token validation for manual terraform login	6 years ago
modules	Support reading module outputs in terraform console (#24808 )	6 years ago
parallelism	…
plan	…
plan-emptydiff	…
plan-invalid	…
plan-out-backend	…
plan-out-backend-legacy	…
plan-vars	…
providers	command/providers: Show provider requirements tree	6 years ago
providers-schema	command: Providers schema shows required_providers	5 years ago
push	…
push-backend-new	…
push-input	…
push-input-partial	…
push-no-remote	…
push-no-upload	…
push-tfvars	…
refresh	…
refresh-empty	…
refresh-output	…
refresh-unset-var	…
refresh-var	…
show	…
show-json	update new outputs plan json	5 years ago
show-json-state	Mildwonkey/last tests (#24553 )	6 years ago
state-list-backend-custom	addrs: embed Provider in AbsProviderConfig instead of Type	6 years ago
state-list-backend-default	addrs: embed Provider in AbsProviderConfig instead of Type	6 years ago
state-pull-backend	…
state-push-bad-lineage	refactor tests to use modern states.State in favor of terraform.State where possible	5 years ago
state-push-good	…
state-push-replace-match	…
state-push-serial-newer	addrs: embed Provider in AbsProviderConfig instead of Type	6 years ago
state-push-serial-older	…
taint-check-required-version	command: Taint should respect required_version	5 years ago
validate-invalid	…
validate-valid	…
variables	Remove sensitive_variables experiment	5 years ago
empty-file	…
statelocker.go	state: remove deprecated state package (#25490 )	6 years ago