84 Commits (f72944530d01bda68eee6b3fdd0d98e02e5aa8aa)

Author	SHA1	Message	Date
Liam Cervante	dec0edfd5a	terraform test: enable deferrals in Terraform Test with the specified flag (#37370)	9 months ago
Liam Cervante	84c2e2f9e5	terraform test: override prevent_destroy meta attribute (#37364)	9 months ago
Liam Cervante	160b6b35b0	terraform test: include expected diagnostics in verbose mode (#37362)	9 months ago
Liam Cervante	0a7701f19a	terraform test: refactor graph edge calculation (#37357) ... * terraform test: refactor graph edge calculation * remove unused attribute	9 months ago
Daniel Schmidt	66001080e6	actions: implement expansion and planning actions ... This implementation is very barebones, but builds the skelleton for all upcoming features in actions. It includes the graph implementation for planning actions including the expansion of actions and dealing with multiple action triggers. We plan all actions as part of their triggering resource for now. All action_triggers depend on the triggering resources plan to determine if an action should run or not, therefore we can plan the actions as part of the triggering resource. This implementation ignores conditions, deferrals, provider arguments and it does not add the actions to the planfile; mostly to enable more people to work on these issues in parallel.	9 months ago
Liam Cervante	2a1b4c3ed4	Update go-cty and HCL for 1.13 release (#37298)	10 months ago
Samsondeen	a1332299a5	Test run Parallelism of 1 should not result in deadlock (#37292)	10 months ago
Samsondeen	f57642d1a6	tf test: parallelize teardown operations (#37220)	10 months ago
Liam Cervante	b4a3e56a19	terraform test: deprecate ambigious variable references in test files (#37218) ... * terraform test: deprecate ambigious variable references in test files * fix panic caused by merge	11 months ago
Liam Cervante	777a916435	terraform test: move providers into the graph (#37216) ... * terraform test: move providers into the graph * consistency checks * remove flaky cycle test * address comments * Update internal/moduletest/graph/node_test_run.go Co-authored-by: Samsondeen <40821565+dsa0x@users.noreply.github.com> * go fmt --------- Co-authored-by: Samsondeen <40821565+dsa0x@users.noreply.github.com>	11 months ago
Liam Cervante	53afa2cd2f	terraform test: move variable evaluation into the terraform test graph (#37205) ... * terraform test: move variable evaluation into the terraform test graph * make copyrightfix	11 months ago
Liam Cervante	063b7cf62b	terraform test: check specific dependencies before skipping run blocks (#37204) ... * terraform test: check specific dependencies before skipping run blocks * fix data race * complete comment	11 months ago
Liam Cervante	757efaed9a	terraform test: automatically create edges based on references (#37200) ... * terraform test: automatically create edges based on references * address comments * remove unused function	11 months ago
Samsondeen	2a79f5fa53	Use iterators for graph vertices (#36558) ... * Use iterators for graph vertices * use func filter * use type param instead of function filter One type parameter seem to be enough instead of 2	11 months ago
Liam Cervante	f80762d3d5	terraform test: add variable definitions to test files (#37195) ... * terraform test: add variable definitions to test files Currently, `terraform test` attempts to work out the type of any external variables by delaying evaluation until each run block executes so it can use the definitions within the run blocks's module. This means that the values of variables can technically change between run blocks which isn't ideal. This commit is the first in a chain which will move the evaluation of variables into the terraform test graph. We need to give the users the option of specifying the type for external variables within the file as these variables are now going to be assessed outside of the context of a run block. To do this, we introduce the optional variable blocks that are added by this commit. * update comment	11 months ago
Liam Cervante	71af8f8858	terraform test: push context initialisation into the graph (#37194) ... * terraform test: refactor the context initialisation into specific node in the graph * Update internal/moduletest/graph/transform_providers.go Co-authored-by: Samsondeen <40821565+dsa0x@users.noreply.github.com> --------- Co-authored-by: Samsondeen <40821565+dsa0x@users.noreply.github.com>	11 months ago
Liam Cervante	19540e30fe	terraform test: don't allow diags from executable nodes (#37193)	11 months ago
Liam Cervante	8135fefa62	terraform test: stop transforming the config under test with new variables (#37152)	11 months ago
Samsondeen	c0a7ff235b	Apply some new go collection features (#36818)	1 year ago
Daniel Banck	10c9b64007	Rename schema.Block to Body (#36629)	1 year ago
Samsondeen	3f4ed7e019	Ensure that all states are cleaned up (#36616)	1 year ago
Samsondeen	1bd312f155	Produce detailed diagnostic objects when test run assertions fail (#36522)	1 year ago
Samsondeen	018110c012	No state to cleaup when it is empty (#36526)	1 year ago
James Bardin	e1485f27fc	use go tool to run generate commands	1 year ago
Samsondeen	a3a42979e2	Ensure that the file teardown summary is displayed before the run's teardown summary (#36483)	1 year ago
James Bardin	17f4dcfd8d	Merge pull request #36465 from hashicorp/jbardin/sensitive-order ... Serialize `AttrSensitivePaths` in a consistent order	1 year ago
Samsondeen	2e91113224	Terraform test: Consolidate test execution procedure (#36459)	1 year ago
James Bardin	cbd7435dfc	udpate tests to match core tfdiags ... The local format function for diagnostics didn't match the global formatting for the tfdiags package.	1 year ago
James Bardin	483c179156	use existing path formatter	1 year ago
Samsondeen	4161e88391	Continue test execution after an expected failure (#36447)	1 year ago
Samsondeen	2f0f537e69	Terraform test: Execute eligible test runs in parallel (#36300)	1 year ago
Sarah French	21cafd70ea	Add more details to JUnit `terraform test` output to describe why a test was skipped (#36315) ... * Add ability for TestJUnitXMLFile to access data about whether the test runner was Stopped * Add details to XML describing why a Run was skipped * Fix wording * Code consistency changes * Move all JUnit-related code down to where it's used Away from the Views section of the code where it was relevant before * Move JUnit-related error and warning diags to above where cancellable contexts are created * Fix wording of user feedback * Fix test to match updated skipped message text * Fix test	1 year ago
Sarah French	43f31c43b0	Add start time timestamps to `<testcase>`/Run data in JUnit XML output from `terraform test` (#36295) ... * Record metadata about the start timestamp for a Run/test case * Add RFC3339 format timestamp attributes to `<testcase>` elements in JUnit XML output * Ensure timestamps are saved as and rendered as UTC timestamps	1 year ago
Samsondeen	aec7c3cc89	terraform test: allow computed/mocked values override during planning (#36227)	1 year ago
Liam Cervante	eeacced8f0	Add go vet as a check to the Github commit actions (#31461) ... * Add go vet as a check to the Github commit actions * deliberately break to test * fix after successful test * Use directly * fix more errors	1 year ago
Radek Simko	79a35f3968	lang: Add Extra to avoid duplicate diagnostic in check blocks (#35944)	1 year ago
Daniel Schmidt	b701e152e5	show value is ephemeral in terraform test	2 years ago
Daniel Schmidt	3e7fdd0de9	improve wording of error message	2 years ago
Daniel Schmidt	ae103fc491	test: emit a nice error message if the user uses ephemeral resource in terrafom test	2 years ago
James Bardin	257678fafb	final changes changes	2 years ago
Aviral Jain	c19118f9e0	skip check evaluation when context is not prepared successfully (#35408)	2 years ago
Liam Cervante	48fc2d3ac7	terraform test: Disallow version constraints within test files (#35161)	2 years ago
Liam Cervante	14418bd198	terraform test: move override evaluation into expander (#35030) ... * terraform test: move override evaluation into expander * clarify comment	2 years ago
Liam Cervante	448775102c	terraform test: Push evaluation of variables to as late as possible (#35014) ... * terraform test: Push evaluation of variables to as late as possible * Update internal/moduletest/hcl/variable_cache.go Co-authored-by: kmoe <5575356+kmoe@users.noreply.github.com> * address comments --------- Co-authored-by: kmoe <5575356+kmoe@users.noreply.github.com>	2 years ago
Martin Atkins	397ea6d05c	moduletest: Capture optional "execution meta" for test runs ... For now this is only to have a place to save the execution duration, but wrapped in a separate struct so that we can distinguish between cases when it is set and when it isn't, because not all test runners will necessarily populate this and even those that do might not populate it in situations where, for example, a test run gets skipped due to an upstream failure. As of this commit, nothing makes use of this new information. A future commit will use it as part of the experimental JUnit XML output from "terraform test", since the JUnit XML format de-facto _requires_ an execution duration for every test case.	2 years ago
Liam Cervante	c6ff573180	Include provider functions in scope used to evaluate test assertions (#34825)	2 years ago
Martin Atkins	88cb4aeea3	backendrun: Separate the types/etc for backends that support operations ... We previously had all of the types and helpers for all kinds of backends together in package backend. That kept things relatively simple, but it also meant that the majority of backends that only deal with remote state storage ended up still indirectly depending on the entire Terraform modules runtime, configuration loader, etc, etc, which brings into scope a bunch of external dependencies that the remote state backends don't really need. Since backends that support operations are a rare exception, we'll move the types and helpers for those into a separate package "backendrun", and then the main package backend can have a much more modest set of types and, more importantly, a modest set of dependencies on other packages in this codebase. This is part of an ongoing effort to reduce the exposure of Terraform Core and CLI code to the remote backends and vice-versa, so that in the long run we can more often treat them as separate for dependency maintenance purposes.	2 years ago
Martin Atkins	545980d664	langrefs: Separate package for expression reference analysis ... Finding references in an expression is a static analysis operation, but we previously had it grouped in with "package lang" that primarily deals with dynamic evaluation of expressions. We need to do static analysis in far more locations than we do full expression evaluation, the static-analysis-only callers don't need anything else from package lang, and the reference-analysis functions are self-contained little wrappers around the address parsing logic in package addrs anyway. Splitting these into a separate package therefore minimizes which packages depend indirectly on package lang, and thus which packages depend indirectly on the implementations of the built-in functions. Some of the built-in functions rely on dependencies we don't use anywhere else, so cutting these out shrinks how many packages indirectly depend on those external dependencies. In particular, they are no longer in the indirect import chain for the "legacy" module.	2 years ago
Daniel Schmidt	4f23efc14e	remove unused config	2 years ago
Daniel Schmidt	df3ee21d82	extract global and suite-level variables before configuring providers	2 years ago