68 Commits (dec0edfd5afff7169f94424aae0590dddfddee8a)

Author	SHA1	Message	Date
Liam Cervante	dec0edfd5a	terraform test: enable deferrals in Terraform Test with the specified flag (#37370)	7 months ago
Liam Cervante	84c2e2f9e5	terraform test: override prevent_destroy meta attribute (#37364)	7 months ago
Liam Cervante	0a7701f19a	terraform test: refactor graph edge calculation (#37357) ... * terraform test: refactor graph edge calculation * remove unused attribute	7 months ago
Samsondeen	a1332299a5	Test run Parallelism of 1 should not result in deadlock (#37292)	8 months ago
Liam Cervante	777a916435	terraform test: move providers into the graph (#37216) ... * terraform test: move providers into the graph * consistency checks * remove flaky cycle test * address comments * Update internal/moduletest/graph/node_test_run.go Co-authored-by: Samsondeen <40821565+dsa0x@users.noreply.github.com> * go fmt --------- Co-authored-by: Samsondeen <40821565+dsa0x@users.noreply.github.com>	9 months ago
Liam Cervante	53afa2cd2f	terraform test: move variable evaluation into the terraform test graph (#37205) ... * terraform test: move variable evaluation into the terraform test graph * make copyrightfix	9 months ago
Liam Cervante	063b7cf62b	terraform test: check specific dependencies before skipping run blocks (#37204) ... * terraform test: check specific dependencies before skipping run blocks * fix data race * complete comment	9 months ago
Liam Cervante	757efaed9a	terraform test: automatically create edges based on references (#37200) ... * terraform test: automatically create edges based on references * address comments * remove unused function	9 months ago
Liam Cervante	f80762d3d5	terraform test: add variable definitions to test files (#37195) ... * terraform test: add variable definitions to test files Currently, `terraform test` attempts to work out the type of any external variables by delaying evaluation until each run block executes so it can use the definitions within the run blocks's module. This means that the values of variables can technically change between run blocks which isn't ideal. This commit is the first in a chain which will move the evaluation of variables into the terraform test graph. We need to give the users the option of specifying the type for external variables within the file as these variables are now going to be assessed outside of the context of a run block. To do this, we introduce the optional variable blocks that are added by this commit. * update comment	9 months ago
Liam Cervante	7fadbe34de	write-only attributes: internal providers should set write-only attributes to null (#36824) ... * write-only attributes: internal providers should set write-only attributes to null * add changelog * fix copywrite headers	11 months ago
Liam Cervante	aaf617d6d7	Add test case to ensure no regression of already fixed crash (#36583)	12 months ago
Samsondeen	3f4ed7e019	Ensure that all states are cleaned up (#36616)	12 months ago
Samsondeen	1bd312f155	Produce detailed diagnostic objects when test run assertions fail (#36522)	12 months ago
Samsondeen	018110c012	No state to cleaup when it is empty (#36526)	1 year ago
Samsondeen	2e91113224	Terraform test: Consolidate test execution procedure (#36459)	1 year ago
Samsondeen	4161e88391	Continue test execution after an expected failure (#36447)	1 year ago
Samsondeen	7f29df96a0	Allow terraform init when only test files are present in directory (#36429)	1 year ago
Samsondeen	2f0f537e69	Terraform test: Execute eligible test runs in parallel (#36300)	1 year ago
Sarah French	6b81f7184c	Change JUnit `terraform test` output to include test failure details inside `<failure>` elements, use the error message as the `message` attribute (#36316) ... * Add details to `<failure>` element describing which assertion failed * Remove unused diagnostic string * Set `message` attribute of `<failure>` element to failed assertion's error message * Make `<failure>` contain diagnostic's message, refactor how `message` attribute is set * Ensure that system-err is only added when needed * Update test fixtures * Make diags usage clearer, ensure all test failure diags in "failure" element * Refactor how "skipped" element value is set * Fix failing test Test_TestJUnitXMLFile_Save	1 year ago
Kévin Andrieux	258f91ab0c	feat: add state_key for test run blocks (#36185) ... * feat: add state_alias for test run blocks * fix: move `state_alias` to run block + rename to `state_key` * docs: add state_key changelog entry * docs: add state_key in run block documentation * Revert "docs: add state_key in run block documentation" This reverts commit ccccf62a76. * Revert "docs: add state_key changelog entry" This reverts commit 86e2ad8dc3.	1 year ago
Liam Cervante	408f323efa	test: also allow mock_data and mock_resource blocks to generate data during planning (#36317)	1 year ago
Sarah French	ab6e4f2299	Refactor JUnit XML output of `terraform test` into a new `junit` package (#36304) ... * Refactor JUnit XML output to use new concept of an Artifact * Move JUnit-related code into new `artifact` package * Refactor Artifact's Save method to return diagnostics, update comments Previously TestJUnitXMLFile implemented the View interface, which cannot return errors. Now it's not a View any more we can simplify things. * Make junitXMLTestReport output deterministic by iterating over a slice instead of a map, add test * Provide sources to junitXMLTestReport, allowing complete error messages in the XML We need to ensure that artifact.NewTestJUnitXMLFile is called once the config Loader is available as a non-nil pointer * Whitespace * Add some test coverage for JUnit XML output for `terraform test` * Refactor how file is saved, add tests * Move XML structs definitions outside of `junitXMLTestReport` * Fix nil pointer bug * Add missing file headers * Refactor comparison of byte slices * Rename package to `junit`, rename structs to match * Add a test showing JUnit output when a test is skipped by the user	1 year ago
Samsondeen	aec7c3cc89	terraform test: allow computed/mocked values override during planning (#36227)	1 year ago
Daniel Schmidt	725add6a1a	test: pass in variables during apply ... ephemeral variables need to be re-supplied	1 year ago
MicahKimel	3258744166	Remove invalid warning during cleanup phase (#35172) ... * stop invalid warning during cleanup phase * stop invalid warning during cleanup phase * invalid warning during cleanup phase * remove unwanted comment * update GetVariables parameter for including warnings * invalid warning during cleanup phase test case * update invalid warnings in cleanup test case to throw a warning for the validation variable before cleanup phase * remove unwanted warnings	2 years ago
Liam Cervante	448775102c	terraform test: Push evaluation of variables to as late as possible (#35014) ... * terraform test: Push evaluation of variables to as late as possible * Update internal/moduletest/hcl/variable_cache.go Co-authored-by: kmoe <5575356+kmoe@users.noreply.github.com> * address comments --------- Co-authored-by: kmoe <5575356+kmoe@users.noreply.github.com>	2 years ago
Liam Cervante	6963c54bec	terraform test: don't remove sensitive marks from inputs (#35021)	2 years ago
Liam Cervante	c6ff573180	Include provider functions in scope used to evaluate test assertions (#34825)	2 years ago
Daniel Schmidt	0529299cc3	run terraform fmt on test	2 years ago
Daniel Schmidt	7ae7a203d8	test: allow using global variables in suite-level variable definitions ... Closes #34534	2 years ago
Liam Cervante	9658f9df6b	mocking overrides: default to concrete empty object when values are missing (#34563)	2 years ago
Liam Cervante	430970c02b	terraform test: Fix crash when file level variables reference variables. (#34531) ... * terraform test: Fix crash when referencing variables within the file level variable block * also allow functions within variables blocks * add tests	2 years ago
Liam Cervante	7e18b1183d	Add test verifying issue #34476 has been fixed (#34478)	2 years ago
Liam Cervante	5cbf7c5f96	Add docs for automatic var files in test directories (#34349)	2 years ago
Kubo	c98e355ca1	terraform test: Collect variables from default var file within testing directory (#34341) ... * Add logic to collect variables for terrafrom test * Add tests for test variable collection * Update the test variable collection implementation * Update internal/backend/local/test.go Co-authored-by: Liam Cervante <liam.cervante@hashicorp.com> * Update internal/backend/local/test.go Co-authored-by: Liam Cervante <liam.cervante@hashicorp.com> * Move test variables into var file * resolve diff from cross-branch switch * go fmt --------- Co-authored-by: Liam Cervante <liam.cervante@hashicorp.com>	2 years ago
Liam Cervante	9ea1aa0a86	terraform test: skip destroy step for empty run blocks (#34331)	2 years ago
Liam Cervante	6670ab43f7	terraform test: rearrange the order of destroy operations (#34293)	2 years ago
Liam Cervante	dedb296773	terraform test: connect mock behaviour to test framework (#34205) ... * connect mock behaviour to test framework * fix calling unconfigured providers	2 years ago
Liam Cervante	57edb9c248	testing framework: add warnings for override blocks with invalid targets (#34181) ... * testing framework: add warnings for override blocks with invalid targets * pre-add the override sources for upcoming features * address comments	2 years ago
Liam Cervante	b9f6b23ba3	testing framework: add support for functions in variables and providers (#34204)	2 years ago
Liam Cervante	ad77877136	terraform test: remove marks before passing variables as inputs to a plan (#34190) ... * remove marks before passing variables as inputs to a plan * fix doc comments	2 years ago
Liam Cervante	f90d71f723	testing framework: allow providers to reference run blocks (#34118) ... * testing framework: allow providers to reference run block * missing copywrite header	2 years ago
Liam Cervante	5bbdc4c3b6	terraform test: allow providers in test files to reference variables (#34069) ... * Process only relevant variables in the testing framework * add support for variables within test provider configurations * remove unused function * fix consistency checks	2 years ago
Liam Cervante	01c0480e77	Test framework will produce regular updates in -json mode (#33953) ... * Test framework will produce regular updates in -json mode * add tests * docs * docs tweaking	2 years ago
Liam Cervante	fba5dad097	Test files should be marked as skipped if all their run blocks were skipped (#33950)	2 years ago
Liam Cervante	f8d4664bcd	Add additional validation around unknown and null values in test variables (#33861) ... * Add additional validation around unknown values in test variables * address comments	2 years ago
Liam Cervante	1c7dfa22b7	Add warning when testing and combining expect_failures with apply operations	2 years ago
Liam Cervante	84e2ebc225	apply defaults when processing variables for assertions	2 years ago
Liam Cervante	041b54fb4b	explicitely disallow duplicate run block names in test files (#33836)	2 years ago
Liam Cervante	a560730376	Make the test command fail if resources could not be cleaned up (#33809) ... * Make the test command fail if resources could not be cleaned up * remove redundant return statement	2 years ago