70 Commits (76eb65c911fcf1fcff030bef4e19807cab227aae)

Author	SHA1	Message	Date
James Bardin	76eb65c911	Fix crash in consul backend ... A TLS config was being assigned to a Transport in a nil http.Client. The Transport is built in the consul config by default, but the http.Client is not built until later in NewClient.	9 years ago
Loïc Albertin	21b287e919	backend/consul: allow specifying various Consul client security options ... These new options are equivalent to the consul CLI arguments -ca-file, -client-cert and -client-key.	9 years ago
Peter McAtominey	6b9b5ec297	backend/azure: update to latest SDK	9 years ago
Peter McAtominey	f9e8e54835	backend: convert Azure remote state to a backend ... Added locking support via blob leasing (requires that an empty state is created before any lock can be acquired. Added support for "environments" in much the same way as the S3 backend.	9 years ago
James Bardin	2bb5007690	Merge pull request #15683 from hashicorp/jbardin/remote-state-lineage ... Remove strict lineage check in remote.State	9 years ago
James Bardin	4c7cd549cd	don't allow leading slashes in s3 remote state key ... S3 accepts objects with a leading slash and strips them off. This works fine except in our workspace hierarchy, which then can no longer find suffixes matching the full key name.	9 years ago
James Bardin	c3e943bed2	add another failing test for remote.State lineage ... Want to make sure we don't hit this again.	9 years ago
James Bardin	18d71f273e	make inmem behave more like remote backends ... When remote backend imeplemtations create a new named state, they may need to acquire a lock and/or save an actual empty state to the backend. Copy this behavior in the inmem backend for testing.	9 years ago
James Bardin	5deef9621d	export Reset() ... This package is used for testing, so there needs to be an easy method for reinitializing the stored data between tests.	9 years ago
James Bardin	ac60ddcd40	Support named states in inmeme backend ... Used to expand test coverage	9 years ago
James Bardin	1070d04b07	Remove consul context adapter for RenewPeriodic ... Updated the vendored consul which no longer requires the channel adapter to convert a `chan stuct{}` to a `<-chan struct{}`. Call testutil.NewTestServerConfigT with the new signature.	9 years ago
James Bardin	bcb11f6d89	have the consul client manage the lock session ... When a consul lock is lost, there is a possibility that the associated session is still active. Most commonly, the long request to watch the lock key may error out, while the session is continually refreshed at a rate of TTL/2. First have the lock monitor retry the lock internally for at least 10 seconds (5 attempts with the default 2 second wait time). In most cases this will reconnect on the first try, keeping the lock channel open. If the consul lock can't recover itself, then cancel the session as soon as possible (terminating the PreiodicRenew will call Session.Destroy), and start over. In the worse case, the consul agents were split, and the session still exists on the leader so we may need to wait for the old session TTL, plus the LockWait time to renew the lock. We use a Context for the cancellation channels here, because that removes the need to worry about double-closes and nil channels. It requires an awkward adapter goroutine for now to convert the Done() `<-chan` to a `chan` for PeriodicRenew, but makes the rest of the code safer in the long run.	9 years ago
James Bardin	5066fa2151	Merge pull request #13871 from fatmcgav/swift_move_to_backend ... Move Swift remote state to backend	9 years ago
James Bardin	42cbb716b7	Merge pull request #15370 from rowleyaj/s3_backend_workspaces ... Add configurable workspace prefix for S3 Backend	9 years ago
Alex Rowley	2dd464cf8f	Clarify field description	9 years ago
James Bardin	1fa7667ad4	s3 backend should use Client.Delete to DeleteState ... The s3.Backend was using it's own code for DeleteState, but the dynamo entries are only handled through the RemoteClient. Have DeleteState use a RemoteClient for delete.	9 years ago
Alex Rowley	db40dc06ab	Add configurable workspace prefix for S3 Backend ... Fixes #13184	9 years ago
Gavin Williams	c2550e78cf	Rename openstack provider for swift remote backend	9 years ago
Gavin Williams	ee2e390f85	remote/swift: Migrate Swift remote state to a backend ... Move the Swift State from a legacy remote state to an official backend. Add `container` and `archive_container` configuration variables, and deprecate `path` and `archive_path` variables. Future improvements: Add support for locking and environments.	9 years ago
James Bardin	ac959af6b4	rename aws provider import in s3 backend	9 years ago
James Bardin	6b700ff1fb	replace lock_table with dynamodb_table in s3 cfg ... Since the DynamoDB table used by the S3 backend is no longer only used for locks, rename it in the config to remove any confusion about it being lock-specific.	9 years ago
James Bardin	ecc5bfb801	Merge pull request #14937 from hashicorp/jbardin/GH-14927 ... check for nil state in s3 client Get	9 years ago
James Bardin	82eba5801d	Test losing and reacquiring a consul lock	9 years ago
James Bardin	3df48bfc27	relock consul when lock is lost ... Consul locks are based on liveness, and may be lost due timeouts, network issued, etc. If the client determines the lock was lost, attempt to reacquire the lock immediately. The client was also not using the `lock` config option. Disable locks if that is not set.	9 years ago
James Bardin	e8330b6f53	use CAS for consul state Put	9 years ago
James Bardin	e7502454b4	check for nil state in s3 client Get ... The S3 client can return (nil, nil) when the remote state doesn't exist. The caused a nil pointer dereference when checking the payload.MD5 against the expected value. This can happen if the remote state was manually removed, but the digest entry was left in the DynamoDB table.	9 years ago
James Bardin	ef1d53934c	Merge pull request #14746 from hashicorp/jbardin/s3-consistency ... store and verify s3 remote state checksum to avoid consistency issues.	9 years ago
James Bardin	91be40a577	add detailed error message s3 checksum mismatch ... Have the s3 RemoteClient return a detailed error message to the user in the case of a mismatch state checksum.	9 years ago
James Bardin	0022d224e8	store and verify s3 remote state checksum ... Updates to objects in S3 are only eventually consistent. If the RemoteClient has a DynamoDB table available, use that to store a checksum of the last written state, so the object can be verified by the next client to call Get. Terraform currently doesn't have any sort of user feedback around RefreshState/Get, so we poll only for a short time before returning an error.	9 years ago
James Bardin	b279b1abb5	check for named s3 states before acquiring a lock ... In order to force-unlock a named state, we have to fetch that state first. Don't attempt to acquire a lock if we know the state already exists in s3.	9 years ago
James Bardin	a2d452acec	failing test to force-unlock a named state in s3 ... The State call attempts to get a lock before determining if a named state exists. This prevents force-unlock, since we need the state to call Unlock.	9 years ago
James Bardin	9c431aee1b	only list environments when the keyName matches ... Prevent extra keys in the s3 envPrefix path from showing up as listed environments. Better handle keys containing slashes Add tests for unexpected keys in s3.	9 years ago
James Bardin	5621d97925	cleanup consul lock entries ... This matches the consul cli behavior, where locks are cleaned up after use. Return an error from re-locking the state. This isn't required by the Locker interface, but it's an added sanity check for state operations. What was incorrect here was returning an empty ID and error, which would indicate that Lock/Unlock isn't supported.	9 years ago
James Bardin	6e136c848a	use the aws provider client initialization ... Use the aws provider code to create the clients for the s3 backend, so that all the behavior matches that of the provider. Remove the fake creds from the test, as the aws provider will attempt to validate them.	9 years ago
James Bardin	54aa466b74	initialize the s3 lock path in one place	9 years ago
James Bardin	d059939f88	Merge pull request #13262 from hashicorp/jbardin/lock-timeouts ... lock timeouts	9 years ago
James Bardin	75458a182d	remove extra state.Locker assertions ... All states are lockers, so get rid of extra asertions.	9 years ago
Paul Stack	4501be7e5c	backend/remote-state: Add support for assume role extensions to s3 backend (#13236) ... Fixes: #13234 This now matches the AWS provider for the Assume Role support	9 years ago
James Bardin	575e7f1811	Properly create a new named state in s3 ... If the state doesn't exist, we need to initialize one so that it can be listed be States.	9 years ago
James Bardin	fa4dc01cf4	add named state support to the s3 backend ... This adds named state (environment) support to the S3 backend. A state NAME will prepend the configured s3 key with `env:/NAME/`. The default state will remain rooted in the bucket for backwards compatibility. Locks in DynamoDB use the S3 key as the as the primary key value, so locking will work as expected for multiple states.	9 years ago
James Bardin	4980fa20e7	move s3 config from client to backend ... The RemoteClient needs to be configured for the named state, so move the general config to the backend. Rename some fields for consistency.	9 years ago
James Bardin	9f5cf2b105	convert S3 remote state to a backend ... Move the S3 State from a legacy remote state to an official backend. This increases test coverage, uses a set schema for configuration, and will allow new backend features to be implemented for the S3 state, e.g. "environments".	9 years ago
Mitchell Hashimoto	0cd15176ff	backend/consul: rebase and modify gzip test	9 years ago
Mitchell Hashimoto	1daff7a826	backend/consul: support "lock" option to disable locking ... This adds a "lock" config (default true) to allow users to optionally disable state locking with Consul. This is necessary if the token given doesn't have session permission and is necessary for backwards compatibility.	9 years ago
James Bardin	08d2b44ada	add gzip to consul backend tests	9 years ago
James Bardin	1527eae6b7	Merge pull request #8748 from christoe/christoe/8491-gzip-consul-remote-state ... state/remote: Add gzip support to consul remote state (#8491)	9 years ago
James Bardin	86f711f6fc	Make consul backend tests opt-in ... This way we don't require contributers to have consul installed to run make test.	9 years ago
James Bardin	fa7743b627	quiet the consul server during backend tests ... Don't display logs unless using `-v`	9 years ago
James Bardin	90055c6ae2	convert the consul backend to use consul/testutil ... Start up our own consul server for unit tests.	9 years ago
Christoffer Kylvåg	abfa35db7c	backend/remote-state/consul: Make gzip compression configurable (#8491)	9 years ago