boundary

Commit Graph

Author	SHA1	Message	Date
Michael Li	26ebaefd70	test(migration): Use docker mirror (#3144 )	3 years ago
Michael Li	28b98348cc	test(e2e): Refactor WaitForSessionStatus methods (#3115 )	3 years ago
Michael Li	3dc1e2108a	chore(enos): Use docker mirror (#3086 )	3 years ago
Michael Li	acda0c3892	chore(enos): Add scenario that uses docker containers for infrastructure (#3073 ) Co-authored-by: Johan Brandhorst-Satzkorn <johan.brandhorst@gmail.com>	3 years ago
Michael Li	420952f6b8	chore(enos): Add scenario for e2e UI tests (#2813 )	3 years ago
Michael Li	54aad4d292	chore(enos): Add debug variable (#3037 )	3 years ago
Timothy Messier	5e0957eb24	ci(test): Use docker mirror (#3018 )	3 years ago
Michael Li	5ec75924df	refact(e2e): Set up variables to prepare for docker implementation (#2992 ) * refact(e2e): Explicitly define port used for targets To maintain consistency for how we define ports, this change explicitly defines the port used in the enos scenario as opposed to relying on a "default" value. This change is in support of work that attempts to spin up test infrastructure using docker. The openssh-server image uses Port 2222, which needs to be passed to the test suite. * refact(e2e): Add optional "Internal" Vault Address parameter This change enables scenarios that need two different Vault addresses, one used by the Vault CLI and one by the Boundary server instance. In the case when using a Docker container, the Boundary server needs the Vault address "internal" to the Docker network, whereas the Vault CLI running outside of the network needs a different address.	3 years ago
Michael Li	96918f0ab6	test(e2e/migration): Add additional resources to database before migrating (#2948 )	3 years ago
Michael Li	fcddd972bf	test(e2e): Add test for `boundary version` (#2933 ) During testing, there was an issue observed where some additional characters were added to the version output. This test validates that output.	3 years ago
Michael Li	8ad861f426	test(e2e): Update migration test to use vault docker container (#2909 ) * fix(enos): Make sure enos reports test as failure After updating this command to save off the output from running `go test`, enos would not report when tests failed. This was due to the extra pipe hiding the exit status of the prior commands. Adding this option should return the status of the last command to exit with a non-zero status. * doc(e2e): Fix comments * refact(e2e): Update AuthenticateCli to accept auth method id * refact(e2e/migration): Use docker to set up vault instead of enos * refact(e2e/migration): Adjust where environment variables are set	3 years ago
Johan Brandhorst-Satzkorn	3c29308673	chore: Add license headers to all files	3 years ago
Haotian	43f0ba89cf	feat(credentiallibraries): support vault ssh certificates	3 years ago
Michael Li	036a71fc93	test(e2e): Add test for updated `boundary authenticate` command (#2848 )	3 years ago
Michael Li	461b194cde	fix(e2e): Address flake due to timing (#2774 ) Observed a flake in this test where a session was still reporting 0 bytes up/down on the first read. Modifying the checks to be more resilient.	3 years ago
Damian Debkowski	b3ba9c5b4d	test(enos): new e2e test for target address (#2732 ) Co-authored-by: Hugo <hugoamvieira@users.noreply.github.com>	3 years ago
Michael Li	fdf3318f72	test(e2e): Add tests for bytes_up/bytes_down (#2740 ) * refact(e2e): Create env files for consistency * refact(e2e): Addmethod for waiting for session * test(e2e): Add bytes up/down test * fix(e2e): Fix require.Equal statements to have the correct order * fix(e2e): Fix loop variable	3 years ago
Michael Li	ff8f1be0a1	test(e2e): Add test for when an incorrect tag is used in a dynamic host catalog (#2731 ) * refact(e2e): Move Dynamic Host Catalog env to its own file This keeps each scenario consistent (an env_test.go file in each directory) * refact(e2e): Update to use type casting * refact(e2e): Rename existing dynamic host catalog test * test(e2e): Add test for an empty dynamic host catalog This test verifies that you fail to connect to a target with an empty host set (in a dynamic host catalog) * fix(e2e): Update return statement since we know err is nil * fix(e2e): Add ok checks in type assertions	3 years ago
Michael Li	8bd883a37d	test(e2e): Add tests to validate that session ends after target is deleted (#2709 ) * test(e2e): Add more "session end" tests These tests validate that the session ends when the respective project or target is deleted. It also ensures that the session can still be read after the deletion of the corresponding item. * Removing test from PR due to bug This test found a bug that will be resolved in the future. Taking this test out of the PR and will add it once the bug is fixed.	3 years ago
Michael Li	1596b02e53	test(e2e): Add database migration test (#2627 ) * test(e2e): Add database migration test * chore(enos): Add enos scenario for migration test * chore(enos): Update go test command to use count option * doc(e2e): Update readme with migration test details * Fix: Typo * CR: Use different library * CR: Add additional context in comment * CR: Move some code from test into functions * doc(e2e): Add instructions to more easily retrieve environment variables * refact(e2e): Create some more methods to increase test readability	3 years ago
Michael Li	0eb7c04c1d	test(e2e): Add tests to validate that session ends after host source is deleted (#2689 )	3 years ago
Michael Li	45171a3f56	refact(e2e): Changes to support an automated migration test (#2676 ) * refact(e2e): Move cleanup steps into each test The migration test needed to create some resources, but doesn't care about cleaning up because the test would take care of spinning down the docker container that it's using. To maintain flexibility going forward, we'll establish that tests are responsible for cleaning up (rather than the methods they use) * refact(e2e): Use new env var for skip check Currently, the e2e tests use the E2E_PASSWORD_AUTH_METHOD_ID environment variable to determine if the test should be skipped. However, the new migration test does not require a pre-existing boundary cluster and would not have this environment variable. As a result, we needed an alternative way to check if an e2e test should be skipped when running tests in ci. * refact(e2e): Create more common boundary methods * fix(e2e): Set to string value Co-authored-by: Johan Brandhorst-Satzkorn <johan.brandhorst@gmail.com>	3 years ago
Michael Li	2d90dc2c97	test(e2e): Minor clerical updates to key destruction tests (#2674 )	3 years ago
Johan Brandhorst-Satzkorn	edd323b73a	Key Rotation/Destruction (#2477 ) (#2607 ) * Key Rotation/Destruction (#2477) * fix: Correct kms.CreateKeys comment This method does not return anything. * feat(kms): Add new ListKeys method The new ListKeys method wraps the underlying KMS wrapper, returning all the keys in the scope specified. * feat(scopes): Add new scope actions for key management Adds list-keys, rotate-keys and revoke-keys actions for scopes. * feat(scopes): Add ListKeys API endpoint This new endpoint lists all keys in a scope * feat(api): Add ListKeys to Scopes client This has to be a custom function because it is a custom action and doesn't map well to any of the existing templates, or generalises well in a way that would make it reasonable to create a new template. * feat(cli): Add new scopes list-keys command * add RotateKeys function to the kms repository * Add Rotate Keys Endpoint to Scopes Api (#2360) * add rotate keys endpoint * add tests for RotateKeys endpoint * remove that one comment I forgot about * addressing more PR comments * Add Rotate Keys CLI Command (#2395) * add cli command and client * add bats tests * fix some info text and pr comments * write a new rotate keys description * Add Missing DEK Foreign Keys (#2408) * add missing fks * mark key as nullable in gorm * update tests to use a new wrapper with a real key_id * fix formatting in test and add keys for auth_token test * replace key values * revert postgres_40_01_test.go * style: reformat sql for readability * refactor: change type of key_id columns to kms_private_id * Store key_id and scope_id with oplog entries, re-type columns referencing data key version (#2431) * fix(db): Correct types of data key version referencers * fix(oplog): Fix missing error handling * feat(oplog): Store key_id and scope_id with oplog entries This migration truncates all existing oplog entries, as migrating existing data would have been complex and likely unnecessary. * Update view references * Always delete oplog entries when dropping keys * Fix rebase issues * Fix sql tests * Add schema for new kms destruction jobs (#2479) * feat: Add schema for new kms destruction jobs The schema lets us manage destruction jobs per-table while providing a guarantee that only one run is running at a time. * Apply suggestions from code review Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Fix table reference and tests Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * update domain, api, and cli to all include key versions in outputs (#2472) * update domain, api, and cli to all include key versions in outputs * fix go sum * add migration to fix immutable error * fix final test issue as well as make gen issue * rebase and fix * address johan pr comments * make gen, didn't realize comments were included * update migrations based on new migration 55 file 03 * Move migrations to 56 * feat: Add key version rewrapping function registry (#2478) The new RegisterTableRewrapFn can be used by a domain to register a callback to use when rewrapping data in a specific table name. * feat(kms): Add scopeId to RewrapFn (#2539) This makes it much easier for rewrap functions to look up the correct wrapper and limit the number of rows searched. * Update Root Cert Proto Definition (#2542) * update root cert proto definition to properly identify public_key as the table primary key * add the test fix as well * Rewrap Functions for Encrypted Tables (#2532) * add oidc rewrap * add argon2 config rewrap * add auth token rewrapping * add worker auth cert rewrapping * check the err * add username password credential rewrapping * add ssh private key credential rewrapping * add vault client certificate rewrap function * add host catalog secret rewrap function * cleanup a little * add host vault token rewrap function * add session credential rewrap function * add session rewrap function * add worker auth rewrap function * update test to include full assert gamut * add session rewrap function TEST * bring all tests up to current standards, make more readable, and include full assert gamut * rework all rewrap functions to utilize scope id * update comments, queries, sql refs, etc, in response to PR comments * forgot a comment * remove hmac updates and fix a couple comments again * Rewrapping Registered Tables Test (#2555) * add the registered table test as well as the two missing rewrap functions * address pr comments, add db r/w conversions, cmp.diff, sql comment, remove (now) faulty immutable test * Add ability to list key version destruction jobs, recurring jobs and destroying key versions (#2498) * feat(kms): Add ability to list data key version destruction jobs * feat(scopes): Add ListKeyVersionDestructionJobs * feat(cli): Add list-key-version-destruction-jobs * feat(kms): Add recurring job that performs table rewrapping The new recurring job runs for each job table with a registered rewrapping callback. It attempts to become the running run and start its rewrapping, gracefully handling sudden interruptions by resuming it's work if it finds evidence of sudden interruption. * feat(kms): Add recurring job for destroying key versions The new job monitors the database for data key version destruction jobs that have finished rewrapping all its data, performing the final data key version revocation. * feat(kms): Add DestroyKeyVersion DestroyKeyVersion immediately destroys a key version if it is a root key version or a data key version which encrypts no data. If the data key version encrypts data which needs to be rewrapped, it queues an asynchronous job to complete the rewrapping operation. * feat(scopes): Add DestroyKeyVersion API endpoint * feat(cli): Add scopes destroy-key-version CLI command * Ensure all secret updates include key ID (#2556) * feat(all): Ensure all secret updates include key ID When updating a secret, it is paramount that the key ID is also updated, as it is the only means we have of ensuring that we only destroy keys once there is no more data associated with the key. * Remove fix to session repository for now This breaks the current private key derivation method * add new encrypt/decrypt funcs and made necessary proto changes (#2557) * add new encrypt/decrypt funcs and made necessary proto changes * address all PR comments * fix test panic * add param checking to rewraps * fix(schema): Correctly organize migrations again * Review comments part 1 * Review comments part 2 * Review comments part 3 * Store cert private key, encrypt tofu token (#2583) * fix(session): store cert private key, encrypt tofu token Previously, we would derive a session certificate private key from the session key used in each project, and not store the key. We would also encrypt the tofu token with the database key but not store a reference to this key in the database. This change fixes this by replacing our key derivation with a key generation step, and instead store the generated key, encrypted, in the database. We also ensure that any new tofu tokens are encrypted with the same key. To handle existing sessions, we lazily rewrite the sessions whenever a user lists them. There is a minor risk that a user could end up destroying the database key that encrypts the tofu token before that session has been rewrapped, but this is going to be rare and temporary. * feat(session): Allow the random source for secrets to be configured * Review comments * Minor fixes * More minor fixes * More small fixes Co-authored-by: Danielle Miu <dani.miu@hashicorp.com> Co-authored-by: Danielle <29378233+DanielleMiu@users.noreply.github.com> Co-authored-by: Michael Gaffney <mike@gaffney.cc> Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * fix(session): Unset session key ID when scope is deleted Unsetting the key ID allows the session to live beyond the lifetime of the scope, while allowing the scope to cascade delete its keys. * fix(migrations): Rewrite migration 56 tests These tests can no longer use the normal test helpers as they try to use the new oplog table structure, so we have to manually write all the interactions. * fix(migrations): Rename migration 58 file name This was the name used in the release branch, update it to the new migration number. * fix(e2e): Add some comments and debug to kms tests * fix(session): Handle empty project and user IDs in read When a project or user is deleted, the session is automatically canceled and the respective field on the session is unset. LookupSession did not handle this case gracefully, and would error on decryption in this state. Skip decrypting sessions that do not have either a user or project to avoid this error. The decrypted values are not used for a canceled session. * Fix worker test * Increase test timeout Co-authored-by: Danielle Miu <dani.miu@hashicorp.com> Co-authored-by: Danielle <29378233+DanielleMiu@users.noreply.github.com> Co-authored-by: Michael Gaffney <mike@gaffney.cc> Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com>	3 years ago
Michael Li	ae28bf7838	test(e2e): Update test to also use a username/password credential in vault (#2595 ) * test(e2e): Add test that uses a vault username/password * refact(e2e): Use go:embed for policy file	3 years ago
Michael Li	80cdbc305d	test(e2e): Check that an active session ends if the user is deleted (#2588 ) Adds a new test to the e2e test suite that checks that an active session ends once the user is deleted.	4 years ago
Michael Li	d68d57e884	fix(e2e): Add retry when checking if session is active (#2586 ) Observed some flakiness here. A test reported that the session was still "pending". Adding additional retries to ensure that it will eventually go active.	4 years ago
Michael Li	48e6156428	test(e2e): Add test that creates a group	4 years ago
Michael Li	02dc9be85f	refact(e2e): Create role functions	4 years ago
Michael Li	81bb361148	test(e2e): Add `ssh localhost` test (#2579 ) This adds a test case where a user would do `boundary connect` in one terminal and `ssh localhost` in another to get to the target.	4 years ago
Michael Li	f4a38a7fc9	fix(e2e): Fix authentication flakiness There was a misunderstanding of how goroutines work. Turns out, the goroutine uses the same keyring as the main routine, which can result in some conflicts depending on when the goroutine executes	4 years ago
Michael Li	c1449c4fd8	test(e2e): Add additional checks to credential store tests	4 years ago
Michael Li	935cc830aa	test(e2e): Add test for vault using the connect authz-token option	4 years ago
Michael Li	0424d379cf	refact(e2e): Reorganize test directory Rearranges the directory structure to align better with the enos scenarios. Tests will now be added in the `tests` directory, with a folder in the directory corresponding to an enos scenario.	4 years ago
Johan Brandhorst-Satzkorn	f57454b6b9	Rewrite interface{} to any (#2535 ) * chore: Rewrite interface{} to any * Add ignore revs	4 years ago
Michael Li	57ffc71849	refact(e2e): Add context as an argument for cli methods This was done have some alignment with the corresponding api methods as well as matching standard Go conventions.	4 years ago
Michael Li	a956e8dec9	refact(e2e): Add WithEnv option to RunCommand This was done to keep the scope of environment variables to just the command execution	4 years ago
Michael Li	1cc2b0b820	doc(e2e): Update typo in comments	4 years ago
Michael Li	6bd168b2a3	test(e2e): Add test that creates a user with the right permissions to start a session	4 years ago
Michael Li	07b16e877c	refact(e2e): Rename original session cancelling test	4 years ago
Michael Li	5d795e6104	refact(e2e): Add support for authenticating as any user	4 years ago
Michael Li	5b0ff4f058	test(e2e): Port "credential stores deletion check" from bats test to e2e test suite The "can not read deleted $NEW_STORE static store" bats test was demonstrating flaky behavior where it would fail due to the credential store read still returning something valid. This check has been moved to an e2e test in order to add some retry logic to the check.	4 years ago
Michael Li	79bc3d4878	refact(e2e): Create credential store function	4 years ago
Michael Li	ab223493a3	fix(e2e): Remove unused code	4 years ago
Michael Li	56ed25a88c	test(e2e): Rename file for clarity	4 years ago
Michael Li	a4e27d877d	refact(e2e): Update RunCommand to have context argument	4 years ago
Michael Li	84aa65ccc5	test(e2e): Add test that cancels a session	4 years ago
Michael Li	cb3f057878	test(e2e): Add test that uses connect authz-token option	4 years ago
Michael Li	ff960e1fb1	refact(e2e): Rename files for consistency	4 years ago
Michael Li	618eca19f5	refact(e2e): Create functions for commonly used operations Many tests had duplicate code to create the base level domain objects in a boundary environment. This commit refactors that code to use functions for these commonly used operations.	4 years ago
Michael Li	051d337b21	refact(e2e): Move logging to helper function	4 years ago
Michael Li	1f87da9fd4	fix(e2e): Fix comment typo	4 years ago
Michael Li	01301cd32a	fix(e2e): Add missing requires	4 years ago
Michael Li	d8448d2184	doc(e2e): Fix typo	4 years ago
Michael Li	f9dfd024ed	doc(e2e): Add info for adding tests	4 years ago
Michael Li	719200612d	refact(e2e): Remove use of AwsHostSetCount env Instead of passing in the number of hosts created for a host set, we can just use the length of the IP addresses to determine that value.	4 years ago
Michael Li	5365b29007	refact(e2e): Port enos smoke test into e2e test suite This adds a test case to the e2e test suite and unifies where testing is located.	4 years ago
Michael Li	1361c3cc6d	refact(e2e): Move environment variables into its own file	4 years ago
Michael Li	86dafced1a	fix(e2e): Add missing require	4 years ago
Michael Li	0afef63dca	refact(e2e): Use envconfig's required property	4 years ago
Michael Li	da0fb9d38a	test(e2e): Add dynamic host catalog test (AWS) This adds the initial set of tests that validate setting up a dynamic host catalog on AWS Co-authored-by: Josh Brand <jbrand@hashicorp.com>	4 years ago
Timothy Messier	d896f37493	Support reading multiple configuration files(#2504 ) feat(config): Support multiple files This updates the three subcommands that take a `-config` flag to to support multiple config files via a repeated `-config` flag. It updates the following subcommands: - `server` - `database init` - `database migrate` Note that the multiple file support only works if all config files are HCL, not JSON. Also note that the config files are concatenated together. There is no attempt to merge config files, so having the same stanza in multiple files can yield unexpected results, with only one of the stanzas being used. When used with these limitations understood, this provides a way to take different actions for different kinds of dynamic configuration changes. An example would be when using consul-template to render the configuration files for boundary. With the multi file support consul-template can render one config file for the controller stanza, and provide boundary with a dynamic database credential via vault. Then when the credential is rotated, consul-template can send boundary a SIGHUP to switch to the new credential without a restart. A separate template could be used to render a config for a stanza that does not support SIGHUP, such as the events stanza that gets its values via consul's KV. If these values change, consul-template can restart boundary so the new configuration is used. Co-authored-by: Timothy Messier <tim.messier@gmail.com> Co-authored-by: Jeff Mitchell <jeffrey.mitchell@gmail.com>	4 years ago
Michael Li	8fe0d13caa	test(e2e): Add vault tests Adds the first set of vault tests. This test sets up vault as a credential store and creates a set of credentials for a target.	4 years ago
Johan Brandhorst-Satzkorn	da9adb0c02	feat: Build docker dev images for specified platform (#2493 ) Previously, building this target on an ARM machine would produce an image with a amd64 binary inside an arm OS.	4 years ago
Michael Li	21e4b70e27	test(e2e): Add end-to-end tests (connect to first target) This adds the initial end-to-end tests. These tests validate the admin workflow of setting up their first target	4 years ago
Timothy Messier	eb61ac6304	refact(session): Add context to session factory This adds a context to the session.RepositoryFactory, allowing errors.NewDeprecated to be replaced with errors.New. It also removes the common.SessionRepoFactory, instead packages just directly import from the session package.	4 years ago
Johan Brandhorst-Satzkorn	de2c40fa77	Fork pgtap-docker to support arm64 (#2411 ) * feat(sql): Fork pgtap to support arm64 This forks pgtap-docker and builds the image locally, and updates our references to use our forked image. * fixup! feat(sql): Fork pgtap to support arm64	4 years ago
Johan Brandhorst-Satzkorn	aef9073fa6	Upgrade to Go 1.19 (#2347 )	4 years ago
Damian Debkowski	27e9f775be	feat: add initial migration hook	4 years ago
Todd	19b549c44a	Rename package servers to server (#2222 )	4 years ago
Todd	e379234259	Remove CanonicalAddress, GetApiTags(), and NewWorkerForStatus. (#2196 ) Minor testing tweaks are also included.	4 years ago
Todd	731a45eba6	Merge the worker_status table with the worker table (#2111 )	4 years ago
Todd	a281d10206	Add worker config table and view (#2090 ) * Remove the server_id from session table, change it to worker_id on session_connection This is step 1 in updating the worker table. The worker is becoming a public resource so it must have a public id. We drop the server_id column on the session_connection table and add the worker_id column so we can use the wt_public_key type. Since db migrations are applied while the controller is offline, it should be safe to assume all session connections are not in a running state, thus allowing us to null out all the worker ids in the session_connection table. For now we don't have very good enforcement of the wt_public_id constraints, since the id is currently defined in the worker config, but this will soon change and the worker's id will be generated by the controller.	4 years ago
Todd	2ecd550e27	Add fields to server_worker to be a boundary resource (#2083 ) * Remove the server_id from session table, change it to worker_id on session_connection This is step 1 in updating the worker table. The worker is becoming a public resource so it must have a public id. We drop the server_id column on the session_connection table and add the worker_id column so we can use the wt_public_key type. Since db migrations are applied while the controller is offline, it should be safe to assume all session connections are not in a running state, thus allowing us to null out all the worker ids in the session_connection table. For now we don't have very good enforcement of the wt_public_id contraints, since the id is currently defined in the worker config, but this will soon change and the worker's id will be generated by the controller. * Updating server_id references to controller_id. * Adding worker tag db writing test. * Move the server table back to the top. * Update comment for the worker object. * Update comment for the worker table. * Update the newWorkerId call to take a context and fix its error. * Correct comment for the wt_network_address domain.	4 years ago
Todd	472d7d520a	Remove the server_id from session table, change it to worker_id on session_connection (#2070 ) * Remove the server_id from session table, change it to worker_id on session_connection This is step 1 in updating the worker table. The worker is becoming a public resource so it must have a public id. We drop the server_id column on the session_connection table and add the worker_id column so we can use the wt_public_key type. Since db migrations are applied while the controller is offline, it should be safe to assume all session connections are not in a running state, thus allowing us to null out all the worker ids in the session_connection table. For now we don't have very good enforcement of the wt_public_id constraints, since the id is currently defined in the worker config, but this will soon change and the worker's id will be generated by the controller.	4 years ago
Todd	d8a443e238	Merge branch 'main' into llb-byow # Conflicts: # internal/daemon/controller/handlers/targets/target_service.go # internal/daemon/controller/handlers/workers/multihop_service.go # internal/daemon/controller/handlers/workers/worker_proxy_service.go # internal/daemon/controller/handlers/workers/worker_service.go # internal/daemon/worker/status.go # internal/daemon/worker/worker.go	4 years ago
Todd	b58dada40d	Move the server daemons into their own package (#2061 ) * Move the server daemons into their own package With this change the internal/server package now is dedicated to the server domain (workers and controllers) and not to the server daemons. The hope is that this will make it easier to keep the daemons decoupled from the representation of the servers in the database.	4 years ago
irenarindos	9e27605213	refact(servers): Split server table into worker and controller	4 years ago
Johan Brandhorst-Satzkorn	21b0d584ad	feat(dbtest): Add benchmark dump generator Generate dumps ahead of time so that they can be used for benchmarks without prohibitive startup costs. Fixes https://hashicorp.atlassian.net/browse/ICU-4039	4 years ago
Johan Brandhorst-Satzkorn	e864652b33	feat(sessions): Add list benchmarks The list benchmark tests uses pre-created database dumps to run its benchmarks. This benchmark will be used to guide optimizations around listing of sessions. Fixes https://hashicorp.atlassian.net/browse/ICU-4042	4 years ago
Johan Brandhorst-Satzkorn	5d042c7ec7	feat(dbtest): Mount DB dumps and create templates Mount the benchmark dump directory when running the test database and create a new script for creating templates from the dumps. This makes it easy to create pre-populated databases for benchmark tests. Fixes https://hashicorp.atlassian.net/browse/ICU-4040	4 years ago
Johan Brandhorst-Satzkorn	a7a2c82931	feat(dbtest): Add docker-load Makefile target The new docker-load target uses docker buildx to build a local image of each of the Dockerfiles, and load them into the local docker socket image store.	4 years ago
Johan Brandhorst-Satzkorn	89196f2ce7	Remove old migration code & Avoid db test image confusion (#2038 ) * refact(dbtest): Remove old migration code This is no longer needed, so we can clean up this script a bit. * refact(dbtest): Change test image env var The existing environment variable clashes with the one used in the top level Makefile. The new name prevents confusing behavior when setting the env var and creating the test database from the root of the repository.	4 years ago
Jeff Mitchell	7eb29261b2	Update to go-kms-wrapping version 2, and plugin-based KMS (#1901 )	4 years ago
Timothy Messier	839f9efcfb	chore(dbtest): Build test database docker image for arm64 This adds a new makefile target to build and publish the test database docker image for multiple architectures. It will create images for: - linux/amd64 - linux/arm64 The target uses docker buildx to build the images. To build the images: docker buildx create --driver docker-container --use make docker-buildx docker buildx rm See: https://docs.docker.com/buildx/working-with-buildx/	4 years ago
Jeff Mitchell	75a38e2505	Import TCP subtypes in test controller	4 years ago
Timothy Messier	34d9842f85	fix(testing/docker): Correctly reset IFS (#1754 )	4 years ago
Jeff Mitchell	5417cc5cb0	Fix setting nil attributes on host sets (#1746 ) This is the analogue of #1743 but for host sets	4 years ago
Timothy Messier	35a7c4f6e7	feat(dbtest): Make test container name configurable	5 years ago
Jeff Mitchell	d58e7670f1	Make PG resource usage nicer for dev (#1615 ) This overrides settings specifically in CI scenarios to the current values but reduces the resource requirements for local dev work.	5 years ago
Timothy Messier	2143940a4a	refactor(dbtest): Support new paths for migration files This updates the docker image used for tests to support the new location for sql migration files and the concept of editions. It continues to process the old paths for now if the new directory does not exist, so that the same image can be used during the transition.	5 years ago
Jim	8d6dee09a9	refact: Add db.DB wrapper and refact all test fixtures to use it. (#1535 ) * refact: Changes required for gorm v2 * refact: Add db.DB wrapper and refact all test fixtures to use it Stop leaking the gorm abstraction within our unit tests. * refact: Migrate direct calls to pq to pgx driver The refactor will remove the remaining direct dependencies on the pq driver which has been deprecated in favor of the pgx driver. It includes the addition of common.SqlOpen which is a wrapper around sql.Open, which is needed to deal with the driver name changing from "postgres" to "pgx" but in our code base the dialect and driver are synonyms.	5 years ago
Louis Ruch	96b0c18f25	docs(dbtest): corrects echo in makefile (#1548 ) After running make test-database-up, the output gave the incorrect command to run to see docker logs.	5 years ago
Todd Knight	e3986d5f9c	Running make fmt to fix formatting.	5 years ago
Timothy Messier	af5d1af568	test: Add dbtest package This is modeled after the internal/docker package to make it easy to use as a replacement. Instead of creating a new docker container for each test, it will create a new database in an existing database container, using a template database as a source. This assumes that the template database exists and already has the schema migrations run against it. The default template is `boundary_template` which should already have all migrations applied. However, some tests require an empty database to test the migration code. In these cases the `template1` template database should be used, ie: dbtest.StartWithTemplate("postgres", dbtest.WithTemplate("template1"))	5 years ago
Timothy Messier	c6cb7c8512	chore: Define custom docker image for tests This images is built from the official postgres docker image, but with updates to optimize the test execution: - A config file for postgres to increase the performance of the test server. - An initialization script to create a template database with all migrations run against it. There are new make targets to build and publish this docker image. The image can be pulled with: docker pull hashicorpboundary/postgres:13-alpine To use this image for tests start the container: make -C internal/db/docker database-up	5 years ago
Michael Gaffney	df35699c4e	Integrate with Vault to retrieve and manage per session credentials (#1308 ) * Fix down migrations * Udpates due to merge * Sentinel values only have to be greater than 0 * Create credential related sdk structs and methods. * Post merge interface updating. * Removing scratch code that was not cleaned up. * updates * Convert client certificate and client certificate keys into pem blocks and validate. * Add newline at end of file. * Faster check for "s" at the end of a resource name when generating from templates. * make fmt * updates * Add dynamic credentials to a session * Refactor: move contents of file * updates * Updates * Add InvalidDynamicCredential error * Assign credentials * Allow updating client certificates seperate from the client certificate key. * Replace application purpose string with enum value * PR feedback / fix go test . * Delete dead code * Use common view * Refactor: extract interface and rename method * Refactor: move code to eliminate privPurpLibrary * Add comment to requestMap * Refactor: do not export methods on an unexported struct * Update internal/db/schema/migrations/postgres/10/03_vault_credential.up.sql Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Add comments to credential Purpose constants * Reorder switch statements to handle errors first * PR feedback * update * fix merge * Organizing the scheduler code and extract the individual store creation test helper function. * Run 'make fmt' * Create certificate when creating store. Allow vault address to be passed in as option * Refactor: rename database views and associated structs This change renames two database views and associated go structs to use a consistent naming pattern. Views ending in 'private' contain encrypted credentials needed for connecting to Vault. Views ending in 'public' mirror the 'private' views but do not include any encrypted values. This change does not include any changes to functionality or behavior. * Adding SAD target operations for credential libraries to the SDK. * Add status field and enumeration table for credential status * Refactor: rename Status to TokenStatus * Add status to vault credentials * Creating the template for the CLI and helper functions. * Add private database view for vault credentials * Add scope_id to view and cleanup TODO comment * Reformat embedded sql queries * Add vault client helpers * updates * white space * Add LookupLease test * CLI commands for Store work. Renamed fields in proto w/ vault prefix. * Test issue credentials with client TLS * Add additional checks to vault ping * Add an error for vault token capabilities and create a VaultToken error kind * Add support for working with Vault policies * Use Vault 1.7.2 for testing * Add testing helper for creating a vault client with a non-root token * Fix Vault renew lease test The Vault renew lease endpoint accepts an optional duration parameter for requesting the number of seconds to extend the lease by. However, Vault is not required to honor this request. * Add a var for the required capabilities of a boundary Vault token * Enhance the test helper for adding a policy to Vault * Allow the test role in postgresql to revoke credentials * Remove out of date comments * Enhance Vault test helpers for the database secrets engine * Reformat comments * Add a method for getting the capabilities of the current Vault token * Add revoke lease to internal Vault client * Reformat: combine err return line with check for nil line * Remove redundant checks in test code Remove checks in test code that are redundant with checks in the test harness. * Refactor CreateToken test helper to return the secret and the token * Fix build failures caused by signature change in vault.CreateToken * Fix Vault version and Vault API link in comments * ran `make gen` after merging from mgaffney-vault. * Remove Vault prefix from attribute fields in API, create a base CLI option for adding field prefixes. format now uses that prefix for error reporting. * Template now allows attaching attribute field prefixes. * Credential store uses PrefixAttributeFieldErrorsWithSubactionPrefix. * Fixing naming of vault flags and helper flags. * Updating more references to generated api methods. * Make the capabilities String method more readable * Add comment outlining PrintApiError usage of Options. * Refactor test to move declarations closer to first use * Fix comment * Implement revoke method on vault repository * Tests now verify certs, CA, and tokens, addresses can be updated in a store. * Added test for creating store with pk/cert in same field. * Allo updating certificates seperate from private key. Only contact backing vault service when updating token. * Fixing bad tests and removing unused code. * Adding tests for various ways of updating tokens. * Add private credential * Add token revocation job and cred renewal/revocation job * Regen after merge. * Fixing field mask related merge error. * Create Library CLI. Removes vault prefix from path. Adds a WithoutCleanup testOption for vault. * Set all credentials to revoked when a token is revoked * Fixing missed renaming update. * fix copy/paste error. * Fixing code generation errors after merge. * make gen after merge. * Update internal/cmd/commands/credentialstorescmd/vault_funcs.go Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Update internal/cmd/commands/credentialstorescmd/vault_funcs.go Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Update internal/cmd/commands/credentialstorescmd/vault_funcs.go Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Refactor: move migrations from 10 to 12 * Removing logic from transaction. * wrapping client errors in the calling op for CredentialStore's client() method. * Redact token * redact client key * updates * Add trigger to revoke credentials when session is canceled or terminated * Fixing some help text for some flags. * Add ability to load values from files (file://) or environment variables (env://). * Updating comments * fix bad merge * feedback * Adding issued credentials to sessions. * Error on capabilities * updates * Expose NewVaulTestServer * Add godoc * Adding generated SessionCredential struct for API. * Progress on building handler test for Authorize Session. * feedback * Update policies * Add 'revoke' as a status for Vault Tokens * Add delete_time to vault credential store * Create dynamic credentials at session creation time. * Tests pass with credentials attached to AuthorizedSession result. * Only call issue if there are credentials to issue. * Fixing output only issues. Adding type to credential library. * Fix test to clear un/pw generated. confirm generated un/pw changes from 1 authorize session call to another. * Update lookupTokenError * Add delete_time to private credential store * Refactor: move private store to separate file * Fixing tests for AuthorizeSession and verifying error cases. * Only create the credential repo if there are credentials to issue. * Rename Library field to CredentialLibrary. * Fixing missing change of Library to CredentialLibrary. * Removing Default SDK functions for fields which are required and update CLI to match. * Replace resource specific id variables with "id" and the input parmater for paths to be just a single string and the resource name as it should show up in the path. * Soft delete vault credential stores * Prevent new SQL functions from silently overwriting existing functions * Rename "Hmac" to "HMAC" in the human readable cli response table. * Fix tests * Add vault database cleanup jobs * Add ability to set the token period in the vault test harness * updates * Add not_null_columns func test * remove unused struct * Up no output timeout * Validate current vault token on addr update * Fix client cert change test * add cert test * Update revocation job where * Fix comment * Use Vault's default port in CLI help strings * Remove down migrations * Increase migration file numbers by 1 * Run make migrations * Move migrations from 12 to 10 * Increase Circle CI timeout for acceptance tests * Fix spelling mistake in error messages * ASD cmds for Target and returning credentials to AuthSession request (#1338) * Add Add/Set/Remove commands for libraries on Targets. Return credentials on AuthorizeSession request. Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> Co-authored-by: Louis Ruch <louisruch@gmail.com> Co-authored-by: Todd Knight <T.Alan.Knight@gmail.com> Co-authored-by: Jeff Mitchell <jeffrey.mitchell@gmail.com>	5 years ago
Jeff Mitchell	15bd1a5245	Add initial SQL for managed groups (#1253 )	5 years ago
Jeff Mitchell	c1cc2e3e8e	Fix typo	6 years ago
Jeff Mitchell	37e9fed2e3	Allow not destroying dev databases (#366 ) This also shifts some logic around to better prepare for non-dev-mode workloads, although it does not actually call the KMS creation functions and initial auth method creation from non-dev commands yet.	6 years ago
Jeff Mitchell	c2b49dbc7d	Plumb root/worker auth kms testing options to public side	6 years ago
Jeff Mitchell	ab1f31e9af	Add WithDatabaseUrl to testing package	6 years ago
Jeff Mitchell	8445d4bbbc	Add WithRecoveryKms option to test controller	6 years ago
Jeff Mitchell	b53812a5c1	Add ability to skip automatic auth method creation (#306 ) This is useful if you, for instance, want Terraform to be 100% responsible for creation of resources (outside of the static ones that cannot be removed or modified, like u_anon). This will mean using the recovery mechanism for initial setup, but that isn't an issue once TF supports that :-)	6 years ago
Jeff Mitchell	282177afc2	Remove the default org (#270 )	6 years ago
Todd Knight	012967e91b	Adding DefaultAuthMethod, DefaultLoginName, DefaultPassword to exported testing test controller. (#258 )	6 years ago
Jeff Mitchell	6661117d4c	The name. The name. The name!	6 years ago
Jeff Mitchell	94f66c9ee6	Fix test function breakage after merging encrypted config	6 years ago
Jeff Mitchell	fafdcbbfa4	CORS support (#73 ) This adds per-listener CORS support. Logic is ported from Vault, along with a fully new test suite.	6 years ago
Jim	26265399ef	fix format directive (#72 )	6 years ago
Todd Knight	95d29c3e95	Allow the TestController to be referenced externally (#65 ) * Allow the TestController to be used outside of our go module. * Adding package comment explaining this testing package is for internal use only.	6 years ago
Todd Knight	ff705bf3b2	Revert "Allow the TestController to be used outside of our module." This reverts commit `e1010ba0`	6 years ago
Todd Knight	e1010ba055	Allow the TestController to be used outside of our module.	6 years ago

1 2 3 4 5

213 Commits (b24f6dcee825caf59cd484fbf6edfeb4cab72e75)