boundary

Commit Graph

Author	SHA1	Message	Date
Johan Brandhorst-Satzkorn	5d042c7ec7	feat(dbtest): Mount DB dumps and create templates Mount the benchmark dump directory when running the test database and create a new script for creating templates from the dumps. This makes it easy to create pre-populated databases for benchmark tests. Fixes https://hashicorp.atlassian.net/browse/ICU-4040	4 years ago
Johan Brandhorst-Satzkorn	a7a2c82931	feat(dbtest): Add docker-load Makefile target The new docker-load target uses docker buildx to build a local image of each of the Dockerfiles, and load them into the local docker socket image store.	4 years ago
Johan Brandhorst-Satzkorn	89196f2ce7	Remove old migration code & Avoid db test image confusion (#2038 ) * refact(dbtest): Remove old migration code This is no longer needed, so we can clean up this script a bit. * refact(dbtest): Change test image env var The existing environment variable clashes with the one used in the top level Makefile. The new name prevents confusing behavior when setting the env var and creating the test database from the root of the repository.	4 years ago
Jeff Mitchell	7eb29261b2	Update to go-kms-wrapping version 2, and plugin-based KMS (#1901 )	4 years ago
Timothy Messier	839f9efcfb	chore(dbtest): Build test database docker image for arm64 This adds a new makefile target to build and publish the test database docker image for multiple architectures. It will create images for: - linux/amd64 - linux/arm64 The target uses docker buildx to build the images. To build the images: docker buildx create --driver docker-container --use make docker-buildx docker buildx rm See: https://docs.docker.com/buildx/working-with-buildx/	4 years ago
Jeff Mitchell	75a38e2505	Import TCP subtypes in test controller	4 years ago
Timothy Messier	34d9842f85	fix(testing/docker): Correctly reset IFS (#1754 )	4 years ago
Jeff Mitchell	5417cc5cb0	Fix setting nil attributes on host sets (#1746 ) This is the analogue of #1743 but for host sets	4 years ago
Timothy Messier	35a7c4f6e7	feat(dbtest): Make test container name configurable	4 years ago
Jeff Mitchell	d58e7670f1	Make PG resource usage nicer for dev (#1615 ) This overrides settings specifically in CI scenarios to the current values but reduces the resource requirements for local dev work.	4 years ago
Timothy Messier	2143940a4a	refactor(dbtest): Support new paths for migration files This updates the docker image used for tests to support the new location for sql migration files and the concept of editions. It continues to process the old paths for now if the new directory does not exist, so that the same image can be used during the transition.	4 years ago
Jim	8d6dee09a9	refact: Add db.DB wrapper and refact all test fixtures to use it. (#1535 ) * refact: Changes required for gorm v2 * refact: Add db.DB wrapper and refact all test fixtures to use it Stop leaking the gorm abstraction within our unit tests. * refact: Migrate direct calls to pq to pgx driver The refactor will remove the remaining direct dependencies on the pq driver which has been deprecated in favor of the pgx driver. It includes the addition of common.SqlOpen which is a wrapper around sql.Open, which is needed to deal with the driver name changing from "postgres" to "pgx" but in our code base the dialect and driver are synonyms.	4 years ago
Louis Ruch	96b0c18f25	docs(dbtest): corrects echo in makefile (#1548 ) After running make test-database-up, the output gave the incorrect command to run to see docker logs.	4 years ago
Todd Knight	e3986d5f9c	Running make fmt to fix formatting.	5 years ago
Timothy Messier	af5d1af568	test: Add dbtest package This is modeled after the internal/docker package to make it easy to use as a replacement. Instead of creating a new docker container for each test, it will create a new database in an existing database container, using a template database as a source. This assumes that the template database exists and already has the schema migrations run against it. The default template is `boundary_template` which should already have all migrations applied. However, some tests require an empty database to test the migration code. In these cases the `template1` template database should be used, ie: dbtest.StartWithTemplate("postgres", dbtest.WithTemplate("template1"))	5 years ago
Timothy Messier	c6cb7c8512	chore: Define custom docker image for tests This images is built from the official postgres docker image, but with updates to optimize the test execution: - A config file for postgres to increase the performance of the test server. - An initialization script to create a template database with all migrations run against it. There are new make targets to build and publish this docker image. The image can be pulled with: docker pull hashicorpboundary/postgres:13-alpine To use this image for tests start the container: make -C internal/db/docker database-up	5 years ago
Michael Gaffney	df35699c4e	Integrate with Vault to retrieve and manage per session credentials (#1308 ) * Fix down migrations * Udpates due to merge * Sentinel values only have to be greater than 0 * Create credential related sdk structs and methods. * Post merge interface updating. * Removing scratch code that was not cleaned up. * updates * Convert client certificate and client certificate keys into pem blocks and validate. * Add newline at end of file. * Faster check for "s" at the end of a resource name when generating from templates. * make fmt * updates * Add dynamic credentials to a session * Refactor: move contents of file * updates * Updates * Add InvalidDynamicCredential error * Assign credentials * Allow updating client certificates seperate from the client certificate key. * Replace application purpose string with enum value * PR feedback / fix go test . * Delete dead code * Use common view * Refactor: extract interface and rename method * Refactor: move code to eliminate privPurpLibrary * Add comment to requestMap * Refactor: do not export methods on an unexported struct * Update internal/db/schema/migrations/postgres/10/03_vault_credential.up.sql Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Add comments to credential Purpose constants * Reorder switch statements to handle errors first * PR feedback * update * fix merge * Organizing the scheduler code and extract the individual store creation test helper function. * Run 'make fmt' * Create certificate when creating store. Allow vault address to be passed in as option * Refactor: rename database views and associated structs This change renames two database views and associated go structs to use a consistent naming pattern. Views ending in 'private' contain encrypted credentials needed for connecting to Vault. Views ending in 'public' mirror the 'private' views but do not include any encrypted values. This change does not include any changes to functionality or behavior. * Adding SAD target operations for credential libraries to the SDK. * Add status field and enumeration table for credential status * Refactor: rename Status to TokenStatus * Add status to vault credentials * Creating the template for the CLI and helper functions. * Add private database view for vault credentials * Add scope_id to view and cleanup TODO comment * Reformat embedded sql queries * Add vault client helpers * updates * white space * Add LookupLease test * CLI commands for Store work. Renamed fields in proto w/ vault prefix. * Test issue credentials with client TLS * Add additional checks to vault ping * Add an error for vault token capabilities and create a VaultToken error kind * Add support for working with Vault policies * Use Vault 1.7.2 for testing * Add testing helper for creating a vault client with a non-root token * Fix Vault renew lease test The Vault renew lease endpoint accepts an optional duration parameter for requesting the number of seconds to extend the lease by. However, Vault is not required to honor this request. * Add a var for the required capabilities of a boundary Vault token * Enhance the test helper for adding a policy to Vault * Allow the test role in postgresql to revoke credentials * Remove out of date comments * Enhance Vault test helpers for the database secrets engine * Reformat comments * Add a method for getting the capabilities of the current Vault token * Add revoke lease to internal Vault client * Reformat: combine err return line with check for nil line * Remove redundant checks in test code Remove checks in test code that are redundant with checks in the test harness. * Refactor CreateToken test helper to return the secret and the token * Fix build failures caused by signature change in vault.CreateToken * Fix Vault version and Vault API link in comments * ran `make gen` after merging from mgaffney-vault. * Remove Vault prefix from attribute fields in API, create a base CLI option for adding field prefixes. format now uses that prefix for error reporting. * Template now allows attaching attribute field prefixes. * Credential store uses PrefixAttributeFieldErrorsWithSubactionPrefix. * Fixing naming of vault flags and helper flags. * Updating more references to generated api methods. * Make the capabilities String method more readable * Add comment outlining PrintApiError usage of Options. * Refactor test to move declarations closer to first use * Fix comment * Implement revoke method on vault repository * Tests now verify certs, CA, and tokens, addresses can be updated in a store. * Added test for creating store with pk/cert in same field. * Allo updating certificates seperate from private key. Only contact backing vault service when updating token. * Fixing bad tests and removing unused code. * Adding tests for various ways of updating tokens. * Add private credential * Add token revocation job and cred renewal/revocation job * Regen after merge. * Fixing field mask related merge error. * Create Library CLI. Removes vault prefix from path. Adds a WithoutCleanup testOption for vault. * Set all credentials to revoked when a token is revoked * Fixing missed renaming update. * fix copy/paste error. * Fixing code generation errors after merge. * make gen after merge. * Update internal/cmd/commands/credentialstorescmd/vault_funcs.go Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Update internal/cmd/commands/credentialstorescmd/vault_funcs.go Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Update internal/cmd/commands/credentialstorescmd/vault_funcs.go Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Refactor: move migrations from 10 to 12 * Removing logic from transaction. * wrapping client errors in the calling op for CredentialStore's client() method. * Redact token * redact client key * updates * Add trigger to revoke credentials when session is canceled or terminated * Fixing some help text for some flags. * Add ability to load values from files (file://) or environment variables (env://). * Updating comments * fix bad merge * feedback * Adding issued credentials to sessions. * Error on capabilities * updates * Expose NewVaulTestServer * Add godoc * Adding generated SessionCredential struct for API. * Progress on building handler test for Authorize Session. * feedback * Update policies * Add 'revoke' as a status for Vault Tokens * Add delete_time to vault credential store * Create dynamic credentials at session creation time. * Tests pass with credentials attached to AuthorizedSession result. * Only call issue if there are credentials to issue. * Fixing output only issues. Adding type to credential library. * Fix test to clear un/pw generated. confirm generated un/pw changes from 1 authorize session call to another. * Update lookupTokenError * Add delete_time to private credential store * Refactor: move private store to separate file * Fixing tests for AuthorizeSession and verifying error cases. * Only create the credential repo if there are credentials to issue. * Rename Library field to CredentialLibrary. * Fixing missing change of Library to CredentialLibrary. * Removing Default SDK functions for fields which are required and update CLI to match. * Replace resource specific id variables with "id" and the input parmater for paths to be just a single string and the resource name as it should show up in the path. * Soft delete vault credential stores * Prevent new SQL functions from silently overwriting existing functions * Rename "Hmac" to "HMAC" in the human readable cli response table. * Fix tests * Add vault database cleanup jobs * Add ability to set the token period in the vault test harness * updates * Add not_null_columns func test * remove unused struct * Up no output timeout * Validate current vault token on addr update * Fix client cert change test * add cert test * Update revocation job where * Fix comment * Use Vault's default port in CLI help strings * Remove down migrations * Increase migration file numbers by 1 * Run make migrations * Move migrations from 12 to 10 * Increase Circle CI timeout for acceptance tests * Fix spelling mistake in error messages * ASD cmds for Target and returning credentials to AuthSession request (#1338) * Add Add/Set/Remove commands for libraries on Targets. Return credentials on AuthorizeSession request. Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> Co-authored-by: Louis Ruch <louisruch@gmail.com> Co-authored-by: Todd Knight <T.Alan.Knight@gmail.com> Co-authored-by: Jeff Mitchell <jeffrey.mitchell@gmail.com>	5 years ago
Jeff Mitchell	15bd1a5245	Add initial SQL for managed groups (#1253 )	5 years ago
Jeff Mitchell	c1cc2e3e8e	Fix typo	6 years ago
Jeff Mitchell	37e9fed2e3	Allow not destroying dev databases (#366 ) This also shifts some logic around to better prepare for non-dev-mode workloads, although it does not actually call the KMS creation functions and initial auth method creation from non-dev commands yet.	6 years ago
Jeff Mitchell	c2b49dbc7d	Plumb root/worker auth kms testing options to public side	6 years ago
Jeff Mitchell	ab1f31e9af	Add WithDatabaseUrl to testing package	6 years ago
Jeff Mitchell	8445d4bbbc	Add WithRecoveryKms option to test controller	6 years ago
Jeff Mitchell	b53812a5c1	Add ability to skip automatic auth method creation (#306 ) This is useful if you, for instance, want Terraform to be 100% responsible for creation of resources (outside of the static ones that cannot be removed or modified, like u_anon). This will mean using the recovery mechanism for initial setup, but that isn't an issue once TF supports that :-)	6 years ago
Jeff Mitchell	282177afc2	Remove the default org (#270 )	6 years ago
Todd Knight	012967e91b	Adding DefaultAuthMethod, DefaultLoginName, DefaultPassword to exported testing test controller. (#258 )	6 years ago
Jeff Mitchell	6661117d4c	The name. The name. The name!	6 years ago
Jeff Mitchell	94f66c9ee6	Fix test function breakage after merging encrypted config	6 years ago
Jeff Mitchell	fafdcbbfa4	CORS support (#73 ) This adds per-listener CORS support. Logic is ported from Vault, along with a fully new test suite.	6 years ago
Jim	26265399ef	fix format directive (#72 )	6 years ago
Todd Knight	95d29c3e95	Allow the TestController to be referenced externally (#65 ) * Allow the TestController to be used outside of our go module. * Adding package comment explaining this testing package is for internal use only.	6 years ago
Todd Knight	ff705bf3b2	Revert "Allow the TestController to be used outside of our module." This reverts commit `e1010ba0`	6 years ago
Todd Knight	e1010ba055	Allow the TestController to be used outside of our module.	6 years ago

33 Commits (5d042c7ec7c19da0431bf5e1d4421376a741c2fa)