136 Commits (fb0e5ea1cef09f435fbe1785ec06dbdbf83a3370)

Author	SHA1	Message	Date
Jeff Mitchell	158ab09952	Merge branch 'main' into plugin-hostcatalogs	5 years ago
Jim	8d6dee09a9	refact: Add db.DB wrapper and refact all test fixtures to use it. (#1535) ... * refact: Changes required for gorm v2 * refact: Add db.DB wrapper and refact all test fixtures to use it Stop leaking the gorm abstraction within our unit tests. * refact: Migrate direct calls to pq to pgx driver The refactor will remove the remaining direct dependencies on the pq driver which has been deprecated in favor of the pgx driver. It includes the addition of common.SqlOpen which is a wrapper around sql.Open, which is needed to deal with the driver name changing from "postgres" to "pgx" but in our code base the dialect and driver are synonyms.	5 years ago
Jim	136ac00b49	refact: Changes required for gorm v2 (#1528)	5 years ago
Todd	e11a481256	Register Azure and AWS at controller start up (#1570) ... * Register Plugins. * Pass catalogs and persisted data when listing hosts for host sets. Register azure plugin at startup if not present.	5 years ago
Jeff Mitchell	8b1ca4b0b8	Add host IDs to plugin host sets read response (#1568) ... This also includes tweaks here and there within the service and repos.	5 years ago
Jeff Mitchell	7d71618df0	Add more host-catalog and host-set CLI support (#1567) ... Add more host-catalog and host-set CLI support Co-authored-by: Todd <T.Alan.Knight@gmail.com>	5 years ago
Jeff Mitchell	a834a14785	Add attribute flag building and parsing (#1562) ... This adds a few command sketches but that's not the main point of the PR and filling those out will come in a different PR. This adds a new flag type that can combine inputs to a single target slice, retaining the ability to distinguish where it came from but also keep ordering across different flag names. It also implements a function that does the heuristic parsing with fallback.	5 years ago
Todd	14cc97b645	Add authorize session for plugin based host sets. (#1559) ... Added a new Endpoint struct at the top level host package level to capture host, set, and address chosen. Temporarily add a host_plugin_host table to capture the hosts returned by the plugins. This ensures the datawarehouse is able to query the table to decide what host was chosen. The view used to update the datawarehouse dimension table provides rows with host set ids and hosts which are not in that host set. This is ok since the function which updates the dimension table provides the host set and host id chosen so that relationship doesn't need to be captured in the view itself. Co-authored-by: Jeff Mitchell <jeffrey.mitchell@gmail.com>	5 years ago
Todd	a4ea99047f	Remove Prefix Id and Plugin Name fields (#1563) ... * Remove Prefix Id and Plugin Name fields. Creating catalogs now require either the plugin id or the name of the plugin resource (but not both). Host Catalogs and Host Sets API resources now have a read only plugin field populated with plugin info. Host Catalogs have a plugin id field as a top level field.	5 years ago
Jeff Mitchell	e4e788553f	Add basic loopback test plugin (#1555)	5 years ago
Jeff Mitchell	8fb1898c3e	Update host plugin RPC to return sets from ListHosts (#1557) ... A few other minor tweaks as well.	5 years ago
Todd	bbfef2802f	Placeholder Plugin Providers for Repos and added testPlugin struct (#1532) ... * Create minimalistic plugin map and test plugin. * Pass secrets and attributes to the plugin when creating catalogs or sets. Add tests for CreateSet and CreateCatalog repo methods. * make fmt and extract out getPrivateCatalog and getCatalog helper methods. * Exporting TestPluginServer so it can be used in the handlers. * Keep separate persisted data from host catalogs lookups which facilitate passing it onto the plugins. * Add TODO to merge get Catalog and get Persisted data. * Adding tests for unimplemented being returned by the plugin. * Use GetFields() instead of AsMap() to confirm attributes should be populated. Make clone consistent between catalog and sets. Co-authored-by: Jeff Mitchell <jeffrey.mitchell@gmail.com>	5 years ago
Jeff Mitchell	01d4383c1b	Add preferred endpoints logic to API/handler/DB and some CLI bits (#1529)	5 years ago
Jeff Mitchell	f9c620a5d5	Merge branch 'main' into plugin-hostcatalogs	5 years ago
Jeff Mitchell	7fc712de44	Bump protoc	5 years ago
Todd Knight	4f09f1d74f	Add create, list, lookup functions for plugin based host catalogs (#1515) ... Create the repository for plugin host catalogs. A large TODO is left in the code to interface with the plugin system once ready.	5 years ago
Todd Knight	1249f9668f	Add Plugin Host Set Repo Create, List, Read Operations (#1497) ... Add repo for plugin based host sets as well as tests.	5 years ago
Todd Knight	db9e1106a9	feat(host): Add host plugin related schemas and tests (#1475) ... * feat(host): Add host plugin related schemas and tests This adds the schema files for host plugins, plugin based catalogs and plugin based sets. This also adds the protos and tests which utilize gorm to ensure the schemas enforce the constraints we expect. Along with this change was a migration which moved catalog names to the base type table so we can ensure all catalogs in a single scope, regardless of subtype, have a unique name. * Updated plugin schemas to do the following: - Add plugin_executable table - plugin table now also has scope_id and name w/ uniqueness constraints - host_plugin no longer has id_prefix column - host_plugin separates name and plugin_name - plugin_version table renamed version to symantic_version column. * Fix typo in delete_plugin_subtype trigger. Add update test for host plugins. * Update id prefixes. Fix public_id typos in protos and plugin_executable name in sql diagrams. * Created internal/plugin and moved base plugin structs to it and moved host plugin subdirectory to it. * Created internal/plugin and moved base plugin structs to it and moved host plugin subdirectory to it. * Add first pass at enums for OS and Arch supported by plugin executables. * Capitalizing the const enums for OS and Architectures. * Add comments to sql files. * Reviewer comments. Remove unsupported OSes and Archs from SQL and go constants. Add missing tests. * Be more permissive in the values the db accepts. The go logic can restrict which values it will allow getting populated into the db. * Removing constraints on which values can be placed inside operating_system and architecture columns. * Updating test helper functions to only create a single catalog or set. * Move files to new migration version. * Fixing job/plugin test. * Update table names, named a number of constraints, remove plugin version and executable tables. * Add constraints for plugin name and id prefix. * Rename constraint, remove unhelpful comment block. * Adding semantic version to plugin_host and set attributes to not null. * Remove semantic versioning from all locations. * Remove semantic_version from plugin_host table comment. * Fix op copy/paste error. Don't use deprecated errors methods. Update constraint names. Add docs. * Apply suggestions from code review Fixing constraint names. Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com>	5 years ago
Jeff Mitchell	2649d1b966	Move protooptions to sdk/pbs (#1486) ... This prevents a reverse dependency from sdk on the main module.	5 years ago
Todd Knight	39cc245966	Make gen after make tools. Includes make fmt of existing non generated files. (#1438)	5 years ago
s-christoff	6b78108ecf	Update primary error functions to take a context, deprecate old functions (#1358) ... * add new error funcs which take a ctx and deprecate existing funcs * use context where available when writing error events * remove circular internal/errors pkg dep * suppress some chatty errors using errors.WithoutEvent() * convert auth oidc funcs to take context where needed to write events Co-authored-by: Jim <jlambert@hashicorp.com>	5 years ago
Todd Knight	10e8aeae4b	Subtype Id registration moved to its own package (#1416) ... * Allow repo packages to register subtypes and id prefixes. * Refactor out request authentication logic to a new package as a sibling to handler.	5 years ago
Michael Gaffney	094bdcdd2b	protobuf: remove unused imports (#1267) ... This removes unused imports in the protobuf files which are reported as warnings by the protoc compiler.	5 years ago
Michael Gaffney	21033a6174	Refactor: multiple rename to fix the spelling of subtype (#1227) ... The definition of 'subtype' is 'a secondary or subordinate type'. The 'T' should not be capitalized (unless it is referring to a type of submarine, which its not).	5 years ago
Michael Gaffney	a7ba27148b	Fix godoc wording	5 years ago
Jim	358f5a61fb	bump protoc to v3.15.8 (#1147)	5 years ago
Jeff Mitchell	be10cc4b42	Update grpc/proto deps (#1136) ... * Update grpc/proto deps * Make gen	5 years ago
Michael Gaffney	3130bd615e	Fix go doc: remove sentence fragment	5 years ago
Michael Gaffney	aafbada3ae	Remove calls to `t.Helper()` from test methods (not helpers) (#1063)	5 years ago
Jeff Mitchell	fcbf372881	Bump proto/grpc deps (#1017) ... * Bump proto/grpc deps * Back out buf change * Run make gen	5 years ago
Louis Ruch	7387cec475	Remove sentinel errors (#968) ... * Remove sentinal errors	5 years ago
Jeff Mitchell	6cd97a4a6e	Add support for recursive listing (#885)	5 years ago
Louis Ruch	8151b30ce9	ICU-743/Domain errors internal/kms refactor (#848) ... * Domain errors internal/kms refactor * Update changelog * Update internal/host error op * Incorrect error returned in read_writer	5 years ago
Jeff Mitchell	84c617dc49	Run make gen after the gofumpt update	5 years ago
Michael Gaffney	94cb79bbdd	See how Boundary would look with gofumpt applied (#853) ... * See how Boundary would look with https://github.com/mvdan/gofumpt applied Results of running `gofumpt -w -s .` * Update tools file and Makefile for gofumpt Co-authored-by: Jeff Mitchell <jeffrey.mitchell@gmail.com>	5 years ago
Louis Ruch	70a5899e99	ICU-739/iam domain error refactor (#841) ... * Refactor iam errors * Update db and host doTx error ops * Changelog	5 years ago
Louis Ruch	bfbb179741	ICU-738/Refactor internal/db to domain errors (#815) ... * Refactor internal/db to domain errors	5 years ago
Jeff Mitchell	11b821a200	Bump deps (#818)	5 years ago
Louis Ruch	ec0020de90	Refactor host_repo -> domain errors (#786) ... * Refactor domain errors: New -> E, create helper New and Wrap * Update host repo to use domain errors	5 years ago
Jim	af6ef1b687	Refactor existing sentinel errors (#774)	6 years ago
Jim	1e71c55920	deprecate access to underlying *sql.DB via internal/db.DB() (#506)	6 years ago
Jeff Mitchell	31fe9292b3	Instantiate default resources (#425)	6 years ago
Jeff Mitchell	62baef1b7e	Add multi connection parameters through targets and into session creation (#375) ... * Update protos and gen * Add new values to targets CLI command * Lots more plumbing of new parameters through everything * allow fields to be set to zero value. * Disallow set but empty name/description strings in create/update verifiers Co-authored-by: Jim Lambert <jlambert@hashicorp.com>	6 years ago
Todd Knight	b998591add	Adding and updating host address validation checks (#350)	6 years ago
Todd Knight	c3ecea172d	Generate new version of SDK resources and Add Tests (#331)	6 years ago
Jim	96e4b1cdba	add option db.WithSkipVetForWrite(true) so the db tests don't get intercepted by app validation (#332)	6 years ago
Todd Knight	1c2c078e0a	Adding Authz checks that support new pathing (#328)	6 years ago
Michael Gaffney	9ca8a4ec20	Host set members (#301) ... * Update host set member test * Add ListSetMembers method signature and doc * Move repository methods for host set members to new file * Add TestSetMembers * Implement ListSetMembers * Return hosts from ListSetMembers * Implement AddSetMembers * Implement DeleteSetMembers * Use sql.QueryContext not sql.Query * Implement SetSetMembers * Refactor: extract getHosts method * Refactor: extract createMembers method * Refactor: extract common functions * Return correct count of changed In SetSetMembers, retrieving the current list of hosts in the set happens after the transaction to modify the set has completed. This retrieval can result in an error but the number of modified rows is not effected. * Make list set members an unexported method * Get hosts within the same transaction as mutations of the set * Return hosts of set from LookupSet method * Return hosts of set from UpdateSet method * Remove listSetMembers * Fix merge conflict * Add NOTE and TODOs about using new pattern in "SetMembers" methods	6 years ago
Michael Gaffney	de162c5533	Replace and remove ErrNilParameter with ErrInvalidParameter (#295)	6 years ago
Jeff Mitchell	8f579c75c3	paum -> ampw (#303)	6 years ago
Todd Knight	c4d3414016	Add Host Set CUDLR handler and SDK (#290)	6 years ago
Michael Gaffney	14dd7b49b2	Add method signatures for host set operations (#291) ... * Add method signatures for host set operations * Rename ReplaceSetMembers to SetSetMembers	6 years ago
Michael Gaffney	b24fc185a7	Export TestSets helper function (#292)	6 years ago
Michael Gaffney	3a3cdd7219	Static host set repository methods (#289) ... * Implement CreateSet * Implement UpdateSet * Implement LookupSet * Implement ListSets * Implement DeleteSet * Remove unused parameter from test helper function * Update to use new kms structure * Remove unused parameter for test helper function * Fix resource-type string for host set	6 years ago
Todd Knight	d5678c4f80	Handler for Host CRUDL actions (#287)	6 years ago
Todd Knight	7474e956dd	List Catalogs for Repo and API Handler (#288)	6 years ago
Jim	9570897032	basic keys mgmt repo (#264)	6 years ago
Michael Gaffney	a413ad7b84	Static Host: Lookup, List and Delete (#283) ... * Implement LookupHost * Implement ListHosts * Implement DeleteHost	6 years ago
Todd Knight	eaae887bbe	Don't require type for children of subtyped resources. (#285)	6 years ago
Michael Gaffney	041e1f9fd3	Update host (#278) ... * Add IsNotNullError function to db package * Let the database handle default values not gorm * Implement UpdateHost * Remove unnecessary clone	6 years ago
Michael Gaffney	e18cdc52b3	Create host (#276) ... * Change testHostCatalog methods to be like other resource test methods * Implement CreateHost * Make allocHost return a pointer to a Host	6 years ago
Michael Gaffney	7d133878be	Add base types for host catalog, host set, and host (#272) ... * Move static host migrations to higher number * Add wt_host_address domain type * Add base tables for host catalog, host set, and host * Reformat create trigger statements * Add subtype triggers for host catalog, host set, and host * Remove wt_host_address domain type * Rename columns in host_set_member * Add delete trigger functions for base types * Add delete after triggers to static host subtypes * Add protobufs for host base types	6 years ago
Michael Gaffney	7ac4be51c0	Refactor static host package (#263) ... * Refactor: inline tablename constants * Refactor: move functionality to new files	6 years ago
Jeff Mitchell	78d7f539c5	Add versioning to host catalogs/sets/hosts and fix up tests (#247) ... * Start adding version to host resources and fixing up tests * Add versioning to host resources and update API tests * Fix nil in test * Add missing update	6 years ago
Jeff Mitchell	6661117d4c	The name. The name. The name!	6 years ago
Michael Gaffney	bdb31cf8b5	Bump deps (#245)	6 years ago
Jeff Mitchell	908a299ea3	Convert SDK to the new options API (#238)	6 years ago
Jim	cb89422d9d	define immutable fields including PKs. (#205)	6 years ago
Michael Gaffney	e03a0ff9d7	Simplify SetTableName pattern (#214)	6 years ago
Todd Knight	f47046f158	Update Watchtower to use grpc-gateway v2 (#204) ... * Migration to grpc gateway v2.	6 years ago
Michael Gaffney	799242fce4	Bump deps and run 'make gen' (#212)	6 years ago
Todd Knight	168ae3a726	Create MaskManager to guarantee wire/storage update mask consistency (#121) ... * Feature: Create MaskManager logic to handle project -> scope update mask logic. * Updating resource protos and services to use new mask manager setup. Co-authored-by: Jeff Mitchell <jeffrey.mitchell@gmail.com>	6 years ago
Jeff Mitchell	dec1f07266	Update deps and make proto	6 years ago
Jim	c83e90ed38	implement SetTableName patttern that allows table name to be set back to the default for the storage type. (#196)	6 years ago
Todd Knight	bb4a185412	Pushing test db cleanup up to where the database objects are created using t.Cleanup. (#166)	6 years ago
Todd Knight	0c8385b423	Updating TxHandler to accept a reader as well in order to support reads inside the same transactions as writes. (#139)	6 years ago
Michael Gaffney	4f30983c14	Bump deps and run make gen (#115)	6 years ago
Michael Gaffney	ce166c0bdf	Use dbassert package (#114) ... Removes direct dependency on gorm in tests.	6 years ago
Michael Gaffney	cce06c2cc3	Do not explicitly call the embedded store.HostCatalog (#88)	6 years ago
Michael Gaffney	5bdd8a46ea	Extract timestamp scanners into reusable package (#91) ... * Refactor: move Timestamp from static/store to db/timestamp * Refactor: convert remaining Timestamps to timestamp.Timestamp * Use new db timestamp	6 years ago
Michael Gaffney	9eaf8afb6f	Rename db.IsUnique to db.IsUniqueError (#90)	6 years ago
Michael Gaffney	4f3f9ed222	Check for nil in embedded HostCatalog (#89)	6 years ago
Jim	ef6edbd515	Null updates (#78)	6 years ago
Michael Gaffney	be97e5cac8	Remove dead code	6 years ago
Jeff Mitchell	31ef4a65ac	Bump deps and make gen	6 years ago
Michael Gaffney	0c7f6da936	Static Host Catalog (#51) ... * database: add wt_public_id domain type * static-hosts: add migrations * Rename migrations * migrations: add description column and fix foreign keys * Add protobuf for static host * Add HostCatalog and HostSet * Add Options * Add foreign key constraint * Add package doc * Add copied scanner code * Add NewHostCatalog with tests * Override default table name for static host catalog * WIP: save static host catalog to database * WIP: Print db url for debugging * Add iam test helper function * Make gorm default to null for names and descriptions * Add foreign key constraint from host catalog to scope * Names are not needed for the test org and project * Avoid an ordering dependency in down migrations * Use wt_timestamp * Add check constraint on host address column * Add Host * Add HostSet * Add HostSetMember * Test a HostSetMember can be written to the database * Move the getters and setters for table name to a new file The TableName methods are needed by gorm and the SetTableName methods are for oplog. Moving them to a new file so related functionality is in the same file. * Add repository * Add NewRepository * Close connection before cleanup of database * Add comments to protobuf file and regenerate * Define repository methods for HostCatalog * Assign PublicId when resource is inserted into the database * Wrap a nil parameter error * Add oplog tickets for static host types * WIP: first cut at CreateCatalog * CreateHostCatalog: more tests * Detect unique constraint violation * Use const for PublicId prefixes * Use PostgreSQL error name instead of error code * Add TODO comments * Fix comments * Use PublicId not PublicID * Refactor: move error variables from host/static to db The error variables defined in host/static are generic and can be reused by other packages. * Create a new repository for each test * Validate CreateCatalog returns a new HostCatalog * Do not modify the HostCatalog passed in * Implement UpdateCatalog * Minor cleanup to make folds work * Implement LookupCatalog * Refactor: extract allocCatalog function * Add comment * Refactor: extract newCatalogMetadata function * Make error strings more consistent * Move database specific error check to internal/db package * Change signature of DeleteCatalog and update docs * Implement DeleteCatalog * Make error strings more consistent * Add examples * Update docs * Add package level doc and example for repository * No need for using reflect.DeepEqual * Remove redundant comment * Clarify ErrMultipleRecords results in the transaction being rolled back * Remove redundant error checks * Remove unnecessary check * Return early instead of using nested 'else' statements * Update and Delete must return a row count * catch err on defers (#82) Co-authored-by: Jim Lambert <jimlambrt@Jims-MBP-3.home> * Remove 'if assert' pattern * Use assert package in test helper function * Add test for updating a non existent catalog * Use a single assert when a specific error is expected * Use assert package when it clarifies the check * Catch errors in cleanup functions * Update comments in protobuf file * Update doc for UpdateCatalog to reflect the new behavior * Add common error values for field mask errors * Require a field mask when calling update methods * Add TODO for removing direct call to gorm * Export Public ID prefixes * Add db timestamp guards * Remove unused option Co-authored-by: Jim <jlambert@hashicorp.com> Co-authored-by: Jim Lambert <jimlambrt@Jims-MBP-3.home>	6 years ago