828 Commits (ecdcf72e0e61496beb68dfa8d428ea3de3df1ba5)

Author	SHA1	Message	Date
Jim	11124794bf	Events: add node for formatting/filtering cloudevents (#1390)	5 years ago
Chris Marchesi	1ebb8efab6	Apply extra review feedback from #1340 (#1400) ... * internal/servers/controller: refactor WaitForNextWorkerStatusUpdate * internal/servers/worker: use connId instead of conn.GetConnectionId() * internal/servers/worker: remove Worker.logClose * internal/session: complement versus inclusive state search * internal/session: use ScanRows instead of Scan * internal/session: make closeConnectionsForDeadServersCte results gormable * internal/tests/cluster: rename TestWorkerSessionCleanup to TestSessionCleanup * Simplify SQL query for CloseConnectionsForDeadWorkers (#1410) Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com>	5 years ago
Jim	cab3dd6986	update eventlogger dep which should eliminate a possible panic with the gated.Broker is nil (#1411)	5 years ago
Chris Marchesi	aae0c29f88	internal/servers/worker: fix TestWorkerWaitForNextSuccessfulStatusUpdate (#1402) ... This fixes this test which was failing intermittently. * Ups the grace period timeout to 2s. * Re-positions the testify require.New() so that incorrect code path warnings are not given.	5 years ago
Louis Ruch	2dae498123	Ensure job progress is always reported (#1396) ... * Update completed and total when job finishes * Remove unused option in test * Add comment * Use writer for updates and inserts	5 years ago
Louis Ruch	74aba58c73	Remove Telemetry from config tests (#1401)	5 years ago
Jeff Mitchell	ed6c59a053	Update the rest of the shared libs locations	5 years ago
Jeff Mitchell	4900f249e6	Update parseutil import location	5 years ago
Jeff Mitchell	b533e12c1a	Update password import	5 years ago
Jeff Mitchell	ce52acb968	Update strutil import	5 years ago
Jeff Mitchell	44329d4ff9	Repoint mlock import	5 years ago
Jeff Mitchell	140c54e319	Repoint base62 import	5 years ago
Jeff Mitchell	9ba1948298	Remove telemetry calls as we aren't using them	5 years ago
Jeff Mitchell	051fe60718	Duplicate logging instead of using from shared secure libs, as it's going out of there and we'll be moving away from hclog anyways	5 years ago
Chris Marchesi	5a70875726	internal/servers/controller: Worker failure connection cleanup (#1340) ... This commit adds the support to do the following: * Mark connections for non-reporting workers as closed. This is the controller counterpart to the worker functionality (see #1330). This is written as a scheduled job that does the work DB-side in a single atomic query. * Works to reconcile states if such a broken controller-worker connection resumes and a worker reports a connection as connected that should be disconnected. In this case, the controller will send an update request, and the worker will honor it and terminate the connection. * Further refinement of the grace period setting has been added here. We have converged on the current server "liveness" setting as our default here, which is half of the previous 30s (15 seconds, in other words). Additionally, this is now configurable on the controller and worker side, with the caveat that it's currently impossible to do so in config as the setting has been untagged in HCL. This is exposed so that we can run some sophisticated testing scenarios where we skew the grace period to either the controller or worker to ensure the aforementioned reconciliation works. * Some repository functions have been added to support the new functionality, in addition to some test code to the worker to allow querying of session state while testing. * Finally, we've added some add timestamp subtraction functions as well, basically serving as the opposite of the addition functions.	5 years ago
Jeff Mitchell	2cbcf9a563	Update usage of shared-secure-libs (#1393)	5 years ago
Chris Marchesi	895de869ab	internal/db: add enumeration constraints for the server table (#1386) ... This adds enumeration constraints to the server table, ensuring that no servers can be added other than the types "controller" and "worker". This should already be impossible to do in code, but this adds a check on the database level to ensure it's the case as well.	5 years ago
Jim	1daa3ebefe	integrate events into the servers (#1355)	5 years ago
Jeff Mitchell	7c3d5be4f6	Update format of secret to return both raw and decoded when possible (#1372)	5 years ago
Chris Marchesi	77bafcab71	internal/servers/worker: actually return when aborting closeConnections (#1371) ... This adds a return when aborting from closeConnections, which should have happened as a part of #1369. Note that it's currently inconsequential that it's not happening right now, save some misleading log entries. setCloseTimeForResponse will effectively no-op on empty or nil input maps.	5 years ago
Chris Marchesi	48e55f156a	worker: ensure connections are closed in local state on controller fail (#1369) ... This backports some test work that is being added in #1340 to assert that the worker is actually marking connections closed in its *local* state on a failure to contact the controller. This was missed in #1357 during some late-stage refactoring. Summary of the changes: * If we can't actually contact the controller during connection closure to mark the connections as closed, we actually construct a "fake" response that just simply includes a closed state for all connections requested. This is then used to update the local connection state. * Added a 3 second timeout to the CloseConnection request to the controller to ensure the call to close connections completed in a timely manner and did not hang indefinitely. Testing enhancements: * Added a new helper in TestHelper called LookupSession that allows the lookup of a session from the worker's internal session state. * This is used in the new ExpectConnectionStateOnWorker check in the E2E test, which is part of a larger amount of enhancements to the E2E test that are coming in #1340. * Added a ConnectionStatusFromProtoVal helper function to the session package to allow the conversion of protobuf connection status values to their higher-level counterparts; essentially it is a reverse of ConnectionStatus.ProtoVal. This is used in some of our tests (with more coming in #1340) to just help with keeping things more idiomatic. Finally, there is some minor error refactoring, and we also change the timeout on internal status and connection close requests to the controller to 5 seconds.	5 years ago
Jim	b3a74584ca	Add WriteSysEvent to the events package. (#1360)	5 years ago
Jeff Mitchell	db269c968d	Use database time for liveness calculation (#1368)	5 years ago
Susmitha Girumala	7f9bc768a0	Bump admin ui version to latest (#1365)	5 years ago
Jeff Mitchell	96d11410c4	Actually use the right password	5 years ago
Jeff Mitchell	36036e5d9c	Update help text from test	5 years ago
Jeff Mitchell	14c7993c2c	Rework single-value set-credentials-library logic (#1364)	5 years ago
Todd Knight	13a65052b4	Allow set-credential-library when a single library id is provided. (#1363)	5 years ago
Jim	3820503979	"make fmt" updates	5 years ago
Chris Marchesi	9f9acce972	[Merge to main] internal/servers/worker: Controller failure connection cleanup (#1330) (#1357) ... This commit adds some rudimentary functionality for cleaning up connections on controller failure, or more specifically, a failure to communicate with the controllers. In this scenario, when a status cannot be sent for any reason for longer than 30 seconds, the worker will close all connections that are normally not cleaned up (so for sessions that currently are *not* in the progress of being canceled or terminated). Status requests now time out after 10 seconds if they are not made successfully. Session status is not touched during this process, but natural cleanup or connectionless sessions will still occur. This should be okay, as the session should be added on re-connect if need be. A few other changes are made to cancelConnections: first, error logging has been moved to the function so that we can handle errors requesting cancellation directly within the function; this entails simply just locally marking these connections as closed with a warning. Second, there was a minor logging bug where closed connections were not properly being noted in the last trace log, this has been fixed. Additional changes: * Circle: Set acceptance test no_output_timeout to 30m	5 years ago
Randall Morey	2b4155d01e	chore: bump UI version (#1361)	5 years ago
Lars Lehtonen	c0640d4fee	internal/credential/vault: fix dropped error (#1359)	5 years ago
Louis Ruch	26a0303b38	Add sentinel and sanitize package (#1353) ... * Add sentinel migrations * Add sentinel and sanitize package	5 years ago
Jeff Mitchell	86c9a90554	Update target credential library service, API, SDK, CLI (#1343)	5 years ago
Todd Knight	6766704687	Move setting worker as active closer to AuthorizeSession in the hopes that the liveness period doesn't pass before the AuthorizeSession can be called. (#1348)	5 years ago
s-christoff	39d54803be	Remove dep (#1346)	5 years ago
Louis Ruch	2def804bdb	Update unique error (#1344)	5 years ago
Michael Gaffney	df35699c4e	Integrate with Vault to retrieve and manage per session credentials (#1308) ... * Fix down migrations * Udpates due to merge * Sentinel values only have to be greater than 0 * Create credential related sdk structs and methods. * Post merge interface updating. * Removing scratch code that was not cleaned up. * updates * Convert client certificate and client certificate keys into pem blocks and validate. * Add newline at end of file. * Faster check for "s" at the end of a resource name when generating from templates. * make fmt * updates * Add dynamic credentials to a session * Refactor: move contents of file * updates * Updates * Add InvalidDynamicCredential error * Assign credentials * Allow updating client certificates seperate from the client certificate key. * Replace application purpose string with enum value * PR feedback / fix go test . * Delete dead code * Use common view * Refactor: extract interface and rename method * Refactor: move code to eliminate privPurpLibrary * Add comment to requestMap * Refactor: do not export methods on an unexported struct * Update internal/db/schema/migrations/postgres/10/03_vault_credential.up.sql Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Add comments to credential Purpose constants * Reorder switch statements to handle errors first * PR feedback * update * fix merge * Organizing the scheduler code and extract the individual store creation test helper function. * Run 'make fmt' * Create certificate when creating store. Allow vault address to be passed in as option * Refactor: rename database views and associated structs This change renames two database views and associated go structs to use a consistent naming pattern. Views ending in 'private' contain encrypted credentials needed for connecting to Vault. Views ending in 'public' mirror the 'private' views but do not include any encrypted values. This change does not include any changes to functionality or behavior. * Adding SAD target operations for credential libraries to the SDK. * Add status field and enumeration table for credential status * Refactor: rename Status to TokenStatus * Add status to vault credentials * Creating the template for the CLI and helper functions. * Add private database view for vault credentials * Add scope_id to view and cleanup TODO comment * Reformat embedded sql queries * Add vault client helpers * updates * white space * Add LookupLease test * CLI commands for Store work. Renamed fields in proto w/ vault prefix. * Test issue credentials with client TLS * Add additional checks to vault ping * Add an error for vault token capabilities and create a VaultToken error kind * Add support for working with Vault policies * Use Vault 1.7.2 for testing * Add testing helper for creating a vault client with a non-root token * Fix Vault renew lease test The Vault renew lease endpoint accepts an optional duration parameter for requesting the number of seconds to extend the lease by. However, Vault is not required to honor this request. * Add a var for the required capabilities of a boundary Vault token * Enhance the test helper for adding a policy to Vault * Allow the test role in postgresql to revoke credentials * Remove out of date comments * Enhance Vault test helpers for the database secrets engine * Reformat comments * Add a method for getting the capabilities of the current Vault token * Add revoke lease to internal Vault client * Reformat: combine err return line with check for nil line * Remove redundant checks in test code Remove checks in test code that are redundant with checks in the test harness. * Refactor CreateToken test helper to return the secret and the token * Fix build failures caused by signature change in vault.CreateToken * Fix Vault version and Vault API link in comments * ran `make gen` after merging from mgaffney-vault. * Remove Vault prefix from attribute fields in API, create a base CLI option for adding field prefixes. format now uses that prefix for error reporting. * Template now allows attaching attribute field prefixes. * Credential store uses PrefixAttributeFieldErrorsWithSubactionPrefix. * Fixing naming of vault flags and helper flags. * Updating more references to generated api methods. * Make the capabilities String method more readable * Add comment outlining PrintApiError usage of Options. * Refactor test to move declarations closer to first use * Fix comment * Implement revoke method on vault repository * Tests now verify certs, CA, and tokens, addresses can be updated in a store. * Added test for creating store with pk/cert in same field. * Allo updating certificates seperate from private key. Only contact backing vault service when updating token. * Fixing bad tests and removing unused code. * Adding tests for various ways of updating tokens. * Add private credential * Add token revocation job and cred renewal/revocation job * Regen after merge. * Fixing field mask related merge error. * Create Library CLI. Removes vault prefix from path. Adds a WithoutCleanup testOption for vault. * Set all credentials to revoked when a token is revoked * Fixing missed renaming update. * fix copy/paste error. * Fixing code generation errors after merge. * make gen after merge. * Update internal/cmd/commands/credentialstorescmd/vault_funcs.go Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Update internal/cmd/commands/credentialstorescmd/vault_funcs.go Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Update internal/cmd/commands/credentialstorescmd/vault_funcs.go Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> * Refactor: move migrations from 10 to 12 * Removing logic from transaction. * wrapping client errors in the calling op for CredentialStore's client() method. * Redact token * redact client key * updates * Add trigger to revoke credentials when session is canceled or terminated * Fixing some help text for some flags. * Add ability to load values from files (file://) or environment variables (env://). * Updating comments * fix bad merge * feedback * Adding issued credentials to sessions. * Error on capabilities * updates * Expose NewVaulTestServer * Add godoc * Adding generated SessionCredential struct for API. * Progress on building handler test for Authorize Session. * feedback * Update policies * Add 'revoke' as a status for Vault Tokens * Add delete_time to vault credential store * Create dynamic credentials at session creation time. * Tests pass with credentials attached to AuthorizedSession result. * Only call issue if there are credentials to issue. * Fixing output only issues. Adding type to credential library. * Fix test to clear un/pw generated. confirm generated un/pw changes from 1 authorize session call to another. * Update lookupTokenError * Add delete_time to private credential store * Refactor: move private store to separate file * Fixing tests for AuthorizeSession and verifying error cases. * Only create the credential repo if there are credentials to issue. * Rename Library field to CredentialLibrary. * Fixing missing change of Library to CredentialLibrary. * Removing Default SDK functions for fields which are required and update CLI to match. * Replace resource specific id variables with "id" and the input parmater for paths to be just a single string and the resource name as it should show up in the path. * Soft delete vault credential stores * Prevent new SQL functions from silently overwriting existing functions * Rename "Hmac" to "HMAC" in the human readable cli response table. * Fix tests * Add vault database cleanup jobs * Add ability to set the token period in the vault test harness * updates * Add not_null_columns func test * remove unused struct * Up no output timeout * Validate current vault token on addr update * Fix client cert change test * add cert test * Update revocation job where * Fix comment * Use Vault's default port in CLI help strings * Remove down migrations * Increase migration file numbers by 1 * Run make migrations * Move migrations from 12 to 10 * Increase Circle CI timeout for acceptance tests * Fix spelling mistake in error messages * ASD cmds for Target and returning credentials to AuthSession request (#1338) * Add Add/Set/Remove commands for libraries on Targets. Return credentials on AuthorizeSession request. Co-authored-by: Michael Gaffney <mgaffney@users.noreply.github.com> Co-authored-by: Louis Ruch <louisruch@gmail.com> Co-authored-by: Todd Knight <T.Alan.Knight@gmail.com> Co-authored-by: Jeff Mitchell <jeffrey.mitchell@gmail.com>	5 years ago
s-christoff	d143f398c0	Change error packages for events (#1339)	5 years ago
Louis Ruch	054549d81e	Allow where without args in searchWhere (#1333) ... * Allow where without args in searchWhere	5 years ago
Louis Ruch	466219f109	Add gostringer to client_secret (#1315)	5 years ago
Louis Ruch	8e4323c31c	Scheduler run jobs failure (#1310) ... * Drop wt_private_id from job table * Add server id len constraint on job_run table	5 years ago
Jeff Mitchell	9c945b7021	Migrate ParseAddress to shared-secure-libs (#1313)	5 years ago
Todd Knight	3175996e29	Have account_claim_maps be deterministically ordered in test comparisons. (#1318)	5 years ago
Louis Ruch	649ed32504	Scheduler updates (#1311) ... * Scheduler updates * Add convenience methods to db/timestamp.Timestamp * Remove recursive loop Co-authored-by: Michael Gaffney <mike@gaffney.cc>	5 years ago
Jim Lambert	aa41676dc9	make gen changes prior to staging release	5 years ago
Jeff Mitchell	e958a77280	Merge remote-tracking branch 'origin/main' into ICU-1573	5 years ago
Randall Morey	5c5678cd39	chore: bump UI version to include OIDC CRUD (#1280) ... * chore: bump UI version to include OIDC CRUD * chore: bump ui version again	5 years ago
Jeff Mitchell	054c0aa538	Update password generated account IDs (#1290)	5 years ago
Jeff Mitchell	4d27b58d2d	Add managed groups test (#1289)	5 years ago
Jeff Mitchell	d6ef2732e7	Merge remote-tracking branch 'origin/main' into ICU-1573	5 years ago
Jeff Mitchell	b513f21153	Add test for GrantsForUser (#1287) ... * Start of test * Add a test for existing GrantsForUser functionality. The test has randomization built in to allocate users across groups and both users and groups across roles. It tracks which users and groups have been assigned to which roles, then ensures that GrantsForUser returns the correct set of roles for a given user. This required modifying the CTE in GrantsForUser to return role_id as well. This doesn't test managed groups yet, that will come in a follow-on PR.	5 years ago
Jim	1b980a0a0e	align directory name with pkg name (#1284)	5 years ago
Naohisa Murakami	237590831b	Fix comment in template for cli (#1281)	5 years ago
Jim	cc2c71a261	base types for events package (#1275)	5 years ago
Jim	465c8c9036	stop panicing because the issuer port is invalid. (#1282)	5 years ago
Jeff Mitchell	9ecc384007	Add managed group support to role principals (#1270)	5 years ago
Jeff Mitchell	ad93315b59	Add predictable account IDs in dev mode (#1271)	5 years ago
Jeff Mitchell	5c8a8c3998	Merge remote-tracking branch 'origin/main' into ICU-1573	5 years ago
Michael Gaffney	094bdcdd2b	protobuf: remove unused imports (#1267) ... This removes unused imports in the protobuf files which are reported as warnings by the protoc compiler.	5 years ago
Jeff Mitchell	9208d10936	Merge branch 'main' into ICU-1573	5 years ago
Jeff Mitchell	306d4fb4d3	Add API/CLI for managed groups (#1265)	5 years ago
Jeff Mitchell	179a49657e	Managed Groups service (#1262)	5 years ago
Todd Knight	4bd480c183	Fix field error message field name. (#1266)	5 years ago
Jim	6cfc1a7753	use a slice for claim maps so the order is deterministic (#1263)	5 years ago
Jeff Mitchell	6c9b9e948e	Add the bits to actually read filters and assign values to users (#1261)	5 years ago
Jeff Mitchell	4363a4084e	Add membership setting function (#1259)	5 years ago
Jeff Mitchell	7da892a054	Managed Groups OIDC Repo (#1254)	5 years ago
Jeff Mitchell	15bd1a5245	Add initial SQL for managed groups (#1253)	5 years ago
Jeff Mitchell	765829be6e	Update CORS to have an allowed_origin of `*` by default (#1249) ... * Update CORS to have an allowed_origin of `*` by default * Update changelog	5 years ago
Jeff Mitchell	a0c1f69ae2	Already-canceled sessions return 200 (#1243) ... If a session is already canceled or terminated, attempting to cancel it will return the current session state and a 200, instead of an error.	5 years ago
Jeff Mitchell	13545e3171	Revert "internal/cmd/config: allow explicit origin list w/implicit CORS toggle (#1247)" (#1248) ... This reverts commit 579fc621ec.	5 years ago
Chris Marchesi	579fc621ec	internal/cmd/config: allow explicit origin list w/implicit CORS toggle (#1247) ... This ensures that cors_allowed_origins can be set when cors_enabled is not explicitly specified and allowed to be its default (currently true). The current behavior is to clobber this value when cors_enabled is not explicitly set, ultimately setting it to the default of "serve://boundary" only.	5 years ago
Michele Degges	e0138ce286	Upgrade build node version & packagespec (#1237)	5 years ago
Jim	d9439fd32a	Revert "chore: bump UI version and add changelog entry (#1229)" (#1233) ... This reverts commit 8e0c3ea46f.	5 years ago
Randall Morey	8e0c3ea46f	chore: bump UI version and add changelog entry (#1229)	5 years ago
Michael Gaffney	21033a6174	Refactor: multiple rename to fix the spelling of subtype (#1227) ... The definition of 'subtype' is 'a secondary or subordinate type'. The 'T' should not be capitalized (unless it is referring to a type of submarine, which its not).	5 years ago
Jeff Mitchell	7ee8ddba6a	True up some spelling	5 years ago
Jeff Mitchell	b54be8ee9a	Add missing API-level state checks during session cancel (#1223) ... * Add missing API-level state checks during session cancel This validates it's not already canceled or in terminated state.	5 years ago
Jeff Mitchell	b47b71d26c	Refactor connection listing for tests (#1224)	5 years ago
Jeff Mitchell	6f34da8923	Add cleanup of dead connections no longer reported by a worker (#1220)	5 years ago
Michael Gaffney	0b5ac930ac	Fix godoc wording	5 years ago
Michael Gaffney	b8831b16f1	Fix some minor godoc problems	5 years ago
Jeff Mitchell	1ec0ba0a93	Migrate the server upsert query to use database time (#1214) ... * Migrate the server upsert query to use database time This ensures that we are using consistent ideas of time regardless of the local time on each worker (for this query). * Fix insert part of the upsert query	5 years ago
Alexey Dubkov	a33d1922a1	Fix cmd help for groups: rename user to member (#1212)	5 years ago
denniskniep	5ba8377106	Remove text in oidc command on json format (#1213) ... Fixes #1193 Fixes that the openid connect authenticate command formatted as json returns disturbing text. Therefore it can not be piped and parsed by another tool	5 years ago
Louis Ruch	feb5d7385d	Louis job scheduler (#1197) ... * Adds job repo * Adds scheduler * Adds plugin table which is a place holder for future expansion of the scheduler. Currently all jobs that are created are linked to the pi_system plugin which are jobs that are held in a local registeredJobs map populated at controller startup.	5 years ago
Jeff Mitchell	c22631fbca	Fix `boundary database init` respecting format flag (#1204) ... The output was ready for json format but the flag wasn't included.	5 years ago
Michael Gaffney	120b5e4c79	Run make migrations	5 years ago
Jeff Mitchell	22d5c88a0b	Add Output Fields support (#1192)	5 years ago
Michael Gaffney	88c3fdc043	Fix godoc spelling	5 years ago
Jim	c7bac26e1a	Fix a broken auth token test and support conditional tests for "versioned" releases. (#1195)	5 years ago
Jeff Mitchell	f32e7f9144	Add ability for the controller/worker name to be read from env/file (#1181)	5 years ago
Michael Gaffney	f130563da7	Run make fmt	5 years ago
Jim	2437cdcc8d	OIDC: add support for account claim maps (#1186)	5 years ago
Dylan Scott	4ae5003763	PR #1001: Postgres Connection Pooling Control (#1015)	5 years ago
s-christoff	9ceeb3bd65	Add -container-image flag (#1112)	5 years ago
Michael Gaffney	ecc9d6d649	Run make fmt	5 years ago
Michael Gaffney	95e5db3aa3	Fix godoc wording	5 years ago
Todd Knight	5d17bd9eec	Error on `boundary database migrate` if the db hasn't been initialized (#1184)	5 years ago