365 Commits (df913f596b796d32cfec217faef048e7d3c52875)

Author	SHA1	Message	Date
Adrien Delorme	731904d3d2	mapstructure-to-hcl2: use accessor for named types and not named type + go genrate + tests	6 years ago
Adrien Delorme	4b7132c87c	Merge remote-tracking branch 'origin/master' into sharing_info	6 years ago
Adrien Delorme	0785c2f6fc	build using HCL2 (#8423) ... This follows #8232 which added the code to generate the code required to parse HCL files for each packer component. All old config files of packer will keep on working the same. Packer takes one argument. When a directory is passed, all files in the folder with a name ending with “.pkr.hcl” or “.pkr.json” will be parsed using the HCL2 format. When a file ending with “.pkr.hcl” or “.pkr.json” is passed it will be parsed using the HCL2 format. For every other case; the old packer style will be used. ## 1. the hcl2template pkg can create a packer.Build from a set of HCL (v2) files I had to make the packer.coreBuild (which is our one and only packer.Build ) a public struct with public fields ## 2. Components interfaces get a new ConfigSpec Method to read a file from an HCL file. This is a breaking change for packer plugins. a packer component can be a: builder/provisioner/post-processor each component interface now gets a `ConfigSpec() hcldec.ObjectSpec` which allows packer to tell what is the layout of the hcl2 config meant to configure that specific component. This ObjectSpec is sent through the wire (RPC) and a cty.Value is now sent through the already existing configuration entrypoints: Provisioner.Prepare(raws ...interface{}) error Builder.Prepare(raws ...interface{}) ([]string, error) PostProcessor.Configure(raws ...interface{}) error close #1768 Example hcl files: ```hcl // file amazon-ebs-kms-key/run.pkr.hcl build { sources = [ "source.amazon-ebs.first", ] provisioner "shell" { inline = [ "sleep 5" ] } post-processor "shell-local" { inline = [ "sleep 5" ] } } // amazon-ebs-kms-key/source.pkr.hcl source "amazon-ebs" "first" { ami_name = "hcl2-test" region = "us-east-1" instance_type = "t2.micro" kms_key_id = "c729958f-c6ba-44cd-ab39-35ab68ce0a6c" encrypt_boot = true source_ami_filter { filters { virtualization-type = "hvm" name = "amzn-ami-hvm-????.??.?.????????-x86_64-gp2" root-device-type = "ebs" } most_recent = true owners = ["amazon"] } launch_block_device_mappings { device_name = "/dev/xvda" volume_size = 20 volume_type = "gp2" delete_on_termination = "true" } launch_block_device_mappings { device_name = "/dev/xvdf" volume_size = 500 volume_type = "gp2" delete_on_termination = true encrypted = true } ami_regions = ["eu-central-1"] run_tags { Name = "packer-solr-something" stack-name = "DevOps Tools" } communicator = "ssh" ssh_pty = true ssh_username = "ec2-user" associate_public_ip_address = true } ```	6 years ago
Megan Marsh	0f6d1beccf	add an extra string array to the Prepare() return values in the builder interfaces; this sets up the ability for builders to give the provisioners custom user-accessible build-time variables.	6 years ago
Oded Priva	5e81c6f44e	added the option to skip IAM instance profile validation (#8457)	6 years ago
Megan Marsh	818d9bb087	send to step run spot instance	7 years ago
Megan Marsh	67c3373107	enable no_ephemeral for spot devices, clean up ranging behavior, update docs	7 years ago
Megan Marsh	08e97ba4d8	generate code for no_ephemeral option	7 years ago
Megan Marsh	0e2bdc8be6	forcibly prevent ephemeral drives from being created in the amazon-ebs builder, when no_ephemeral is set	7 years ago
nywilken	f9f4726eff	builder/amazon/step_pre_validate: Add check for non-default VPCs ... Subnet information is only really needed when the specified `vpc_id` is not the default VPC for the region where the builder is being executed. This change uses the AWS API to determine if the VPC provided is a non-default VPC and only validates the existence of a `subnet_id` if a user has provided a non-default `vpc_id`. Tests after change ``` > make test TEST=./builder/amazon/... TESTARGS='-count=1 -v -run=TestStepPreValidate_checkVpc' ... === RUN TestStepPreValidate_checkVpc === RUN TestStepPreValidate_checkVpc/DefaultVpc === RUN TestStepPreValidate_checkVpc/NonDefaultVpcNoSubnet === RUN TestStepPreValidate_checkVpc/NonDefaultVpcWithSubnet === RUN TestStepPreValidate_checkVpc/SubnetWithNoVpc === RUN TestStepPreValidate_checkVpc/NoVpcInformation --- PASS: TestStepPreValidate_checkVpc (0.00s) --- PASS: TestStepPreValidate_checkVpc/DefaultVpc (0.00s) --- PASS: TestStepPreValidate_checkVpc/NonDefaultVpcNoSubnet (0.00s) --- PASS: TestStepPreValidate_checkVpc/NonDefaultVpcWithSubnet (0.00s) --- PASS: TestStepPreValidate_checkVpc/SubnetWithNoVpc (0.00s) --- PASS: TestStepPreValidate_checkVpc/NoVpcInformation (0.00s) PASS ... ```	7 years ago
Megan Marsh	dfa134cd98	ditch else statement for improved clarity	7 years ago
Megan Marsh	ce8bca349f	Update builder/amazon/ebs/step_create_ami.go ... Co-Authored-By: Adrien Delorme <azr@users.noreply.github.com>	7 years ago
Megan Marsh	a35ac0127e	fix bug in step_region_copy	7 years ago
Megan Marsh	5614f307fb	regerate code ... generate flat FlatPolicyDocument add PolicyDocument to generate command	7 years ago
Megan Marsh	d15f43e4eb	Merge pull request #8232 from hashicorp/artifact-tree ... HCL2 configs - part one	7 years ago
Bernard Baltrusaitis	8b83cca064	adding temporary instance profile document policy	7 years ago
Adrien Delorme	078ba7c8c3	commit old code generation tool ... for history	7 years ago
Megan Marsh	0cbd3ff0f3	make sure amazon builders respect ssh_host option	7 years ago
Adrien Delorme	3fe9d52e3f	Merge remote-tracking branch 'origin/master' into scrape_doc_to_builder_struct_config	7 years ago
Megan Marsh	1d9bba6fe3	change AMIEncryptBootVolume to trilean	7 years ago
Megan Marsh	1a6adadb89	convert EnableAMIENASupport to trilean in code	7 years ago
Adrien Delorme	4cb7c30987	Merge remote-tracking branch 'origin/master' into scrape_doc_to_builder_struct_config	7 years ago
Megan Marsh	54d2ad5028	refactored step_ami_region_copy to fix bugs and clarify assumptions; added more tests for that step. ... fix race condition caused by variable declaration outside of loop	7 years ago
Megan Marsh	6ad975f296	Revert "move SSHInterface/SSHIPVersion fields to communitator.Config struct" ... This reverts commit b0c09087a2.	7 years ago
Megan Marsh	c722afe707	stop calculating spot bids; amazon changed the way spot instances are priced to be stable rather than bid-based, so when user sets auto, we can just default to the ondemand price and know that they'll get the same price as everyone else bidding at that time.	7 years ago
Adrien Delorme	9f4c8fb321	document ebs builder using partials	7 years ago
Adrien Delorme	c696878d2e	aws block devices mapping: BlockDevices.Build -> BuildEC2BlockDeviceMappings()	7 years ago
Adrien Delorme	ff2e0298ba	simplify block devices utilisation by removing intermediary types	7 years ago
Megan Marsh	0d55bc46ee	add skip_save_build_region flag to fix naming conflicts when building for multiple regions	7 years ago
Adrien Delorme	8e857d64f1	aws: rewrap struct comments for documentation generation	7 years ago
Megan Marsh	708165eaa8	refactoring step_run_spot_instance and swapping out the calls to create a spot instance with a call to create a spot fleet of one, so that we can be more flexible with the instance type when desired	7 years ago
Megan Marsh	2c352cc681	add tests for step_ami_region_copy	7 years ago
Megan Marsh	ae3cf48f71	in ebs, don't clean up temporary amis from encryption step. that's handled in step_copy_ami now	7 years ago
Megan Marsh	105d3f8853	delete unencrypted temporary snapshot when encrypt_boot is true. Also, fix nil map error in region copy	7 years ago
Megan Marsh	201c8c1332	make sure that you encrypt using the provided kms key id and not the default	7 years ago
Adrien Delorme	a4bf94dd3c	change Builder to be passed a context for cancellation ... we have to to give it to our hook	7 years ago
Akshat Mahajan	f07e4214cc	Addresses issues #5384, #5494: Rename and change `temporary_security_group_source_cidr` ... to accept a list of strings (for Amazon builders). Per this change, `temporary_security_group_source_cidr` in the configuration: 1. Will be renamed to `temporary_security_group_source_cidrs`. 2. Will accept a list of CIDRs. 3. Will have its documentation updated to reflect this change. 4. Will have a fixer attached for newer templates to avail of.	7 years ago
Adrien Delorme	9f82b75e57	Use the hashicorp/go-getter to download files ... * removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same. * removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context. * on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors. * added unit tests for step_download that are now CI tested on windows, mac & linux. * files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension` * since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted. * a download file is protected and locked by a file lock, * updated docs * updated go modules and vendors	7 years ago
Megan Marsh	3ed9fe6dee	remove unused imports ... remove HttpClientWithEnvironmentProxy from amazon builders; let access config handle it	7 years ago
Megan Marsh	0ed57a37a3	dont overwrite session config in ebs builder	7 years ago
Megan Marsh	ec3b0a5138	fix conflict from mergeing too many things to master at once	7 years ago
Megan Marsh	9d2b06bd61	Merge pull request #7342 from hashicorp/fix_7316 ... swap region copy and encryption steps	7 years ago
Adrien Delorme	f03cbd8a10	aws: allow to pass nil bool as encryption parameter ... to retain current encryption settings this changes the fields : * ami_config.encrypt_boot * block_device.encrypted This also removes StepCreateEncryptedAMICopy as this step is now done in StepAMIRegionCopy	7 years ago
Megan Marsh	3b726e66c1	swap region copy and encryption steps	7 years ago
Megan Marsh	3704a053d0	move region validation and credential wait into step pre validate	7 years ago
Megan Marsh	035c3506ba	manually set proxyfromenvironment in default http client for ec2 sessions	7 years ago
Megan Marsh	fbb3d526e3	move region validation to run so that we don't break validation when we don't have aws creds set	8 years ago
Megan Marsh	9573013d3a	Merge pull request #6872 from aspectcapital/disable-ena-support ... Add support to explicitly disable ENA support	8 years ago
Matt Dainty	feb8067c7d	Convert `ena_support` to a pointer ... This means it now has three states, `true`, `false`, & `nil`. The default state is now `nil` which does nothing instead of `false` which now will explicitly disable ENA support instead of just not enabling it.	8 years ago
Megan Marsh	57f87f58b9	Merge pull request #6374 from rickard-von-essen/aws-filters ... builder/amazon: Add suppport for vpc_filter, subnet_filter, and security_group_filter	8 years ago
Adrien Delorme	22d3e9b5c4	builder/amazon/ebs: pass config as a pointer so values could be populated by a run	8 years ago
Matthew Hooker	9181570bc3	remove stray struct dumps in logs	8 years ago
Megan Marsh	79093da6ad	skip region validation in tests that don't care; refactor Prepare func so we can test region validation logic with a mock	8 years ago
Megan Marsh	38cc525ec7	new option allowing user to clean up the ephemeral ssh key from the authorized_keys file	8 years ago
Adrien Delorme	2e73ed8d46	pass Comm instance to fix Spot instance creation	8 years ago
Adrien Delorme	e02d0dacc4	Merge branch 'master' into aws-filters	8 years ago
Megan Marsh	b94e6e913e	Merge pull request #6670 from sargun/fix-ena-on-pv ... Allow users to build hvm images from pv images to have ena_support	8 years ago
Adrien Delorme	b80e1d51c6	aws: when building an AMI with 'encrypt_boot: true', randomize the name of the temporary AMI	8 years ago
Sargun Dhillon	902497d6ce	Allow users to build hvm images from pv images to have ena_support	8 years ago
RenaudS	26aab49aaf	aws spot instances: add block_duration_minutes option (#6638) ... * Add block_duration_minutes option * int64 cannot be nil * Update doc * Fix formating	8 years ago
Adrien Delorme	df9e756865	pass the Comm instance to the amazon ebs builders steps	8 years ago
Adrien Delorme	b0c09087a2	move SSHInterface/SSHIPVersion fields to communitator.Config struct	8 years ago
Adrien Delorme	ef4ca9c48e	builder.amazon: use c.Comm for ssh	8 years ago
Adrien Delorme	293c485372	builder.aws: use SSHAgentAuth from Comm	8 years ago
Adrien Delorme	ef08c441c9	builder.aws: use Comm field for StepKeyPair & StepGetPassword	8 years ago
Adrien Delorme	51d2aac9f6	SSHPrivateKey => SSHPrivateKeyFile	8 years ago
Matthew Hooker	e41e99954d	go 1.11 format rules	8 years ago
Rickard von Essen	533967cb66	builder/amazon: Add suppport for security_group_filter ... Allow selecting SG's using a filter. Also some cleanup of vpc_filter and subnet_filter.	8 years ago
Megan Marsh	340363a649	Merge pull request #6613 from hashicorp/merge_ssh_config_funcs ... Merge ssh config funcs from builders	8 years ago
Rickard von Essen	9840862757	builder/amazon: Add suppport for vpc_filter and subnet_filter ... First step of adding support for discovering VPC's and Subnets using filters.	8 years ago
Adrien Delorme	41f6e0334d	refactor all copy pasted sshConfig with into communicator.Config.SSHConfigFunc ... * still need to append the auth methods into an array for gracefullness	8 years ago
Megan Marsh	ff6a039d5b	replace scrubconfig with packer.LogSecretFilter.Set ... filter winrm password from logs Add new root-level packer template option, sensitive-variables, to tell us what user variables to mark sensitive.	8 years ago
Matthew Hooker	31fcfe4bc2	PoC for filtering logs	8 years ago
Anshul Sharma	c1edcd3774	amazon-ebssurrogate clean up volumes	8 years ago
James Nugent	9fffe4056e	Merge pull request #5452 from smaato/tag-spot-requests ... Enable tagging of spot requests	8 years ago
Megan Marsh	f49a2d8aed	move UI call to before the wait; add context to these steps	8 years ago
Megan Marsh	cf63dd10bf	replace AMIStateRefreshFunc, InstanceStateRefreshFunc, our spot instance waiter, our chroot volume waiter, and our snapshot waiters with waiters form AWS's SDK.	8 years ago
Mark Meyer	3dbf1cb371	Enable tagging of spot requests ... This adds a new parameter to the EBS builders named `spot_tags'. This parameter accepts a map of tags, much like `tags'. These tags will be applied to a spot request that is created. Improve visibility.	8 years ago
DanHam	d5304a25e9	Pass T2 Unlimited settings to run instance step for appropriate EC2 builders	8 years ago
Matthew Hooker	0521efa200	correctly log reason waiting for ami failed.	8 years ago
AlessioT	3d4c7d0df1	Feature Request: Log reason why AMI creation failed	8 years ago
AlessioT	373226e9c5	Extract state reason for failure	8 years ago
AlessioT	09bb21774d	alessio.tomasino@yahoo.co.uk	8 years ago
AlessioT	c27f3e9445	alessio.tomasino@yahoo.co.uk	8 years ago
Megan Marsh	3afb243f11	use build name to ensure that winrm password and other shared state is not overwritten if two builders need the password in the same packer run.	8 years ago
Matthew Hooker	21812fa17f	Add volume and run tags if in us-gov/china ... We can't tag on instance creation when we're in "restricted" regions, so let's add the tags after the resources have been created. Adds methods to AccessConfig to detect if we're in China or US Gov regions (i.e. "restricted"). Also turns tag:tag maps into a type, and moves methods around validating and converting them to ec2Tags to methods of the type.	8 years ago
Matthew Hooker	7a189a83a1	fix imports ... `find . -type f -name '*.go' -not -path "./vendor/*" -exec goimports -w {} \;`	8 years ago
Matthew Hooker	a831d522be	change run signatures ... Run now takes a context as well as a statebag. We'll assign the context to the blank identifier to prevent namespace collisions. We'll let the step authors opt-in to using the context. `find . -iname "step_*.go" -exec gsed -i'' 's/func \(.*\)Run(/func \1Run(_ context.Context, /' {} \;`	8 years ago
Matthew Hooker	366dc3da0a	move multistep imports to helper. ... gomvpkg -from "github.com/mitchellh/multistep" -to "github.com/hashicorp/packer/helper/multistep"	8 years ago
Matthew Hooker	dfd5f07145	fix ebs acc test	8 years ago
Matthew Hooker	f3dea272d9	Set session in state bag ... We can construct connections to arbitrary regions from it	8 years ago
Matthew Hooker	f6c401a143	don't pass in accessconfig	8 years ago
Rong Chen	3e92b1374e	issue5606: follow the convention to use AccessConfig to create new aws session for step_create_tags etc.	8 years ago
Rickard von Essen	63f791570a	Merge pull request #5665 from kwilczynski/remove-sts-token-from-logging ... amazon: Remove Session Token (STS) from being shown in the log.	8 years ago
Matthew Hooker	f216330ba3	spot instance ena/sriov checking for all other builders	8 years ago
Matthew Hooker	4b1d8e3fe8	don't allow enhanced networking flags for spot instances.	8 years ago
Krzysztof Wilczynski	05327b7524	amazon: Remove Session Token (STS) from being shown in the log. ... This commit adds a change which ensures that the Session Token config struct item is removed from log output. Signed-off-by: Krzysztof Wilczynski <kw@linux.com>	9 years ago
John Davies-Colley	707ec675b2	ssh interface for amazon builders 🔨	9 years ago
Matthew Hooker	95e4ae251e	WIP	9 years ago
Matthew Hooker	c65fa8490d	fix various bugs deregistering AMIs ... always deregister ami in session region validate that session region does not appear in ami_regions	9 years ago