packer

Commit Graph

Author	SHA1	Message	Date
nywilken	d2a9e6b32e	Format code with `gofmt -s -w`	6 years ago
Sylvia Moss	0b7251a4bb	Share .Device and .MountPath between builders, provisioners and post-processors (#8621 )	6 years ago
Adrien Delorme	731904d3d2	mapstructure-to-hcl2: use accessor for named types and not named type + go genrate + tests	6 years ago
Adrien Delorme	4b7132c87c	Merge remote-tracking branch 'origin/master' into sharing_info	6 years ago
Adrien Delorme	0785c2f6fc	build using HCL2 (#8423 ) This follows #8232 which added the code to generate the code required to parse HCL files for each packer component. All old config files of packer will keep on working the same. Packer takes one argument. When a directory is passed, all files in the folder with a name ending with “.pkr.hcl” or “.pkr.json” will be parsed using the HCL2 format. When a file ending with “.pkr.hcl” or “.pkr.json” is passed it will be parsed using the HCL2 format. For every other case; the old packer style will be used. ## 1. the hcl2template pkg can create a packer.Build from a set of HCL (v2) files I had to make the packer.coreBuild (which is our one and only packer.Build ) a public struct with public fields ## 2. Components interfaces get a new ConfigSpec Method to read a file from an HCL file. This is a breaking change for packer plugins. a packer component can be a: builder/provisioner/post-processor each component interface now gets a `ConfigSpec() hcldec.ObjectSpec` which allows packer to tell what is the layout of the hcl2 config meant to configure that specific component. This ObjectSpec is sent through the wire (RPC) and a cty.Value is now sent through the already existing configuration entrypoints: Provisioner.Prepare(raws ...interface{}) error Builder.Prepare(raws ...interface{}) ([]string, error) PostProcessor.Configure(raws ...interface{}) error close #1768 Example hcl files: ```hcl // file amazon-ebs-kms-key/run.pkr.hcl build { sources = [ "source.amazon-ebs.first", ] provisioner "shell" { inline = [ "sleep 5" ] } post-processor "shell-local" { inline = [ "sleep 5" ] } } // amazon-ebs-kms-key/source.pkr.hcl source "amazon-ebs" "first" { ami_name = "hcl2-test" region = "us-east-1" instance_type = "t2.micro" kms_key_id = "c729958f-c6ba-44cd-ab39-35ab68ce0a6c" encrypt_boot = true source_ami_filter { filters { virtualization-type = "hvm" name = "amzn-ami-hvm-????.??.?.????????-x86_64-gp2" root-device-type = "ebs" } most_recent = true owners = ["amazon"] } launch_block_device_mappings { device_name = "/dev/xvda" volume_size = 20 volume_type = "gp2" delete_on_termination = "true" } launch_block_device_mappings { device_name = "/dev/xvdf" volume_size = 500 volume_type = "gp2" delete_on_termination = true encrypted = true } ami_regions = ["eu-central-1"] run_tags { Name = "packer-solr-something" stack-name = "DevOps Tools" } communicator = "ssh" ssh_pty = true ssh_username = "ec2-user" associate_public_ip_address = true } ```	6 years ago
Megan Marsh	0f6d1beccf	add an extra string array to the Prepare() return values in the builder interfaces; this sets up the ability for builders to give the provisioners custom user-accessible build-time variables.	6 years ago
Megan Marsh	fcda07ee6a	clarify docs by removing unclear string (#8439 ) the docs generator from code PR #7724 mis scrapped it	6 years ago
Paul Meyer	3be7d81ce2	Move common steps together	7 years ago
Paul Meyer	e6dfe301ac	Move CommandWrapper & ShellCommand to common	7 years ago
Adrien Delorme	cf1555bf17	Merge remote-tracking branch 'origin/master' into artifact-tree	7 years ago
Paul Meyer	977ca5be1c	Add StepCopyFiles and StepChrootProvision	7 years ago
Paul Meyer	9a3e6661b1	Add StepMountExtra	7 years ago
Paul Meyer	addbdedea9	Add StepPostMountCommands	7 years ago
Paul Meyer	4d750ddefa	Reuse amazon/chroot/step_pre_mount_commands.go	7 years ago
Adrien Delorme	078ba7c8c3	commit old code generation tool for history	7 years ago
Adrien Delorme	8b8c2fc138	builder.amazon.chroot: remove specific BlockDevice definition because the common one already has a KmsKeyId field	7 years ago
Megan Marsh	2e20facc8b	fix tests	7 years ago
Megan Marsh	e283023d9b	make sure step_register_ami in chroot builder respects encryption and ami skip build retion values once the copy happens	7 years ago
Adrien Delorme	792f61a4ad	fmt	7 years ago
Adrien Delorme	3fe9d52e3f	Merge remote-tracking branch 'origin/master' into scrape_doc_to_builder_struct_config	7 years ago
Adrien Delorme	9d0bc476d9	add ommited struct interpolation after `dcc22df609`	7 years ago
Adrien Delorme	5517d41468	make sure all documentation fields are there * add missing `temporary_key_pair_name` field for alicloud * add missing description to `vpc_filter` for aws * add missing ssh communicator fields for aws * add links for aws * update vmware-vmx docs * manually describe AMI Configuration section for ebsvolume * display missing required ami_name field for aws * add missing fields for docker * add missing fields for openstack	7 years ago
Megan Marsh	1a6adadb89	convert EnableAMIENASupport to trilean in code	7 years ago
Adrien Delorme	02421bad33	simplify BlockDevice prepares	7 years ago
Adrien Delorme	a476ab79d7	document chroot builder using partials	7 years ago
Adrien Delorme	dcc22df609	aws: move the OmitFromArtifact field in ebssurrogat where it's being used also, simplified a bit the usage of block device	7 years ago
Adrien Delorme	a86aae1c7e	mode KmsKeyId to chroot block device, as it's only used there	7 years ago
Adrien Delorme	c696878d2e	aws block devices mapping: BlockDevices.Build -> BuildEC2BlockDeviceMappings()	7 years ago
Adrien Delorme	ff2e0298ba	simplify block devices utilisation by removing intermediary types	7 years ago
Adrien Delorme	e09f3fbd02	amazon: update docs & links	7 years ago
Adrien Delorme	e6cbb013ba	add // go:generate struct-markdown to all previously edited files	7 years ago
Adrien Delorme	f1917edd34	generate the comments for config struct of builders scraping doc website	7 years ago
Megan Marsh	2cfba56265	fix typos	7 years ago
Megan Marsh	02c9f24531	allow user to set architecture	7 years ago
Megan Marsh	2c352cc681	add tests for step_ami_region_copy	7 years ago
Megan Marsh	201c8c1332	make sure that you encrypt using the provided kms key id and not the default	7 years ago
Adrien Delorme	aee73d745d	update code after go mod update	7 years ago
Adrien Delorme	f555e7a9f2	allow a provisioner to timeout * I had to contextualise Communicator.Start and RemoteCmd.StartWithUi NOTE: Communicator.Start starts a RemoteCmd but RemoteCmd.StartWithUi will run the cmd and wait for a return, so I renamed StartWithUi to RunWithUi so that the intent is clearer. Ideally in the future RunWithUi will be named back to StartWithUi and the exit status or wait funcs of the command will allow to wait for a return. If you do so please read carrefully https://golang.org/pkg/os/exec/#Cmd.Stdout to avoid a deadlock * cmd.ExitStatus to cmd.ExitStatus() is now blocking to avoid race conditions * also had to simplify StartWithUi	7 years ago
Adrien Delorme	c4f3dccc14	rename interpolation context from ctx to ictx and contexts to ctx to avoid conflicts	7 years ago
Adrien Delorme	a4bf94dd3c	change Builder to be passed a context for cancellation we have to to give it to our hook	7 years ago
Adrien Delorme	9f82b75e57	Use the hashicorp/go-getter to download files * removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same. * removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context. * on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors. * added unit tests for step_download that are now CI tested on windows, mac & linux. * files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension` * since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted. * a download file is protected and locked by a file lock, * updated docs * updated go modules and vendors	7 years ago
Megan Marsh	0196d7f835	Merge pull request #7370 from sargun/allow-users-to-specify-custom-block-device-mapping amazon-chroot: Allow users to specify custom block device mapping	7 years ago
Megan Marsh	3ed9fe6dee	remove unused imports remove HttpClientWithEnvironmentProxy from amazon builders; let access config handle it	7 years ago
Sargun Dhillon	601e754438	amazon/chroot: Allow creating new block device mappings !not fromScratch Previously, when you built from an existing image, you were unable to reconfigure block device mappings, as it just took them and copied them over. This allows users to specify new, custom block device mappings, even when building from an existing image.	7 years ago
Megan Marsh	0abd16527e	Merge pull request #7337 from sargun/fix-chroot-builder Amazon-chroot: Fix building PV images and where mount_partition is set	7 years ago
Adrien Delorme	f03cbd8a10	aws: allow to pass nil bool as encryption parameter to retain current encryption settings this changes the fields : * ami_config.encrypt_boot * block_device.encrypted This also removes StepCreateEncryptedAMICopy as this step is now done in StepAMIRegionCopy	7 years ago
Sargun Dhillon	142a84ef43	amazon/chroot: Refactor step_register_ami for testing EBS-related behaviour There is some logic around how EBS mappings are handled / generated depending on whether an image if from scratch or not. There was no testing around this behaviour before. This strips that logic out into a separate function, to enable testing it independentlhy.	7 years ago
Sargun Dhillon	d3c65ee77d	builder/amazon/chroot: Fix building PV images with mount_partition Right now, if we have a source image that's PV, and try to build an image with mount_partition set to not 0, it does not get picked up. This is because under PV we only had a filesystem, not partitions, but you can convert a PV image to an HVM image during build time.	7 years ago
Megan Marsh	3704a053d0	move region validation and credential wait into step pre validate	7 years ago
Megan Marsh	035c3506ba	manually set proxyfromenvironment in default http client for ec2 sessions	7 years ago
Adrien Delorme	b7222d1f56	Add tmp package that offers Dir & File funcs this regroups the calls of tmp func calls into one package. the tmp pkg allows to store tmp files under a common directory for easier managment Squashed commit of the following: commit `74b674c015` Merge: `fc94b5714` `66001525d` Author: Matthew Patton <mpatton@enquizit.com> Date: Fri Nov 2 02:02:38 2018 -0400 Merge branch 'remove_TMPDIR_docs' of github.com:tb3088/packer into remove_TMPDIR_docs commit `fc94b57142` Author: Matthew Patton <mpatton@enquizit.com> Date: Fri Nov 2 01:42:38 2018 -0400 update tests to honor configured temporary directory commit `5a562359f4` Author: Matthew Patton <mpatton@enquizit.com> Date: Thu Nov 1 18:52:38 2018 -0400 sync straggler to refactor. implement tests at packer/configfile instead of buried in docker. commit `9d5a4a0935` Author: Matthew Patton <mpatton@enquizit.com> Date: Thu Nov 1 15:39:46 2018 -0400 insert URL to GoLang API for os.TempDir() commit `fbae4c2e05` Author: Matthew Patton <mpatton@enquizit.com> Date: Thu Nov 1 07:41:29 2018 -0400 revise documentation to match code commit `3590fae8bd` Author: Matthew Patton <mpatton@enquizit.com> Date: Thu Nov 1 07:21:59 2018 -0400 refacter config_file. replace all hard-coded os.TempDir with wrapper commit `d5c5306a97` Author: Matthew Patton <mpatton@enquizit.com> Date: Wed Oct 31 20:11:36 2018 -0400 close massive file overwrite hole with TempDir commit `0a72297da8` Author: Matthew Patton <mpatton@enquizit.com> Date: Wed Oct 31 01:06:00 2018 -0400 adjust var declaration scope commit `20f68228b6` Author: Matthew Patton <mpatton@enquizit.com> Date: Wed Oct 31 00:54:35 2018 -0400 use mktemp() equivalent to create temporary directory commit `c73ebe3d83` Author: Matthew Patton <mpatton@enquizit.com> Date: Tue Oct 30 20:40:58 2018 -0400 remove extraneous variable declaration, fix FOR loop commit `63549b8bd7` Author: Matthew Patton <mpatton@enquizit.com> Date: Tue Oct 30 19:30:44 2018 -0400 match styistic convension with rest of docs commit `9761010749` Author: Matthew Patton <mpatton@enquizit.com> Date: Tue Oct 30 19:08:39 2018 -0400 revert dangling config file change commit `95159afbc0` Author: Matthew Patton <matthew.patton@itgfirm.com> Date: Fri Dec 29 23:53:43 2017 -0500 replace invalid TMPDIR variable wth PACKER_TMP_DIR. update ConfigTmpDir() to try common temporary paths first and only write to configDir() as a last resort. commit `66001525d7` Author: Matthew Patton <mpatton@enquizit.com> Date: Fri Nov 2 01:42:38 2018 -0400 update tests to honor configured temporary directory commit `e9b6adefea` Author: Matthew Patton <mpatton@enquizit.com> Date: Thu Nov 1 18:52:38 2018 -0400 sync straggler to refactor. implement tests at packer/configfile instead of buried in docker. commit `852113ed07` Author: Matthew Patton <mpatton@enquizit.com> Date: Thu Nov 1 15:39:46 2018 -0400 insert URL to GoLang API for os.TempDir() commit `54add38d1d` Author: Matthew Patton <mpatton@enquizit.com> Date: Thu Nov 1 07:41:29 2018 -0400 revise documentation to match code commit `6b5b8f6d4e` Author: Matthew Patton <mpatton@enquizit.com> Date: Thu Nov 1 07:21:59 2018 -0400 refacter config_file. replace all hard-coded os.TempDir with wrapper commit `c22092c601` Author: Matthew Patton <mpatton@enquizit.com> Date: Wed Oct 31 20:11:36 2018 -0400 close massive file overwrite hole with TempDir commit `7a73045091` Author: Matthew Patton <mpatton@enquizit.com> Date: Wed Oct 31 01:06:00 2018 -0400 adjust var declaration scope commit `0f2933adb6` Author: Matthew Patton <mpatton@enquizit.com> Date: Wed Oct 31 00:54:35 2018 -0400 use mktemp() equivalent to create temporary directory commit `d74839ede0` Author: Matthew Patton <mpatton@enquizit.com> Date: Tue Oct 30 20:40:58 2018 -0400 remove extraneous variable declaration, fix FOR loop commit `eb65416619` Author: Matthew Patton <mpatton@enquizit.com> Date: Tue Oct 30 19:30:44 2018 -0400 match styistic convension with rest of docs commit `acaa2b31ed` Author: Matthew Patton <mpatton@enquizit.com> Date: Tue Oct 30 19:08:39 2018 -0400 revert dangling config file change commit `e573fde668` Author: Matthew Patton <matthew.patton@itgfirm.com> Date: Fri Dec 29 23:53:43 2017 -0500 replace invalid TMPDIR variable wth PACKER_TMP_DIR. update ConfigTmpDir() to try common temporary paths first and only write to configDir() as a last resort. commit `39a9874afc` Merge: `8a413cfe8` `3315812c2` Author: Matthew Patton <mpatton@enquizit.com> Date: Tue Oct 30 18:19:26 2018 -0400 Merge branch 'master' of https://github.com/hashicorp/packer into prestine commit `8a413cfe83` Merge: `e07491de5` `4e14710a6` Author: Matthew Patton <mpatton@enquizit.com> Date: Mon Oct 1 20:18:10 2018 -0400 Merge remote-tracking branch 'upstream/master' into prestine commit `e07491de59` Merge: `42610a35d` `a1fa35dff` Author: Matthew Patton <mpatton@enquizit.com> Date: Tue Aug 21 13:26:19 2018 -0400 Merge remote-tracking branch 'upstream/master' into prestine commit `42610a35d5` Merge: `5298142da` `0d63cf7bc` Author: Matthew Patton <matthew.patton@itgfirm.com> Date: Tue Jun 19 22:45:05 2018 -0400 Merge remote-tracking branch 'upstream/master' into prestine commit `5298142da6` Merge: `7bb110bc7` `9d9736552` Author: Matthew Patton <mpatton@enquizit.com> Date: Mon Jun 11 15:10:09 2018 -0400 Merge remote-tracking branch 'upstream/master' into prestine commit `7bb110bc74` Merge: `a61c869ca` `6189d66e7` Author: Matthew Patton <matthew.patton@itgfirm.com> Date: Wed May 9 23:41:22 2018 -0400 Merge remote-tracking branch 'upstream/master' into prestine commit `a61c869ca7` Merge: `098101dd9` `4be5f072c` Author: Matthew Patton <matthew.patton@itgfirm.com> Date: Fri May 4 10:13:04 2018 -0400 Merge remote-tracking branch 'upstream/master' into prestine commit `098101dd99` Merge: `fefaf0fa6` `554b2b4a5` Author: Matthew Patton <matthew.patton@itgfirm.com> Date: Tue May 1 20:52:30 2018 -0400 Merge branch 'EOL-handling' into prestine Co-Authored-By: Matthew Patton <pattonme@yahoo.com>	7 years ago
Matt Dainty	feb8067c7d	Convert `ena_support` to a pointer This means it now has three states, `true`, `false`, & `nil`. The default state is now `nil` which does nothing instead of `false` which now will explicitly disable ENA support instead of just not enabling it.	8 years ago
Matthew Hooker	9181570bc3	remove stray struct dumps in logs	8 years ago
Megan Marsh	79093da6ad	skip region validation in tests that don't care; refactor Prepare func so we can test region validation logic with a mock	8 years ago
Megan Marsh	93f1155a14	remove test-related special casing	8 years ago
Sargun Dhillon	63d784023f	Add support to support non-gp2 volume types for building from_scratch	8 years ago
Sargun Dhillon	07ce820c70	Enable setting the volume type when building with the Amazon Chroot builder	8 years ago
Megan Marsh	b94e6e913e	Merge pull request #6670 from sargun/fix-ena-on-pv Allow users to build hvm images from pv images to have ena_support	8 years ago
Sargun Dhillon	902497d6ce	Allow users to build hvm images from pv images to have ena_support	8 years ago
Megan Marsh	e4f6b6f720	fix chroot communicator to properly escape quotes	8 years ago
Megan Marsh	ff6a039d5b	replace scrubconfig with packer.LogSecretFilter.Set filter winrm password from logs Add new root-level packer template option, sensitive-variables, to tell us what user variables to mark sensitive.	8 years ago
Anshul Sharma	885ecb0790	Issue-6309 Amazon Chroot Provider - Add tags on CreateVolume	8 years ago
Megan Marsh	f49a2d8aed	move UI call to before the wait; add context to these steps	8 years ago
Megan Marsh	cf63dd10bf	replace AMIStateRefreshFunc, InstanceStateRefreshFunc, our spot instance waiter, our chroot volume waiter, and our snapshot waiters with waiters form AWS's SDK.	8 years ago
Megan Marsh	87a93e84ac	sh -c to execute command to accomodate communicator change	8 years ago
M. Marsh	62e1323577	Merge pull request #5956 from hashicorp/dedupe_shell_local Deduplicate the code for the shell-local post-processor and shell-local provisioner	8 years ago
Megan Marsh	e670eed315	Add new option, nvme_device_path, so that we can properly mount nvme block devices.	8 years ago
Megan Marsh	6dc4b1cbdc	move all of the run commands for shell-local provisioner and postprocessor into common library too	8 years ago
Megan Marsh	616b41e58f	deduplicate the nearly identical communicators for the shell-local provisioner and post-processor, moving single communicator into a new common/shell-local module	8 years ago
Megan Marsh	59e3ec722d	allow user to mount entire block device in chroot builder	8 years ago
Matthew Hooker	21812fa17f	Add volume and run tags if in us-gov/china We can't tag on instance creation when we're in "restricted" regions, so let's add the tags after the resources have been created. Adds methods to AccessConfig to detect if we're in China or US Gov regions (i.e. "restricted"). Also turns tag:tag maps into a type, and moves methods around validating and converting them to ec2Tags to methods of the type.	8 years ago
Matthew Hooker	fad4d5c272	update tests for mapstructure behavior changes	8 years ago
Matthew Hooker	7a189a83a1	fix imports `find . -type f -name '.go' -not -path "./vendor/" -exec goimports -w {} \;`	8 years ago
Matthew Hooker	a831d522be	change run signatures Run now takes a context as well as a statebag. We'll assign the context to the blank identifier to prevent namespace collisions. We'll let the step authors opt-in to using the context. `find . -iname "step_.go" -exec gsed -i'' 's/func \(.\)Run(/func \1Run(_ context.Context, /' {} \;`	8 years ago
Matthew Hooker	366dc3da0a	move multistep imports to helper. gomvpkg -from "github.com/mitchellh/multistep" -to "github.com/hashicorp/packer/helper/multistep"	8 years ago
Matthew Hooker	ebe995c0ff	run goimports	8 years ago
Matthew Hooker	f3dea272d9	Set session in state bag We can construct connections to arbitrary regions from it	8 years ago
Matthew Hooker	f6c401a143	don't pass in accessconfig	8 years ago
Rong Chen	3e92b1374e	issue5606: follow the convention to use AccessConfig to create new aws session for step_create_tags etc.	8 years ago
Krzysztof Wilczynski	05327b7524	amazon: Remove Session Token (STS) from being shown in the log. This commit adds a change which ensures that the Session Token config struct item is removed from log output. Signed-off-by: Krzysztof Wilczynski <kw@linux.com>	9 years ago
Matthew Hooker	f681faa296	fix tests	9 years ago
Matthew Hooker	c65fa8490d	fix various bugs deregistering AMIs always deregister ami in session region validate that session region does not appear in ami_regions	9 years ago
Megan Marsh	85ad1f58fb	include ena_support and sriov_support in chroot and instance docs	9 years ago
Megan Marsh	2d4bc70d7b	use ami prefix to make it clear that these variables are amazon specific add fixer, fixer tests	9 years ago
Megan Marsh	9e2e467b31	Allow granular modification of sriov and ena enhanced networking options in amazon amis. Maintain old functionality.	9 years ago
Megan Marsh	7da52e1f77	Merge pull request #5250 from hashicorp/repro_3399 make force_deregister work in all regions, not just original region.	9 years ago
Megan Marsh	14b2d04332	make force_deregister work in all regions, not just original region.	9 years ago
Sean Chittenden	cd84b17923	Fix building packer on GOOS=solaris Update to golang/x/sys/unix is coming in the subsequent commit.	9 years ago
Megan Marsh	e9ec705497	use block device mappings to know whether a snapshot existed before packer's current run. If yes, don't delete the unencrypted snapshot.	9 years ago
Matthew Hooker	58e386827a	fix typo	9 years ago
Matthew Hooker	56c513088b	I think this was the intention	9 years ago
Rickard von Essen	3833d34829	builder/amazon: Cleaned up credential handeling This properly handles: - Preference between types of credential - Assume role via ECS Task Role	9 years ago
Megan Marsh	b8c2a5fd43	fix step initializer everywhere StepAMIRegionCopy is called	9 years ago
Matthew Hooker	81522dced0	move packer to hashicorp	9 years ago
Matthew Hooker	cc11ec3566	check for a couple errors	9 years ago
Matthew Hooker	d1b20b3d9c	remove a bunch of dead code. https://github.com/dominikh/go-tools/tree/master/cmd/unused	9 years ago
Matthew Hooker	230079f73a	spell fixes	9 years ago
Matthew Hooker	e4aa2a34ca	builder/amazon-chroot: nullable copy_files Allow users to specify that they don't want any files copied into the chroot by setting an empty copy_files list	9 years ago
Matthew Hooker	50d9546658	builder/amazon: set force_deregister to true on -force	9 years ago
Matthew Hooker	61976dfd86	Merge pull request #4578 from life360/enable_ena Always set both SRIOV and ENA when Enhanced Networking is enabled	9 years ago

1 2 3 4 5 ...

307 Commits (90fb09e52a2558c59eaf87a3adabcb3b59cd1d8d)