Matt Clay
fb9efd3c7e
Add `--remote-terminate` option to ansible-test.
...
Set `--remote-terminate success` for osx tests.
9 years ago
Matt Clay
b8cb3f519b
Detect and fix environment tampering in tests.
9 years ago
Matt Clay
e6934e42be
Update ansible-test change handling and CS plugin. ( #24395 )
...
* Use CloudStack simulator from Ansible repo.
* Recognize cloud specific ansible-test changes.
* Hide ansible-test cs notice in explain mode.
9 years ago
Matt Clay
0573b8bcd2
Fix ansible-test cloud integration bugs.
9 years ago
Matt Clay
ac72fd9d2c
Add missing return statements.
9 years ago
Matt Clay
201242f302
Fix call to wrong method in ansible-test.
9 years ago
Matt Clay
1582e9bf7d
Fix handling of Shippable env vars.
9 years ago
Matt Clay
a07d42e16d
Add support for cloud tests to ansible-test. ( #24315 )
...
* Split out ansible-test docker functions.
* Add cloud support to ansible-test.
9 years ago
Matt Clay
6522d703a1
Fix ansible-test pylint and pep8 issues. ( #24245 )
...
* Fix pylint useless-super-delegation issues.
* Fix miscellaneous pylint issues.
* Fix PEP 8 issues.
* Fix warnings reported by PyCharm.
9 years ago
Matt Clay
d662f6f0db
Fix bugs in ansible-test units command. ( #24044 )
...
* Handle old versions of coverage.
* Handle old versions of setuptools.
* Detect python version for docker/remote units.
* Add sanity override for test constraints.
9 years ago
Matt Clay
cb1f57d4e5
Add rstcheck to ansible-test and correct issues. ( #23550 )
...
* Add rstcheck to ansible-test.
* Fix rst code-block languages and syntax errors.
* Fix rst inline literals.
* Update python 2 code block to pass tests on py 3.
9 years ago
Matt Clay
92ad9a19b6
Fix ansible-test empty diff handling on Shippable.
9 years ago
Matt Clay
0cf1e8e061
Fix ansible-test handling of import/syntax errors.
9 years ago
Matt Clay
1daa69d685
Initial pylint support for ansible-test sanity.
9 years ago
Matt Clay
4fdeade389
Overhaul ansible-test import analysis. ( #22888 )
...
- Add support for module_utils packages for better organization.
- Add support for "virtual" module_utils packages such as `six`.
9 years ago
Matt Clay
042e387f27
Fix metadata handling for shell command. ( #22801 )
9 years ago
Matt Clay
991bf0a1c3
Fix ansible-test base branch handling on merge. ( #22759 )
9 years ago
Matt Clay
47887a2edd
Fix ansible-test base branch usage on Shippable.
9 years ago
Matt Clay
f7c83ccdc0
Fix ansible-test PR diff handling.
...
Permits use of PRs on branches other than devel.
9 years ago
Matt Clay
3a22467b38
Remove python 2.4 compile test.
9 years ago
Matt Clay
869449e288
Add test verification to ansible-test. ( #22636 )
...
* Add unified git diff parser.
* Add metadata and diff handling.
* Add test confidence/verification to bot output.
9 years ago
Matt Clay
5e9a2b8528
Verify SHA in Shippable change detection.
9 years ago
Matt Clay
89559f78de
Add `--failure-ok` option to `ansible-test`. ( #22623 )
9 years ago
Matt Clay
771b14acb2
Sort test messages for deterministic output. ( #22581 )
9 years ago
Matt Clay
cfd313bced
Disable ansible color output on sanity tests.
9 years ago
Matt Clay
3ab344e8bd
Use lint/junit output for compile test. ( #22395 )
...
* Refactor sanity classes for use in all tests.
* Use lint/junit output for compile test.
* Add missing options for compile test.
* Fix early bailout on requirements install.
9 years ago
Matt Clay
fbf55886ba
Use lint friendly output for python syntax checks. ( #22390 )
9 years ago
Matt Clay
8f463fcdd2
Create bot friendly sanity output. ( #22381 )
9 years ago
Matt Clay
3e4be156d7
Pre-compile regexes to speed up target processing.
...
Without this, changing a large number of files results in target
processing taking a very long time due to repeatedly compiling
the same patterns in a loop over many targets.
9 years ago
Matt Clay
d66ce40ecb
Overhaul `ansible-test sanity` implementation. ( #22177 )
...
- Tests are run to completion instead of stopping on first failure.
- Test results are now parsed instead of passing through to the console.
- Test results can be saved in junit xml format.
- Test results will show up on the Shippable "Tests" result tab.
- Added an experimental --lint option for easier integration with other tools.
- Code smell tests are now usable with the --list-tests, --test and --skip-test options.
- Code split out from executor.py into sanity.py.
- Rename download-logs to download.py and add support for test and coverage results.
- Miscellaneous improvements.
9 years ago
Matt Clay
28b882e737
Support ansible commands in sanity tests. ( #22172 )
9 years ago
Matt Clay
4f3dade266
Add retries for ansible-test docker run.
9 years ago
Matt Clay
45cec93e99
Disable newer shellcheck tests which don't pass.
9 years ago
Matt Clay
fcac261eef
Run unit tests in isolation w/ coverage support.
9 years ago
Matt Clay
c87ebb6215
Deduplicate arcs when combining coverage data. ( #22022 )
9 years ago
Matt Clay
2797cff773
Run destructive win tests when creating instances.
9 years ago
Matt Clay
2804d2e848
Split up unit tests on Shippable. ( #21931 )
...
* Add more verbose output to coverage combine.
* Run unit tests on CI separately by version.
9 years ago
Matt Clay
bc8186543a
Pass base branch to module validator on delegate.
9 years ago
Matt Martz
9b1bd2eb7e
Re-enable module comparisons in validate-modules ( #21582 )
...
* Re-enable module comparisons, specifically for new module detection and for finding new options/arguments
* Only do new module checks in shippable, local will display warning
9 years ago
Matt Clay
1ce2ea0b6c
Fix ansible-test handling of deleted test targets.
9 years ago
Matt Clay
2192c1eb02
Fix ansible-test selection of inventory file.
9 years ago
John R Barker
5e28d3a15c
network_cli shouldn't be specified anymore ( #21458 )
9 years ago
Matt Clay
d54bc09fae
Consider module_utils deps when running tests. ( #21382 )
...
* Skip pep8 analysis when --explain is used.
* Fix return type annotations.
* Match line length requirement of PEP 8 config.
* Consider module_utils deps when running tests.
9 years ago
Peter Sprygada
7f1c43e597
updates ios modules to support persistent socket ( #21258 )
...
* updates all ios modules to support persistent socket
* adds ios action plugin to connect to device
* adds exec_command() to ios shared module
* fixes ios_config and ios_template local action
* update all unit test cases
* adds base test module for ios module testing
9 years ago
Matt Clay
4189592701
Revert "Enable process isolation for unit tests."
...
This reverts commit 91526cd9f2 .
Removing this feature primarily because it interferes with
collecting proper code coverage results. I may restore the
feature later if that can be resolved.
9 years ago
Matt Clay
91526cd9f2
Enable process isolation for unit tests.
9 years ago
Matt Clay
bce5fc7d96
Use us-east-2 for Windows CI on Shippable.
9 years ago
Matt Clay
309a37de86
Add `--debug` option to `ansible-test`.
9 years ago
Matt Clay
6ef1a6aeb6
Add `pep8` to `ansible-test`. ( #20745 )
...
The rule sets and legacy file list are a first draft.
It is likely that they will need to be revised.
9 years ago
Dag Wieers
3a0a74dc18
Make test/runner less verbose when spawning instances
...
As discussed on IRC
9 years ago
Matt Clay
5503b89831
Run fewer tests for winrm config script changes.
9 years ago
Matt Clay
76d563af79
Temporarily switch Windows tests to us-east-1.
...
Will switch back to us-east-2 after AWS limit increase is done.
9 years ago
Matt Clay
fa7f84217b
Add startup checks to ansible-test.
9 years ago
Matt Clay
61e6e7868c
Improve jinja2 test coverage. ( #20533 )
...
* Run `template` test on latest jinja2 version.
* Update jinja2 install for groupby_filter.
* Clean test output dir for each test.
9 years ago
Matt Clay
7ed67746cf
Enable Windows 2016 on Shippable.
...
Also launch Windows instances on us-east-2 and all others on us-east-1.
9 years ago
Matt Clay
4ba9f63afe
Use multiple AWS regions in ansible-test. ( #20429 )
...
* Move ansible-test EnvironmentConfig to util.
* Use multiple AWS regions in ansible-test.
9 years ago
Matt Clay
4673a9c9c2
Generate ssh key once for network tests.
9 years ago
Matt Clay
4c97bad28e
Update ansible-test network change classification.
9 years ago
Matt Clay
3c51ce56fd
Enable more network support in ansible-test. ( #20372 )
...
* Only start platform instances with tests selected.
* Enable ios on Shippable.
* Show inventory in explain mode.
* Fix indentation of generated network inventory.
* Update classification of network module_utils.
9 years ago
Matt Clay
dbb89549ff
Improve ansible-test error handling and timeouts. ( #20328 )
...
* Eliminate warning/retry on old instance check.
* Increase instance start timeout for windows.
9 years ago
Matt Clay
b5d5888b6e
Add support for ios to ansible-test.
9 years ago
Matt Clay
e2bd71ac02
Clean up inventory generation in ansible-test. ( #20313 )
9 years ago
Matt Clay
a59ce3a7f9
Add retry on failure to get instance.
9 years ago
Matt Clay
f3130898bb
Retry instance start on error.
9 years ago
Matt Clay
d8733a5455
Complete initial network-integration support.
9 years ago
Matt Clay
300181cfd3
Send current winrm config to ansible-core-ci.
9 years ago
Matt Clay
f340b8d14f
Add test support for python 3.6.
9 years ago
Matt Clay
3ec7243918
Run all win tests for winrm config script changes.
9 years ago
Brian Coca
57f8b791d6
consolidated docs
...
point to new doc locations
removed non existing dirs
9 years ago
Matt Clay
b7780ca530
Pass DOCKER_* env vars to docker in ansible-test.
9 years ago
Matt Clay
dac226de4a
Improve ansible-test completion and messaging. ( #19627 )
...
* Simplify type annotation of args.docker_util.
* Improve error messaging for ansible-doc test.
* Add completion for docker, remote and windows.
9 years ago
Matt Clay
422857166b
Remove legacy test alias migration script. ( #19629 )
...
* Require code-smell tests to be files.
* Add sanity check for integration test aliases.
* Remove migration script for test aliases.
9 years ago
Matt Clay
9b5c782a0b
Use `docker pull` by default in ansible-test.
10 years ago
Matt Clay
f28b5a0ed8
Add --tox-sitepackages option to ansible-test.
10 years ago
Matt Clay
45772b961f
Add private fork CI support to ansible-test.
10 years ago
Matt Clay
1c9a58a885
Run all tests when no last successful commit.
...
(cherry picked from commit 2e56035fddfd04eb084bd977fc1ee2f35c2f5283)
10 years ago
Matt Clay
5628e260f2
Relocate module unit tests. ( #18812 )
...
* Relocate module unit tests.
* Fix classification of unit test changes.
10 years ago
Matt Clay
573078fc6b
Fix unit test directory path target.
10 years ago
Matt Clay
47083f145a
Don't error if pytest skips all unit tests.
10 years ago
Matt Clay
8e951b9f98
Remove legacy `test/samples` directory.
10 years ago
Matt Clay
7d3e2b2121
Verify path before assigning to sanity test.
10 years ago
Matt Clay
14a2757116
Correct change classification for network plugins.
10 years ago
Adrian Likins
ba56c87566
Add SSH_AUTH_SOCK to default env
...
So ssh-agent works when using locally.
10 years ago
Matt Clay
bee58fe890
Fix compile skip path handling for targeted tests.
10 years ago
Matt Clay
6bbd92e422
Initial ansible-test implementation. ( #18556 )
10 years ago