summaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2021-01-27CI: Use Docker proxy for pulls + Ruby fixes + get_pipMark Goddard1-0/+18
For Stein (due to CentOS 7) includes as well: - get_pip macro: fix for Python 2.7 - sensu-client: Pin simpleidn Ruby gem simpleidn Ruby gem started requiring Ruby 2.2. - monasca-grafana: Pin git Ruby gem fpm Ruby gem started requiring git Ruby gem git Ruby gem started requiring Ruby 2.3 - mark helm-repository as unbuildable It no longer builds, it's not used, it's been removed... Change-Id: I0c4d5e1ea16c6677813a334b38b3a22ad811531d Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com> Depends-On: https://review.opendev.org/772501 (cherry picked from commit a8c12def858b57349207cab5fa8dabb3c23bdfa0)
2020-09-14Fix kolla_set_configs --check with a directoryMark Goddard1-0/+41
There are several issues with kolla_set_configs --check: 1. We calculate the destination path incorrectly when comparing a file in a directory, due to passing arguments to os.path.relpath in the wrong order 2. For directories that have not changed, we also attempt to compare them as files, which fails when they are open()ed. 3. If the config JSON does not have a config_files key, it fails with a KeyError. The first two issues affect the fluentd container, which specifies directories as the source, without using a glob. The third affects OVN containers. This patch fixes these issues. Closes-Bug: #1890567 Change-Id: I8921befe51da4282121443849177a7ca5ebe8822 (cherry picked from commit c5320eb22386c34d83435fa0b9aa03b178996b52)
2020-09-03[CI] Fix wheel url for CentOSRadosław Piliszek1-1/+1
CentOS wheels do not differentiate between minor versions atm. Change-Id: I5365c813bab5e3205fd34eb64dc3337f192d67d4 (cherry picked from commit a3ef68d91c60c9d451450ae0e371e25402bb4c6f)
2020-06-26CI: use wheels from infra mirrorMarcin Juszkiewicz2-0/+4
If they are available then we do not need to build them. Especially AArch64 jobs will speedup (once wheels are built). Change-Id: I79af6c37950e156018a9204fbcc7417cd7d41012 (adapted by hand)
2020-06-25CI: Install python deps, mark oraclelinux rsyslog as skippedMichal Nasiadka2-1/+43
setuptools is missing from infra image - so it needs to be installed. Copy cat of a kolla-ansible change: https://review.opendev.org/#/c/735808/ Disables rsyslog build on oraclelinux (both source and binary) and tripleoclient (binary). Depends-On: https://review.opendev.org/737829 Change-Id: I6068abcbc0e73eeab77b0aa99983a95adc6defd3
2020-04-03Fix multiple CI issuesMark Goddard1-0/+7
1. Pin openstacksdk and client libraries in kolla-toolbox Stein and below only. openstacksdk released 0.45.0 (and possibly 0.44.0 as well) which dropped py2 compat but did not advertise the fact. It was amended later but it will now always affect kolla images until pinned to older. The observable error is: "ImportError: No module named queue" Since Train we pin u-c, but not before that. This change introduces a version constraint for openstacksdk and client libs: - python-novaclient - python-cinderclient - python-keystoneclient - python-glanceclient 2. Make deploy jobs non-voting For similar reasons to 1., the deploy jobs fail when using the openstack client for testing. Due to a dependency loop between these two projects, we must make these jobs non-voting to fix the image build. This should be reverted ASAP. 3. CI: Add https match for mirror.centos.org to template-overrides Some CentOS repos (currently one - Ceph NFS Ganesha) use https://mirror.centos.org instead of http:// and we break their definition by removing mirrorlist= entry and not inserting baseurl entry due to a missing match. Original Change-Id: I7b29f8c6be80820042023d2b85162d5cc9a65f08 Change-Id: I8c2da6437333210a7926f2deb926ab5d1c93c3c6 Closes-Bug: #1870349
2020-03-18CI: Install toxMark Goddard1-0/+5
tox will be removed from the base image. Install it before that happens. This change is made in a simple way that can be easily backported. Change-Id: I2a24c87aa44c1e03ba76a2fb0bd71caf54eb4211 (cherry picked from commit a81413fc52b0eaf1eefc3302ba425ac9b93d5a4d)
2020-01-20CI: Fix symlinks to failed logsRadosław Piliszek1-13/+0
Stop renaming files. Swift should be able to serve text/plain files based on content, not extension. Failed logs symlinks were broken because we stopped gzipping log files and improperly rewrote the logic there. Change-Id: Idddf51730821644948f51577807f5beaa18c6262 (cherry picked from commit 4a0182f15acbabc88df0aa660abce81d61f528da)
2020-01-13CI: Fix symlinks for failed build logsMark Goddard1-6/+0
Follow up to I5b5f323471676317a2898875cbbf297082328fcc. Logs are no longer gzipped, so we do not need to modify the 000_FAILED_* symlinks. Change-Id: I5df42ac0ff91b1b97537a4fbc33fc7970f29d60e (cherry picked from commit 63f773f569c7601deab40b32bd62ccde513fa46f)
2020-01-10Stop gzipping logs in postMichal Nasiadka1-4/+0
As per [1] we should stop compressing the logs sent to swift in order to get them back readable via a browser. [1]: http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html Change-Id: I5b5f323471676317a2898875cbbf297082328fcc (cherry picked from commit f44b0b778b0d3a0bfa2f7d5cc126618c4c1e67f5)
2019-07-03Extract CI vars for use in kolla-ansible jobsRadosław Piliszek2-10/+12
Adapted for stable/stein (oraclelinux still tested) Change-Id: If58f15e18e420aca790496132352f1c1dcdb2640 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit 8270ae20f9a8d528d5bea9e275a84a3ef4cf23aa)
2019-06-27Clean up test processRadosław Piliszek5-85/+58
If stestr failed, then no node info was logged. Logging node info is now handled in pre and post stages of Zuul. Additionally Zuul v3 migration recommendations were applied and some unused code removed improving general readability. Change-Id: Iae9d37cb76997ba8389e21c7e2a3bf5905abe029 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit c7ac0f0de0c65afe54974a7ea727feb27c0f60eb)
2019-06-14Fix issues with Percona in Zuul and clean up a little bitRadosław Piliszek1-2/+4
Percona site has connectivity issues from OVH hosts (of Zuul). This patch makes it so that: - the internal repo is actually used - RPM GPG keys are downloaded from the actually used repo - Ubuntu mimics the RHEL behavior (i.e. the Percona repo is enabled only in the xtrabackup image) extra benefit: no need for APT preferences for Percona repo to spare MariaDB deps Change-Id: Id27831f6b404762f9e44fd6bd1c4702bf06b05f8 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit de58339a0e1704ae1ade4e032a73bb4708ecfaf1)
2019-06-14Debian/Ubuntu: allow to use unsigned repositoriesMarcin Juszkiewicz1-6/+8
When we run Debian 'buster' or Ubuntu 18.04 in CI job they refuse to work as infra mirror is not signed. This patch instructs APT to use unsigned repos anyway. Change-Id: I530fde5b57894afda2de98d7c217e735497e3feb (cherry picked from commit 5859180c2c78c62defca37446722b5f15fdbefb7)
2019-03-15Fix lower-constraints and kolla CI jobsMark Goddard1-2/+2
Multiple fixes to fix multiple problems. 1. Bump setuptools requirement to 21.0.0 The 16.0.0 requirement breaks the lower-constraints job on Ubuntu bionic. We see the following error: AttributeError: module 'importlib._bootstrap' has no attribute 'SourceFileLoader' 2. ubuntu-binary horizon image needs to use python3 for django manage.py 3. ubuntu-binary nova-placement-api image needs to use python3 for apache mod wsgi. 4. nova-libvirt needs exact qemu dependencies due to packaging change 5. OracleLinux repos definition was changed in official image. 6. Fetch InfluxDB gpg key for Ubuntu base image from influx server. Change-Id: Ic797d41f53a5f146d112619f1683cbfbf3a85dc2
2019-02-14Fix py36 gate jobMichal Nasiadka1-0/+1
python 3.6 pycache also includes links - so those also need to be removed Depends-On: https://review.openstack.org/636750 Change-Id: I0f995df45bf203acc79cc7bd52b9ac51577468da
2018-12-27Update hacking versionconfi-surya1-1/+2
Use latest release 1.1.0 and compatible changes w.r.t pep8 Change-Id: Ia3d1166a2746a46591e4e5a04ea91e03ddc28d93
2018-12-19Merge "Use infra mirrors for ODL and percona repos"Zuul3-4/+6
2018-12-18Merge "No need to use dict_object.keys()"Zuul1-1/+1
2018-12-18Use infra mirrors for ODL and percona reposEduardo Gonzalez3-4/+6
Change-Id: I212a53b235f2785d93d474660c87a8521f3cc8b2
2018-12-05Fix Oraclelinux build, disable collectd in gateEduardo Gonzalez2-4/+0
Oraclelinux repositories has been upgraded and previous file removed, this change update repos to new URLs. Disable collectd in gate as is currently broken and blocks mergingin voting jobs. Change-Id: I402cff1ac86a2ba108f2f5378cc98db5f6ecc673
2018-12-03No need to use dict_object.keys()confi-surya1-1/+1
for in dict_object.keys() can be replaced with for in dict_object, so just a short cleaup Change-Id: Id934eae6db05298b85b800531b9dfdcb28782cc5
2018-11-29Fix the parameter order of assertEqualconfi-surya1-1/+1
On assertEqual, the order of parameters should be (expected, observed). But, some part of kolla tests was written with invalid order. This patch fix the problem. Change-Id: I9fcfb3923716243ddb1886223e932ec12829fb2e Related-Bug: #1277104
2018-11-20Suppress log copy output in gatesEduardo Gonzalez1-0/+2
Copying collectd logs is half of the job ouput. This change is to remove the verbosity of the syncronize tasks by applying --quiet to only show errors Change-Id: I39b47b844aab87d043a2cd745103d6589f3632e3
2018-09-24Merge "Fix epel mirror replacement in gates"Zuul1-0/+1
2018-09-21Disable debug logs for image buildsMark Goddard1-1/+1
Logs emitted when building via the tox environments can exceed the maximum length supported by subunit [1], causing the following message: Length too long: <length> This change disables debug logging in these tox environments to reduce the length of the output. [1] https://github.com/testing-cabal/subunit/blob/8cdd703980c314dddf95cc0556f67bc80358ddcd/python/subunit/v2.py#L208 Change-Id: Icb5793a8ea58edafe2f3a249eb1da7d4ae2e395f
2018-09-19Fix epel mirror replacement in gatesEduardo Gonzalez1-0/+1
Change-Id: I7b74497931de5e2a89fc1a2b827a1cf6d64ab7e9
2018-07-10Add CI script to retrieve info from build logsMartin André2-0/+83
This should serve as a base for retrieving useful information from the kolla build logs. For now, the script warns about obsolete package names and helps track packages that are installed too many times in different images. It only supports rpm-based distros for now. Change-Id: I160b6ede1336bd0c202621a48ca0218f72fc1270
2018-07-10Show disk space used by docker images in CIMartin André1-1/+1
The `docker system df` command can show the total size of the docker cache. If you pass it the `-v` option, it will break it down per image, replacing the use of `docker ps -a` and `docker images`. This should be very useful in CI to see the variation in the images size. Change-Id: I407434d88f59df65693974265551c624420d4aaf
2018-07-09Stop creating an empty system_logs dir in CIMartin André1-1/+1
The system logs from the building node are copied to the system_log directory. There is no need to create an empty system_logs directory. It was certainly a typo. Change-Id: I1f0eea485550bd7b41c9954a6b7077251518b31d
2018-06-04Merge "Bump Ubuntu base image to 18.04"Zuul1-4/+5
2018-05-26Bump Ubuntu base image to 18.04Jeffrey Zhang1-4/+5
Ubuntu 18.04 has been released. We need upgrade to it this cycle. Changes made in this patch - Bump ubuntu repo from xenial to bionic. Some repos do not have bionic packages, so still using xenial repos. - Drop mariadb, percona and nfs-ganesha repo, because these packages are already provided by Ubuntu official repo. - Since qdrouterd does not have bionic repo and xenial packages does not work on Ubuntu bionic, just add it into ignore image list. - Use python-rtslib-fb and targetcli-fb rather than python-rtslib and targetcli - use xen-utils package name rather than with package version one. - Seems unsigned repo won't work on Ubuntu bionic, stop using infra mirrored unsigned repo in gate building job. Needed-By: https://review.openstack.org/568728 Implement blueprint: ubuntu-bionic Change-Id: I4e3b0ca669cfbf6316bf591f2d8428fa1a0d6182
2018-05-08Create symlinks for failed builds logsMartin André1-0/+6
This allows to know which image failed to build without having to parse the huge job-output.txt file. This commit creates a convenient 000_FAILED_image_name.log symlink to the relevant log files when kolla is configured to output to a log directory. This creates symlinks only for the parent image with error, i.e. it skips images that failed to build because of parent error. Change-Id: I05954e2335dc3fac469276809c91f9c87e3ecab2
2018-04-04Merge "No use of mox/mox3"Zuul1-1/+1
2018-04-03Merge "Revert "Seem there are some wrong in infra ubuntu repo""Zuul1-5/+4
2018-03-30No use of mox/mox3Surya Prakash Singh1-1/+1
Now onwards no support of mox/mox3, please check storyboard link for reference https://storyboard.openstack.org/#!/story/2001546 Change-Id: Ic1fa65951f1e43e1279d8c72fcfc5e09609faa70
2018-03-21Support push kolla tag image to hub.docker.com siteJeffrey Zhang1-1/+1
Change-Id: I8a21f60a37ba038e46c29d0bcff9ffbd2457a257
2018-02-27Verify YAML syntax in gatesEduardo Gonzalez3-0/+3
Test yaml syntax is correct on new changes. Fixes current warnings and errors Change-Id: I5888f8e4a9d27a08506036df2c564b9f2081ccee
2018-02-26Revert "Seem there are some wrong in infra ubuntu repo"Jeffrey Zhang1-5/+4
This reverts commit 7b562990b5b717bb83d56673b368de9b355bb315. Change-Id: Id5f0e9532a7714a18125832d4f38bbe7bb849c84
2018-02-12Seem there are some wrong in infra ubuntu repoJeffrey Zhang1-4/+5
Revert this after infra ubuntu repo is OK. Change-Id: I8bbf8257d5a932b7e9f2e9a64d62cd5892e3f1bb
2018-01-16Merge "Add collectd in ci to collect system information"Zuul2-1/+4
2017-12-18Add collectd in ci to collect system informationJeffrey Zhang2-1/+4
Change-Id: Ic5cbdfd4ebca1d907ada5c39f27dc4a7889daa21
2017-12-06Use separate publish jobs in periodic pipelineJeffrey Zhang1-4/+0
The secrets can not be inherited. Change-Id: Ie0f99f470a419c57865eb8b0a14e465ae228c799
2017-12-04Change more repo url to infra mirrorJeffrey Zhang4-41/+46
Change-Id: I7e9fd2760ae3202f3a84833bb65edfdcffa67fe4
2017-11-28Improve gate post jobsJeffrey Zhang2-4/+5
- Reuse build jobs to publish images - Add binary jobs in periodic pipeline - Push all image to dockerhub - Use branch name for image tag Change-Id: Ifefb96bcbcc9c6840cf865f7786b43a43fae4c17
2017-11-08Fixup small bug with dockerhub publisherMichal (inc0) Jastrzebski1-1/+1
Jinja2 vs gotpl... Change-Id: I27a54eb9202ac5f3e9b3ef9c307e81475e8833f5
2017-11-06Dockerhub publisher jobMichal (inc0) Jastrzebski5-1/+117
This patchset includes pushing mechanism for daily periodic jobs. Change-Id: Ic4179ffd3a6e640abfb181dbd000bc75cc64b750
2017-10-19Moving jobs to kolla repoJeffrey Zhang3-0/+143
This is zuulv3 migration patch. This patch only implement build jobs. Deploy jobs will be pushed in another one. Partial-Bug: #1720601 Change-Id: Ib9157ed132820d752ef1dbd7a53353ebd68b1934
2017-09-23Skip known failed kolla imagesJeffrey Zhang1-116/+11
Change-Id: Ide8478c248e77b9c85201981e8086f3dbf06d131
2017-08-29Enable mistral in test_build centos sourceEduardo Gonzalez1-1/+0
For some reason, mistral was disabled in test_build since long time ago. I've been using mistral with no problem. Also current gates build mistral images properly. Change-Id: I89e79c22f0e15b8165b23fa8cd98df309efdaf45