summaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2022-03-04Build CentOS Stream 8 imagesMichal Nasiadka2-7/+12
This is part of the effort to allow a migration path for operators using CentOS 7 and Train today. Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/831265 Change-Id: I75373eb21c4269c20f72603ad4cf162a472de25b (cherry picked from commit 67d6d28b6208cc004a50f19be1386d88c2404bc4)
2022-03-03CI: Fix epel url overrideMichał Nasiadka1-3/+7
epel-release now installs epel*.repos with following baseurl: baseurl=https://download.example/pub/epel/$releasever/Everything/$basearch This backport has been adapted to continue to work on CentOS 7. Change-Id: I19f57d258021ff660df6b6b95e8205b69f3bea85 (cherry picked from commit acc8cb9903aa2a97342d1ca76bc9e274361194c1)
2022-01-26CI: make it work againMarcin Juszkiewicz2-2/+15
Python changes: - limit pip to 20.x as this is last version working on both Python 2 and 3. - cap 'setuptools' to be older than 58 to have use_2to3 functionality (fixes 'anyjson' installation) - upgrade pip in 'elasticsearch-curator' image to get it built on CentOS 7 Unbuildable images: - 'bifrost-base' under CentOS 8 (Error: Cannot find a valid baseurl for repo: epel) - 'monasca-grafana' under CentOS 7/8 - 'sensu-client' under CentOS 7 (aws-eventstream requires Ruby version >= 2.3) - dropped *-upgrade CI jobs as Stein is EOL - pin 'qpid-proton-c' package for CentOS 7 to not install EPEL one (cinder-volume, openstack-base and tripleoclient) - bump 'libvirt-python' in 'masakari-monitors' to 7.10.0 (newer branches install package from distribution but CentOS 7 lacks it) - pin 'unf_ext' gem in Sensu images as CentOS 7 lacks Ruby 2.2+ (fixed sensu-server) - install 'ca-certificates' for newer Let's Encrypt certificates support (so we can fetch upper-constraints) - make Zuul fetch openstack/requirements project files (make 'openstack-base' pass) (like 2nd fix) Co-Authored-by: Pierre Riteau <pierre@stackhpc.com> Closes-Bug: #1943617 Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/826464 Change-Id: I8ee32e53cda581493b2a4bb73ca72ab05014b9d4
2021-05-11CI: drop bashism from template overridesMarcin Juszkiewicz1-1/+1
[[ is bash only In many distributions /bin/sh == bash but not in Debian and derived where it is dash (very simple POSIX shell). Change-Id: I2b084ea78b236623b174473f411bae04e624a3e9 (cherry picked from commit f0c3567740be342355b39a7c7d3ca341d5a4ec0f)
2021-05-10[CI] Trust only infra mirrors and fix APT mirrorsMarcin Juszkiewicz1-20/+22
Infra mirrors get their indices rebuilt to avoid broken indices (due to partial update). Unfortunately, this wipes out the cryptographic signatures. Our approach so far was disabling apt security features globally. However, this is not a valid choice for external repos. It hid an issue we introduced with new RabbitMQ repos missing proper keys installed in the image. This caused permanent failures outside of our CI. Our process should be as close as possible to users' experience. This patch makes CI trust only the mirrors that have their indices rebuilt (so infra mirrors). For Train, fixed missing override parts as well. And it includes also: - I8209770ca1353fd89aacef0859ca3a373645c6b2 - Icb745f628c1c50d9f20df022b08ddc46fccc270c - Id3b55ac470a977be7ee7decdef3b49e8d89a130f Change-Id: Ic5abc4b87fd76f87aba383abf43e95ba70629fcb Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> (cherry picked from commit c364c8be85f4653bf7af1c7ac0378823553e7441) (cherry picked from commit 4a482380408d107c59119b379add34f4b8e87ad7)
2021-01-26CI: revert to public package mirrors after buildMark Goddard1-3/+59
When building images in CI, we use local package mirrors to reduce external network traffic. These mirrors are not necessarily reliable nor are they guaranteed to be accessible outside of the CI environment (although many are). While it is an antipattern to install packages in containers at runtime, the Bifrost container does just that. If the mirrors configured in the image are unavailable, Bifrost deployment can fail. This change fixes the issue by reverting to public package mirrors as a final step of the image build process. Closes-Bug: #1902101 Change-Id: I2592a736206eaec811290e9fbdbf2540c0518ffe (cherry picked from commit 0fc464332c789ce05e9d6442726ada84ce7fc65a)
2021-01-22CI: Use Docker proxy for pulls + Ruby fixesMichał Nasiadka1-0/+18
For Train (due to CentOS 7) includes as well: - sensu-client: Pin simpleidn Ruby gem simpleidn Ruby gem started requiring Ruby 2.2. - monasca-grafana: Pin git Ruby gem fpm Ruby gem started requiring git Ruby gem git Ruby gem started requiring Ruby 2.3 Change-Id: I0c4d5e1ea16c6677813a334b38b3a22ad811531d Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com> Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/772077 (cherry picked from commit a8c12def858b57349207cab5fa8dabb3c23bdfa0)
2020-09-14Fix kolla_set_configs --check with a directoryMark Goddard1-0/+41
There are several issues with kolla_set_configs --check: 1. We calculate the destination path incorrectly when comparing a file in a directory, due to passing arguments to os.path.relpath in the wrong order 2. For directories that have not changed, we also attempt to compare them as files, which fails when they are open()ed. 3. If the config JSON does not have a config_files key, it fails with a KeyError. The first two issues affect the fluentd container, which specifies directories as the source, without using a glob. The third affects OVN containers. This patch fixes these issues. Closes-Bug: #1890567 Change-Id: I8921befe51da4282121443849177a7ca5ebe8822 (cherry picked from commit c5320eb22386c34d83435fa0b9aa03b178996b52)
2020-09-03[CI] Fix wheel url for CentOSRadosław Piliszek1-1/+1
CentOS wheels do not differentiate between minor versions atm. Change-Id: I5365c813bab5e3205fd34eb64dc3337f192d67d4 (cherry picked from commit a3ef68d91c60c9d451450ae0e371e25402bb4c6f)
2020-06-19CI: use wheels from infra mirrorMarcin Juszkiewicz2-0/+4
If they are available then we do not need to build them. Especially AArch64 jobs will speedup (once wheels are built). Change-Id: I79af6c37950e156018a9204fbcc7417cd7d41012
2020-06-19CI: Install python deps, fix mod_wsgi in cyborg-api, disable masakari-monitorsMichal Nasiadka2-1/+43
setuptools is missing from infra image - so it needs to be installed. Copy cat of a kolla-ansible change: https://review.opendev.org/#/c/735808/ Fixes also cyborg-api to use py3 mod_wsgi in centos8 Temporarily disables masakari-monitors build, because it fails on centos8 due to problems with libvirt-python===5.7.0 (upper-constraints): Missing type converters: virTypedParameterPtr:1 ERROR: failed virConnectSetIdentity Depends-On: https://review.opendev.org/#/c/736744/ Change-Id: I6068abcbc0e73eeab77b0aa99983a95adc6defd3
2020-04-04CI: Use network mode = hostRadosław Piliszek1-0/+3
This avoids issues with IPv6 not enabled in docker. Change-Id: Iff80392357ef5e2dd3f2e24dbf4df299660805b9
2020-04-03CI: Add https match for mirror.centos.org to template-overridesMichal Nasiadka1-0/+3
Some CentOS repos (currently one - Ceph NFS Ganesha) use https://mirror.centos.org instead of http:// and we break their definition by removing mirrorlist= entry and not inserting baseurl entry due to a missing match. Change-Id: I7b29f8c6be80820042023d2b85162d5cc9a65f08 (cherry picked from commit 1a28aefec8d3f9c2d6a5bf77a040a81edc94b3ac)
2020-03-23Merge "CI: Install tox" into stable/trainZuul1-0/+5
2020-03-19CI: publish AArch64 Debian/source imagesMarcin Juszkiewicz1-0/+5
We want to test upgrades on aarch64. For this we need to publish images. AArch64 images with get "-aarch64" added to tag to not collide with x86-64 ones. (manually adapted from master change) Change-Id: Ibae2578b4bc18c0ab7fcc1840c39bb86659ab920
2020-03-18CI: Install toxMark Goddard1-0/+5
tox will be removed from the base image. Install it before that happens. This change is made in a simple way that can be easily backported. Change-Id: I2a24c87aa44c1e03ba76a2fb0bd71caf54eb4211 (cherry picked from commit a81413fc52b0eaf1eefc3302ba425ac9b93d5a4d)
2020-02-26CentOS 8: Update packages in imagesMark Goddard1-1/+1
* Some further changes for python2 vs python3 packages * Allow rabbitmq 3.7.*, since a newer erlang is available * Switch from qemu-img-ev to qemu-img on CentOS 8 * bridge-utils no longer available on CentOS 8 * libvirt-daemon-driver-lxc no longer available on CentOS 8 * Mark some more images buildable for CentOS 8 Depends-On: https://review.opendev.org/709553 Change-Id: Iaf5b68ff6d944ae730ca0b1d5832172c106a6c08 Partially-Implements: blueprint centos-rhel-8 Partially-Implements: blueprint centos-rhel-python-3 (cherry picked from commit 4b4e26262b9e03190c639481fb60a8f4f92c532a)
2020-02-26CentOS 8: base and openstack-base imagesMark Goddard1-2/+10
Adds support to the base and openstack-base images for CentOS 8. These images have been removed from the list of unbuildable images, and replaced with all dependent images. This change also includes backports of a number of other changes related to the base image: * CentOS 8: disable repo_gpgcheck for grafana image (Ice120e8001fd9e8bb37ca4f2df26259cf798ee0e) * CentOS 8: base image fixes for RabbitMQ, fluentd & InfluxDB (Ibbb720390ff17e11249a5aa77163c15c0971209a) Change-Id: I18fba8a5c2f99b700990cbf41c76077a1ec2408a Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit 3c618a1f6f0beca723e031fbe323b159400ad08f)
2020-02-24CentOS 8: Don't force tag in build jobsMark Goddard2-7/+7
We should allow the tag set in kolla-build.conf to be used for the image tags, since our deploy jobs need to set it to change_XXXXXXX when images are built for the job. Change-Id: I705514ee0249ff1d309e280001d653271e3686af Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit 8788a452a9ab7c1f3a94986c2a55e887d1530bbf)
2020-02-21Merge "CentOS 8: Add zuul build and publish jobs" into stable/trainZuul2-1/+25
2020-01-20CI: Fix symlinks to failed logsRadosław Piliszek1-13/+0
Stop renaming files. Swift should be able to serve text/plain files based on content, not extension. Failed logs symlinks were broken because we stopped gzipping log files and improperly rewrote the logic there. Change-Id: Idddf51730821644948f51577807f5beaa18c6262 (cherry picked from commit 4a0182f15acbabc88df0aa660abce81d61f528da)
2020-01-15Merge "Stop gzipping logs in post" into stable/trainZuul1-4/+0
2020-01-14CentOS 8: Add zuul build and publish jobsMark Goddard2-1/+25
Adds build and publishing jobs for CentOS 8 images: - kolla-build-centos8-binary - kolla-build-centos8-source - kolla-publish-centos8-binary - kolla-publish-centos8-source The 'base' image has been added to the list of unbuildable images for CentOS 8 (now separate from the list for CentOS 7). This means that no images will be built - the jobs should essentially be a 'noop'. Change-Id: Ie9a0109bd4eef337358d714e4b5088b8e3de2f23 Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit b060623b907348e518bdf1afede0b641be56c415)
2020-01-13CI: Fix symlinks for failed build logsMark Goddard1-6/+0
Follow up to I5b5f323471676317a2898875cbbf297082328fcc. Logs are no longer gzipped, so we do not need to modify the 000_FAILED_* symlinks. Change-Id: I5df42ac0ff91b1b97537a4fbc33fc7970f29d60e (cherry picked from commit 63f773f569c7601deab40b32bd62ccde513fa46f)
2020-01-10Stop gzipping logs in postMichal Nasiadka1-4/+0
As per [1] we should stop compressing the logs sent to swift in order to get them back readable via a browser. [1]: http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html Change-Id: I5b5f323471676317a2898875cbbf297082328fcc (cherry picked from commit f44b0b778b0d3a0bfa2f7d5cc126618c4c1e67f5)
2019-10-29Merge "Remove /var/yum/cache from CentOS base image"Zuul1-4/+2
2019-10-28Remove /var/yum/cache from CentOS base imageMark Goddard1-4/+2
Since https://review.opendev.org/#/c/682600/, the following lines result in /var/yum/cache being present in one of the layers of the base image: RUN {{ macros.install_packages(base_centos_yum_repo_packages | customizable("centos_yum_repo_packages"), chain=True, clean=False) }} \ {% for repo in base_centos_yum_repos_to_disable | customizable('centos_yum_repos_to_disable') -%} && yum-config-manager --disable {{ repo }} \ {% endfor -%} {% for key in base_centos_yum_repo_keys | customizable('centos_yum_repo_keys') -%} && rpm --import {{ key }} \ {% endfor -%} && /bin/true {% block base_centos_repo_overrides_post_yum %}{% endblock %} RUN {{ macros.rpm_security_update(clean_package_cache) }} This is because it is not cleaned in the first RUN statement. This adds 76MB to the image. Also, using two separate RUNs which results in an extra 23MB due to updates to /var/lib/rpm/Packages. Found via https://github.com/wagoodman/dive. Change-Id: I0302ee1dfc10a2b7df127ac6a7764a84b1d74a33 Closes-Bug: #1850036
2019-10-21Move to RDO Train packagesMichal Nasiadka1-4/+0
Change-Id: I396f929ecc11f87fb83585bedd39be93a605c57b
2019-09-19CI: Use docker mirror proxyRadosław Piliszek2-8/+5
TODO: Debian build still requires access to original repo. Change-Id: Ie4bac5334369a63793d36568a9d3a58a0cdc7667 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-09-18Remove support for OracleLinuxMark Goddard2-31/+1
We have agreed to remove support for Oracle Linux. http://lists.openstack.org/pipermail/openstack-discuss/2019-June/006896.html Change-Id: I961dfba1aeef2c509ecdaf376dfe6928926ffb39 Depends-On: https://review.opendev.org/682858
2019-09-17CI: CentOS - override mirrors ASAP + crmsh mirror overrideRadosław Piliszek1-13/+31
This makes mirrored repos used as soon as they are installed in the image, instead of hitting upstreams. This patch also adds crmsh override. Usable only after infra change merges. Depends-on: https://review.opendev.org/682576 Change-Id: Ic7494eff4c740b6e528da4508dc88a64e697bc04 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-09-12Drop Percona XtraBackup in favour of MariaDB BackupMarcin Juszkiewicz2-4/+0
XtraBackup started failing to install on Ubuntu and does not support MariaDB 10.3 version. Related-Bug: #1843043 Change-Id: I9cf62c8e03a02574d85e5349df1d23a51d4c99be
2019-07-21Change how build process treats unbuildable imagesMarcin Juszkiewicz1-2/+2
We have a list of images which are unbuildable for distro/buildtype/arch combos. This patch renames it from SKIPPED_IMAGES to UNBUILDABLE_IMAGES because 'skipped' images is something else in our code. Now all unbuildable images are marked as such and so are their children. At the end of build there is information provided about skipped images (due to --skip-parents or --skip-existing options) and then information about not buildable images. Both list should only contain entries related to requested build. Change-Id: If9b521339f564e483cba03d52e7c4eba271821a5
2019-07-15cleanup setup of Debian/Ubuntu CI nodesMarcin Juszkiewicz1-0/+2
Change-Id: I3a771793dfbbfc26f6d5716ba7a5b60c2e6154fa
2019-07-03CI: Clean up Zuul repo mirrors for CentOSRadosław Piliszek2-13/+15
- unify RDO mirror definition with others - drop definitions of unused mirrors: grafana, elastic - clean up the process of mirror substitution: - use the more common style of sed d command - apply more specific substitutions Change-Id: Idad2c6956cca647d4c865d6f6149ea37164db568 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-28Extract CI vars for use in kolla-ansible jobsRadosław Piliszek2-9/+11
Change-Id: If58f15e18e420aca790496132352f1c1dcdb2640 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-27Merge "Clean up test process"Zuul5-85/+58
2019-06-25Remove Oracle Linux stuff in CI codeRadosław Piliszek2-24/+0
Oracle Linux is no longer tested via CI after [1]. This patch removes OL support from Zuul files. [1] https://review.opendev.org/664217 Change-Id: I527aba3635ef82e2d2a88ee7f5250bf03e420800 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-20Clean up test processRadosław Piliszek5-85/+58
If stestr failed, then no node info was logged. Logging node info is now handled in pre and post stages of Zuul. Additionally Zuul v3 migration recommendations were applied and some unused code removed improving general readability. Change-Id: Iae9d37cb76997ba8389e21c7e2a3bf5905abe029 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-08Fix issues with Percona in Zuul and clean up a little bitRadosław Piliszek1-2/+4
Percona site has connectivity issues from OVH hosts (of Zuul). This patch makes it so that: - the internal repo is actually used - RPM GPG keys are downloaded from the actually used repo - Ubuntu mimics the RHEL behavior (i.e. the Percona repo is enabled only in the xtrabackup image) extra benefit: no need for APT preferences for Percona repo to spare MariaDB deps Change-Id: Id27831f6b404762f9e44fd6bd1c4702bf06b05f8 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-07Debian/Ubuntu: allow to use unsigned repositoriesMarcin Juszkiewicz1-6/+8
When we run Debian 'buster' or Ubuntu 18.04 in CI job they refuse to work as infra mirror is not signed. This patch instructs APT to use unsigned repos anyway. Change-Id: I530fde5b57894afda2de98d7c217e735497e3feb
2019-03-15Fix lower-constraints and kolla CI jobsMark Goddard1-2/+2
Multiple fixes to fix multiple problems. 1. Bump setuptools requirement to 21.0.0 The 16.0.0 requirement breaks the lower-constraints job on Ubuntu bionic. We see the following error: AttributeError: module 'importlib._bootstrap' has no attribute 'SourceFileLoader' 2. ubuntu-binary horizon image needs to use python3 for django manage.py 3. ubuntu-binary nova-placement-api image needs to use python3 for apache mod wsgi. 4. nova-libvirt needs exact qemu dependencies due to packaging change 5. OracleLinux repos definition was changed in official image. 6. Fetch InfluxDB gpg key for Ubuntu base image from influx server. Change-Id: Ic797d41f53a5f146d112619f1683cbfbf3a85dc2
2019-02-14Fix py36 gate jobMichal Nasiadka1-0/+1
python 3.6 pycache also includes links - so those also need to be removed Depends-On: https://review.openstack.org/636750 Change-Id: I0f995df45bf203acc79cc7bd52b9ac51577468da
2018-12-27Update hacking versionconfi-surya1-1/+2
Use latest release 1.1.0 and compatible changes w.r.t pep8 Change-Id: Ia3d1166a2746a46591e4e5a04ea91e03ddc28d93
2018-12-19Merge "Use infra mirrors for ODL and percona repos"Zuul3-4/+6
2018-12-18Merge "No need to use dict_object.keys()"Zuul1-1/+1
2018-12-18Use infra mirrors for ODL and percona reposEduardo Gonzalez3-4/+6
Change-Id: I212a53b235f2785d93d474660c87a8521f3cc8b2
2018-12-05Fix Oraclelinux build, disable collectd in gateEduardo Gonzalez2-4/+0
Oraclelinux repositories has been upgraded and previous file removed, this change update repos to new URLs. Disable collectd in gate as is currently broken and blocks mergingin voting jobs. Change-Id: I402cff1ac86a2ba108f2f5378cc98db5f6ecc673
2018-12-03No need to use dict_object.keys()confi-surya1-1/+1
for in dict_object.keys() can be replaced with for in dict_object, so just a short cleaup Change-Id: Id934eae6db05298b85b800531b9dfdcb28782cc5
2018-11-29Fix the parameter order of assertEqualconfi-surya1-1/+1
On assertEqual, the order of parameters should be (expected, observed). But, some part of kolla tests was written with invalid order. This patch fix the problem. Change-Id: I9fcfb3923716243ddb1886223e932ec12829fb2e Related-Bug: #1277104
generated by cgit v1.2.3 (git 2.39.1) at 2026-11-05 16:47:13 +0000