summaryrefslogtreecommitdiff
path: root/tests/templates
AgeCommit message (Collapse)AuthorFilesLines
2023-01-13CentOS/Rocky: use CentOS Cloud SIG repo instead of DeloreanMarcin Juszkiewicz1-9/+0
Zed was released, landed in CentOS repo, time to use it. Change-Id: I829a0fc4439281b074c40e200d96a27584da3765
2022-10-03CI/centos/rocky: use repos from opendev mirrorMarcin Juszkiewicz1-29/+35
Repo definitions in RHEL 9 rebuilds use metalink method for most of entries which makes our use of sed obsolete. This patch adds file with definitions of all CS9 repos we use and moves all official definitions a side at start of build. After build our definitions get removed and official ones are restored. Similar is done for RockyLinux 9 builds but there RL9 repos are used from official mirrors while CS9/EPEL ones are from OpenDev mirrors. Final images will have repos in wrong enabled/disabled state. Change-Id: I04121fd5ca9894b6deeda3808808cbffd6b97811
2022-09-30Add RockyLinux 9 supportMichal Nasiadka1-17/+14
Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/859570 Change-Id: I7af51d07b8a939c908aa072294061def57dd67de
2022-09-27Move to CentOS Stream 9Marcin Juszkiewicz1-2/+2
OpenStack 'zed' requires Python 3.8+ so RHEL 8 family has to go. This changeset moves to CentOS Stream 9 while move to RockyLinux 9 is planned as final solution. CI moved to CentOS Stream 9 nodes. Depends-on: https://review.opendev.org/c/openstack/kolla-ansible/+/839715 Change-Id: I113b9984294cf8663d3fc0c8840320e1d40ea731
2022-03-11Unify curl use (customisation options)Maksim Malchuk1-1/+1
This change adds and unifies an ability to override hardcoded URLs for air-gapped environments via the usual blocks mechanism. Also, this change replaces ENV with ARG instruction for the variables used only in building images, and uses bash variable expansion where it possible. This change is a continuation of the I46b77978926fc2b578a68d1aaa944b2198af0685 Change-Id: I1fbad333b1bc95484e6f4c5145d5936a0e2db84f Signed-off-by: Maksim Malchuk <maksim.malchuk@gmail.com>
2021-07-01CI: Fix epel url overrideMichał Nasiadka1-3/+3
epel-release now installs epel*.repos with following baseurl: baseurl=https://download.example/pub/epel/$releasever/Everything/$basearch Change-Id: I19f57d258021ff660df6b6b95e8205b69f3bea85
2021-05-08Merge "CI: drop bashism from template overrides"Zuul1-1/+1
2021-05-04[CI] Trust only infra mirrorsRadosław Piliszek1-22/+10
Infra mirrors get their indices rebuilt to avoid broken indices (due to partial update). Unfortunately, this wipes out the cryptographic signatures. Our approach so far was disabling apt security features globally. However, this is not a valid choice for external repos. It hid an issue we introduced with new RabbitMQ repos missing proper keys installed in the image. This caused permanent failures outside of our CI. Our process should be as close as possible to users' experience. This patch makes CI trust only the mirrors that have their indices rebuilt (so infra mirrors). Change-Id: Ic5abc4b87fd76f87aba383abf43e95ba70629fcb
2021-05-04CI: drop bashism from template overridesMarcin Juszkiewicz1-1/+1
[[ is bash only In many distributions /bin/sh == bash but not in Debian and derived where it is dash (very simple POSIX shell). Change-Id: I2b084ea78b236623b174473f411bae04e624a3e9
2021-04-26move to Debian 'bullseye'Marcin Juszkiewicz1-1/+1
Bullseye is now in hard freeze cycle and goes for release. https://release.debian.org/bullseye/freeze_policy.html Co-Authored-By: Michal Nasiadka <mnasiadka@gmail.com> Change-Id: I543965a2741cebfa759576a4c75669a7bacd4208
2020-12-17CI: revert to public package mirrors after buildMark Goddard1-3/+56
When building images in CI, we use local package mirrors to reduce external network traffic. These mirrors are not necessarily reliable nor are they guaranteed to be accessible outside of the CI environment (although many are). While it is an antipattern to install packages in containers at runtime, the Bifrost container does just that. If the mirrors configured in the image are unavailable, Bifrost deployment can fail. This change fixes the issue by reverting to public package mirrors as a final step of the image build process. Closes-Bug: #1902101 Change-Id: I2592a736206eaec811290e9fbdbf2540c0518ffe
2020-10-28[CI] Use local RDO mirrorRadosław Piliszek1-1/+3
Fixes a FIXME. Change-Id: I2e6e07d6f466a7485ce6481e6e43b034fdc27f41
2020-09-16[CI] Support building source images with in-review changesMark Goddard1-18/+0
Following this change it is possible to add 'Depends-On' lines to a kolla commit message that point to reviews in other projects. For example, this could be used to test building and deploying container images containing a change to the nova project that is currently in review. It also allows to introduce jobs testing against Kolla in other projects. The kolla-build-config Ansible role can also be used by other projects, such as kolla-ansible, to generate the necessary configuration. This takes us closer to the Kolla Builder - Next Generation concept [1]. [1] http://lists.openstack.org/pipermail/openstack-discuss/2020-April/014255.html Change-Id: Ia2efa6b5d7278b75ab8dec23207f92d6bd7c58f0 Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2020-08-12[CI] Add no-infra-wheels jobsRadosław Piliszek1-0/+2
Since Kolla is run in the wild against PyPI mirrors which do not include the OpenDev-provided wheels, it might be nice to be able to test these scenarios in the CI. These jobs are added to the experimental queue so that they do not consume resources when not needed. Any Gerrit user may run them now to verify whether the change passes them. Change-Id: I9c33eeaf03be037651f82c831f0e07ab9a27752a
2020-06-18CI: use wheels from infra mirrorMarcin Juszkiewicz1-0/+1
If they are available then we do not need to build them. Especially AArch64 jobs will speedup (once wheels are built). Change-Id: I79af6c37950e156018a9204fbcc7417cd7d41012
2020-06-18CI: fix line merge in CentOS buildsMarcin Juszkiewicz1-1/+1
Looks like I missed one situation with "base/centos: take care of whitespaces" change. Change-Id: Id7b5e8ddf23f9ab13806fb02042e76183bcddf05
2020-05-17base/centos: take care of whitespacesMarcin Juszkiewicz1-3/+3
Let's get rid of this warning: Change-Id: I121e2ecb30ec6e8d1b6d88d9b921894438c3e094 INFO:kolla.common.utils.base:ESC[91m[WARNING]: Empty continuation line found in: INFO:kolla.common.utils.base: RUN dnf -y install centos-release-opstools epel-release dnf-plugins-core && dnf config-manager --enable PowerTools && dnf config-manager --disable centos-ceph-nautilus && dnf config-manager --disable centos-nfs-ganesha28 && dnf config-manager --disable influxdb && rpm --import /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-OpsTools && dnf -y distro-sync --security --sec-severity=Important --sec-severity=Critical INFO:kolla.common.utils.base:[WARNING]: Empty continuation lines will become errors in a future release. INFO:kolla.common.utils.base:ESC[0m INFO:kolla.common.utils.base:Step 1/39 : FROM centos:8
2020-04-15Merge "Remove support for CentOS 7"Zuul1-23/+0
2020-04-15Remove support for CentOS 7Marcin Juszkiewicz1-23/+0
With the move to RHEL/CentOS 8 we no longer have Python 2 in our images so there is no need for checking which Python version (2.x or 3.x) is used inside of containers. We also no longer have to support yum as a value for distro_package_manager. Partially-Implements: blueprint centos-rhel-8 Change-Id: Ie45cf3465fedddbde7856961527421883ba3d5c9
2020-04-08CI: add Centos 8 and Ubuntu jobs for aarch64Marcin Juszkiewicz1-0/+1
also simplify Debian job definition Depends-on: https://review.opendev.org/718413 Depends-on: https://review.opendev.org/718363 Depends-on: https://review.opendev.org/718236 Depends-on: https://review.opendev.org/718238 Change-Id: I2c75dbc2ea063dd3507eaaf93a484c50acae5fb5
2020-04-03CI: Avoid toxRadosław Piliszek1-0/+5
We don't need tox nor tell our users to use it when doing kolla builds. Tox is going away from base infra images (it is already gone from aarch64 ones). Depends-on: https://review.opendev.org/713134 Co-authored-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Change-Id: Ib1d97a783951ac42740ebf91bcc6ecaf2bf70853
2020-04-03CI: Add https match for mirror.centos.org to template-overridesMichal Nasiadka1-0/+3
Some CentOS repos (currently one - Ceph NFS Ganesha) use https://mirror.centos.org instead of http:// and we break their definition by removing mirrorlist= entry and not inserting baseurl entry due to a missing match. Change-Id: I7b29f8c6be80820042023d2b85162d5cc9a65f08
2020-03-19CI: publish AArch64 Debian/source imagesMarcin Juszkiewicz1-1/+2
We want to test upgrades on aarch64. For this we need to publish images. AArch64 images will get "-aarch64" added to tag to not collide with x86-64 ones. Change-Id: Ibae2578b4bc18c0ab7fcc1840c39bb86659ab920
2020-03-17CentOS 8: Switch default base image, tag as masterMark Goddard1-3/+1
Changes the default base tag and distro for CentOS images from 7 to 8. Also changes the tag used by the publisher jobs for CentOS 8 images from 'master-centos8' to 'master'. Change-Id: I5498141ade23219d63f34debc2b8e1330dec2e68 Partially-Implements: blueprint centos-rhel-8
2020-03-13CI: Use network mode = hostRadosław Piliszek1-0/+3
This avoids issues with IPv6 not enabled in docker. Change-Id: Iff80392357ef5e2dd3f2e24dbf4df299660805b9
2020-02-05CentOS 8: Fix CentOS 7 publisher tagMark Goddard1-1/+1
Currently we use CentOS 8 nodepool images for all CI build jobs. This means we can't use the ansible_distribution_major_version fact to detect whether we are building CentOS 7 or 8 images. Due to this, all CentOS images (including CentOS 7) are currently published with a 'master-centos8' tag. This change fixes the issue by using the base_tag variable which is defined for CentOS 8 build jobs. Change-Id: I29b7b8ee742120107a11bd419ac58ab5c09b0b75 Partially-Implements: blueprint centos-rhel-8
2020-01-30Merge "CentOS 8: Update packages in images"Zuul1-1/+1
2020-01-30CI: Fix tag suffix logic for CentOS 8Mark Goddard1-1/+1
On CentOS, ansible_distribution is 'CentOS' rather than 'centos'. Our logic when setting the image tag for publisher jobs is incorrect, meaning that the centos8 publisher publishes images as 'master' rather than 'master-centos8'. Since this job only has two images it is likely to complete before the CentOS 7 publisher, so hopefully images will not be broken for long. This change fixes the issue by using a case-insensitive comparison. Change-Id: I66c93e07fe5c6c143e9cf65c6451e573bbfc51d8 Partially-Implements: blueprint centos-rhel-8
2020-01-29Merge "CentOS 8: base and openstack-base images"Zuul1-2/+17
2020-01-29CentOS 8: Update packages in imagesMark Goddard1-1/+1
* Some further changes for python2 vs python3 packages * Allow rabbitmq 3.7.*, since a newer erlang is available * Switch from qemu-img-ev to qemu-img on CentOS 8 * bridge-utils no longer available on CentOS 8 * libvirt-daemon-driver-lxc no longer available on CentOS 8 * Mark some more images buildable for CentOS 8 Change-Id: Iaf5b68ff6d944ae730ca0b1d5832172c106a6c08 Partially-Implements: blueprint centos-rhel-8 Partially-Implements: blueprint centos-rhel-python-3
2020-01-20Revert "Debian/source: do not force tag in build jobs"Radosław Piliszek1-1/+0
This reverts commit ca4da16836e4b3ef1d84059a63378c3f5bb2517e. This is adapted to revert only the missed part of aarch64 publisher which now blocks publishing for debian. Change-Id: I02932857454bdb09b72f539038d394760457109d
2020-01-14Debian/source: do not force tag in build jobsMarcin Juszkiewicz1-0/+1
Multiarch publisher uses 'branch-arch' so set it in kolla-build.conf file. Change-Id: I1af17edc9671237d270c5c6fe70e4420199bdb02
2020-01-14Merge "CentOS 8: Don't force tag in build jobs"Zuul1-1/+3
2020-01-14Ubuntu: use local APT mirrors if possibleMarcin Juszkiewicz1-1/+1
APT has a way to fetch mirror list and autoselect best mirror. Change-Id: I8209770ca1353fd89aacef0859ca3a373645c6b2
2020-01-13CentOS 8: Don't force tag in build jobsMark Goddard1-1/+3
We should allow the tag set in kolla-build.conf to be used for the image tags, since our deploy jobs need to set it to change_XXXXXXX when images are built for the job. Change-Id: I705514ee0249ff1d309e280001d653271e3686af Partially-Implements: blueprint centos-rhel-8
2020-01-10CI: use Debian/Ubuntu mirrors in base imageMarcin Juszkiewicz1-6/+3
So far we built 'base' image using upstream mirrors and then replaced them with OpenStack infra ones. Let do that right after we copy own APT sources.list file. Change-Id: Icb745f628c1c50d9f20df022b08ddc46fccc270c
2020-01-10Use Debian mirror in CI jobsMarcin Juszkiewicz1-2/+11
There is Debian mirror on each CI worker so we should use it. Change-Id: Id3b55ac470a977be7ee7decdef3b49e8d89a130f
2020-01-09CentOS 8: base and openstack-base imagesMark Goddard1-2/+17
Adds support to the base and openstack-base images for CentOS 8. These images have been removed from the list of unbuildable images, and replaced with all dependent images. Change-Id: I18fba8a5c2f99b700990cbf41c76077a1ec2408a Partially-Implements: blueprint centos-rhel-8
2019-12-16Add Debian/source aarch64 CI jobMarcin Juszkiewicz1-1/+1
AArch64 is getting popular and not all changes working on x86-64 work properly on aarch64 architecture. Let check them. Job is running in separate pipeline due to low number of aarch64 nodes. Authored-By: Xinliang Liu <xinliang.liu@linaro.org> Co-Authored-By: Jeffrey Zhang <zhang.lei.fly@gmail.com> Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Implements: blueprint aarch64-3rd-party-ci-kolla Depends-On: https://review.opendev.org/#/c/698606 Change-Id: I7e7802dfa4f4d9c61d01dba4b77c01cfb24301c0
2019-11-14Merge "Revert "Move to RDO Train packages""Zuul1-0/+4
2019-11-13Revert "Move to RDO Train packages"Radosław Piliszek1-0/+4
This reverts commit c78c82c9630b334cbaef040d68bce7e5ae8cc118. Change-Id: I61c68bf738673a96dd5ba256e40e8532364ff281
2019-10-29Merge "Remove /var/yum/cache from CentOS base image"Zuul1-4/+2
2019-10-28Remove /var/yum/cache from CentOS base imageMark Goddard1-4/+2
Since https://review.opendev.org/#/c/682600/, the following lines result in /var/yum/cache being present in one of the layers of the base image: RUN {{ macros.install_packages(base_centos_yum_repo_packages | customizable("centos_yum_repo_packages"), chain=True, clean=False) }} \ {% for repo in base_centos_yum_repos_to_disable | customizable('centos_yum_repos_to_disable') -%} && yum-config-manager --disable {{ repo }} \ {% endfor -%} {% for key in base_centos_yum_repo_keys | customizable('centos_yum_repo_keys') -%} && rpm --import {{ key }} \ {% endfor -%} && /bin/true {% block base_centos_repo_overrides_post_yum %}{% endblock %} RUN {{ macros.rpm_security_update(clean_package_cache) }} This is because it is not cleaned in the first RUN statement. This adds 76MB to the image. Also, using two separate RUNs which results in an extra 23MB due to updates to /var/lib/rpm/Packages. Found via https://github.com/wagoodman/dive. Change-Id: I0302ee1dfc10a2b7df127ac6a7764a84b1d74a33 Closes-Bug: #1850036
2019-10-21Move to RDO Train packagesMichal Nasiadka1-4/+0
Change-Id: I396f929ecc11f87fb83585bedd39be93a605c57b
2019-09-17CI: CentOS - override mirrors ASAP + crmsh mirror overrideRadosław Piliszek1-13/+31
This makes mirrored repos used as soon as they are installed in the image, instead of hitting upstreams. This patch also adds crmsh override. Usable only after infra change merges. Depends-on: https://review.opendev.org/682576 Change-Id: Ic7494eff4c740b6e528da4508dc88a64e697bc04 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-09-12Drop Percona XtraBackup in favour of MariaDB BackupMarcin Juszkiewicz1-3/+0
XtraBackup started failing to install on Ubuntu and does not support MariaDB 10.3 version. Related-Bug: #1843043 Change-Id: I9cf62c8e03a02574d85e5349df1d23a51d4c99be
2019-07-03CI: Clean up Zuul repo mirrors for CentOSRadosław Piliszek1-10/+14
- unify RDO mirror definition with others - drop definitions of unused mirrors: grafana, elastic - clean up the process of mirror substitution: - use the more common style of sed d command - apply more specific substitutions Change-Id: Idad2c6956cca647d4c865d6f6149ea37164db568 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-27Merge "Clean up test process"Zuul1-1/+1
2019-06-25Remove Oracle Linux stuff in CI codeRadosław Piliszek1-23/+0
Oracle Linux is no longer tested via CI after [1]. This patch removes OL support from Zuul files. [1] https://review.opendev.org/664217 Change-Id: I527aba3635ef82e2d2a88ee7f5250bf03e420800 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-20Clean up test processRadosław Piliszek1-1/+1
If stestr failed, then no node info was logged. Logging node info is now handled in pre and post stages of Zuul. Additionally Zuul v3 migration recommendations were applied and some unused code removed improving general readability. Change-Id: Iae9d37cb76997ba8389e21c7e2a3bf5905abe029 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
generated by cgit v1.2.3 (git 2.39.1) at 2026-11-05 18:23:22 +0000