summaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2020-09-16[CI] Support building source images with in-review changesMark Goddard2-22/+25
Following this change it is possible to add 'Depends-On' lines to a kolla commit message that point to reviews in other projects. For example, this could be used to test building and deploying container images containing a change to the nova project that is currently in review. It also allows to introduce jobs testing against Kolla in other projects. The kolla-build-config Ansible role can also be used by other projects, such as kolla-ansible, to generate the necessary configuration. This takes us closer to the Kolla Builder - Next Generation concept [1]. [1] http://lists.openstack.org/pipermail/openstack-discuss/2020-April/014255.html Change-Id: Ia2efa6b5d7278b75ab8dec23207f92d6bd7c58f0 Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2020-08-30Update imp module to importlibzhoulinhui1-2/+12
The imp module is deprecated[1] since version 3.4, use importlib to instead 1: https://docs.python.org/3/library/imp.html Change-Id: I79dfd923531dd3e00d23e1682865f56f0cf437d2
2020-08-28Fix kolla_set_configs --check with a directoryMark Goddard1-0/+41
There are several issues with kolla_set_configs --check: 1. We calculate the destination path incorrectly when comparing a file in a directory, due to passing arguments to os.path.relpath in the wrong order 2. For directories that have not changed, we also attempt to compare them as files, which fails when they are open()ed. 3. If the config JSON does not have a config_files key, it fails with a KeyError. The first two issues affect the fluentd container, which specifies directories as the source, without using a glob. The third affects OVN containers. This patch fixes these issues. Closes-Bug: #1890567 Change-Id: I8921befe51da4282121443849177a7ca5ebe8822
2020-08-12Merge "[CI] Add no-infra-wheels jobs"Zuul1-0/+2
2020-08-12[CI] Add no-infra-wheels jobsRadosław Piliszek1-0/+2
Since Kolla is run in the wild against PyPI mirrors which do not include the OpenDev-provided wheels, it might be nice to be able to test these scenarios in the CI. These jobs are added to the experimental queue so that they do not consume resources when not needed. Any Gerrit user may run them now to verify whether the change passes them. Change-Id: I9c33eeaf03be037651f82c831f0e07ab9a27752a
2020-08-11[CI] Fix wheel url for CentOSRadosław Piliszek1-1/+1
CentOS wheels do not differentiate between minor versions atm. Change-Id: I5365c813bab5e3205fd34eb64dc3337f192d67d4
2020-06-18CI: use wheels from infra mirrorMarcin Juszkiewicz2-0/+4
If they are available then we do not need to build them. Especially AArch64 jobs will speedup (once wheels are built). Change-Id: I79af6c37950e156018a9204fbcc7417cd7d41012
2020-06-18CI: fix line merge in CentOS buildsMarcin Juszkiewicz1-1/+1
Looks like I missed one situation with "base/centos: take care of whitespaces" change. Change-Id: Id7b5e8ddf23f9ab13806fb02042e76183bcddf05
2020-05-17base/centos: take care of whitespacesMarcin Juszkiewicz1-3/+3
Let's get rid of this warning: Change-Id: I121e2ecb30ec6e8d1b6d88d9b921894438c3e094 INFO:kolla.common.utils.base:ESC[91m[WARNING]: Empty continuation line found in: INFO:kolla.common.utils.base: RUN dnf -y install centos-release-opstools epel-release dnf-plugins-core && dnf config-manager --enable PowerTools && dnf config-manager --disable centos-ceph-nautilus && dnf config-manager --disable centos-nfs-ganesha28 && dnf config-manager --disable influxdb && rpm --import /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-OpsTools && dnf -y distro-sync --security --sec-severity=Important --sec-severity=Critical INFO:kolla.common.utils.base:[WARNING]: Empty continuation lines will become errors in a future release. INFO:kolla.common.utils.base:ESC[0m INFO:kolla.common.utils.base:Step 1/39 : FROM centos:8
2020-04-30CI: make sure that virtualenv is availableMarcin Juszkiewicz1-0/+9
Failed to find required executable virtualenv in paths: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games Change-Id: Ie6094e1c5de5c89e0180c42edf5ef94c1c9964b7
2020-04-15Merge "Remove support for CentOS 7"Zuul1-23/+0
2020-04-15Remove support for CentOS 7Marcin Juszkiewicz1-23/+0
With the move to RHEL/CentOS 8 we no longer have Python 2 in our images so there is no need for checking which Python version (2.x or 3.x) is used inside of containers. We also no longer have to support yum as a value for distro_package_manager. Partially-Implements: blueprint centos-rhel-8 Change-Id: Ie45cf3465fedddbde7856961527421883ba3d5c9
2020-04-08CI: add Centos 8 and Ubuntu jobs for aarch64Marcin Juszkiewicz1-0/+1
also simplify Debian job definition Depends-on: https://review.opendev.org/718413 Depends-on: https://review.opendev.org/718363 Depends-on: https://review.opendev.org/718236 Depends-on: https://review.opendev.org/718238 Change-Id: I2c75dbc2ea063dd3507eaaf93a484c50acae5fb5
2020-04-04Merge "CI: Ansiblify setup of builders"Zuul2-12/+52
2020-04-04Merge "CI: Avoid tox"Zuul4-140/+21
2020-04-03Merge "Update hacking for Python3"Zuul1-0/+1
2020-04-03CI: Ansiblify setup of buildersRadosław Piliszek2-12/+52
CI is set up using Ansible playbooks now. This also drops redundant shell scripts. Co-authored-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Change-Id: I5264746fd04276448f4668c3bb3a218a40e8660b
2020-04-03CI: Avoid toxRadosław Piliszek4-140/+21
We don't need tox nor tell our users to use it when doing kolla builds. Tox is going away from base infra images (it is already gone from aarch64 ones). Depends-on: https://review.opendev.org/713134 Co-authored-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Change-Id: Ib1d97a783951ac42740ebf91bcc6ecaf2bf70853
2020-04-03Merge "CI: Add https match for mirror.centos.org to template-overrides"Zuul1-0/+3
2020-04-03CI: Add https match for mirror.centos.org to template-overridesMichal Nasiadka1-0/+3
Some CentOS repos (currently one - Ceph NFS Ganesha) use https://mirror.centos.org instead of http:// and we break their definition by removing mirrorlist= entry and not inserting baseurl entry due to a missing match. Change-Id: I7b29f8c6be80820042023d2b85162d5cc9a65f08
2020-04-02Use unittest.mock instead of PyPI mockRadosław Piliszek2-2/+2
Now that py2 is gone, oslotest dropped dependency on mock and will soon affect Ussuri CI [1], let's use unittest.mock built in py3. This also fixes py38 jobs and proactively prevents py36 and py37 failing due to [1]. This is because we never included mock in test-requirements (but in lower-constraints where it does not really belong at all) and instead relied on oslotest to bring it in. [1] https://review.opendev.org/716322 Change-Id: Iceedcc7ad0d087414f6f94dfc0235fda4754be63
2020-04-01Update hacking for Python3Andreas Jaeger1-0/+1
The repo is Python 3 now, so update hacking to version 3.0 which supports Python 3. Fix problems found by updated hacking version. Update local hacking checks for new flake8. Remove hacking and friends from lower-constraints, they are not needed in installations. Change-Id: I67e5ca24c550163c218fb06692de0b7c528d8318
2020-03-19CI: publish AArch64 Debian/source imagesMarcin Juszkiewicz1-1/+2
We want to test upgrades on aarch64. For this we need to publish images. AArch64 images will get "-aarch64" added to tag to not collide with x86-64 ones. Change-Id: Ibae2578b4bc18c0ab7fcc1840c39bb86659ab920
2020-03-17Merge "CI: Install tox"Zuul1-0/+5
2020-03-17CI: Install toxMark Goddard1-0/+5
tox will be removed from the base image. Install it before that happens. This change is made in a simple way that can be easily backported. Change-Id: I2a24c87aa44c1e03ba76a2fb0bd71caf54eb4211
2020-03-17CentOS 8: Switch default base image, tag as masterMark Goddard2-4/+2
Changes the default base tag and distro for CentOS images from 7 to 8. Also changes the tag used by the publisher jobs for CentOS 8 images from 'master-centos8' to 'master'. Change-Id: I5498141ade23219d63f34debc2b8e1330dec2e68 Partially-Implements: blueprint centos-rhel-8
2020-03-13CI: Use network mode = hostRadosław Piliszek1-0/+3
This avoids issues with IPv6 not enabled in docker. Change-Id: Iff80392357ef5e2dd3f2e24dbf4df299660805b9
2020-02-13Revert "Upgrade virtualenv in pre"Radosław Piliszek1-5/+0
Reverts temporary. This reverts commit 063a46a7de4471504535499ca2a972a79e4ce5e5. Change-Id: Ibf2848db954862f917a23eb0aa1594ccc4e7ef67
2020-02-12Upgrade virtualenv in preMichal Nasiadka1-0/+5
Since virtualenv 20.0 (amongst other changes) six version >1.12.0 is required. This change adds upgrade of virtualenv and six in pre - to be reverted once infra CentOS images are sorted out. Depends-On: https://review.opendev.org/707377 Change-Id: I75249055989309d0afdfc29c894beb6b1fcd1994
2020-02-05CentOS 8: Fix CentOS 7 publisher tagMark Goddard1-1/+1
Currently we use CentOS 8 nodepool images for all CI build jobs. This means we can't use the ansible_distribution_major_version fact to detect whether we are building CentOS 7 or 8 images. Due to this, all CentOS images (including CentOS 7) are currently published with a 'master-centos8' tag. This change fixes the issue by using the base_tag variable which is defined for CentOS 8 build jobs. Change-Id: I29b7b8ee742120107a11bd419ac58ab5c09b0b75 Partially-Implements: blueprint centos-rhel-8
2020-01-30Merge "CentOS 8: Update packages in images"Zuul1-1/+1
2020-01-30CI: Fix tag suffix logic for CentOS 8Mark Goddard1-1/+1
On CentOS, ansible_distribution is 'CentOS' rather than 'centos'. Our logic when setting the image tag for publisher jobs is incorrect, meaning that the centos8 publisher publishes images as 'master' rather than 'master-centos8'. Since this job only has two images it is likely to complete before the CentOS 7 publisher, so hopefully images will not be broken for long. This change fixes the issue by using a case-insensitive comparison. Change-Id: I66c93e07fe5c6c143e9cf65c6451e573bbfc51d8 Partially-Implements: blueprint centos-rhel-8
2020-01-29Merge "CentOS 8: base and openstack-base images"Zuul1-2/+17
2020-01-29CentOS 8: Update packages in imagesMark Goddard1-1/+1
* Some further changes for python2 vs python3 packages * Allow rabbitmq 3.7.*, since a newer erlang is available * Switch from qemu-img-ev to qemu-img on CentOS 8 * bridge-utils no longer available on CentOS 8 * libvirt-daemon-driver-lxc no longer available on CentOS 8 * Mark some more images buildable for CentOS 8 Change-Id: Iaf5b68ff6d944ae730ca0b1d5832172c106a6c08 Partially-Implements: blueprint centos-rhel-8 Partially-Implements: blueprint centos-rhel-python-3
2020-01-20CI: Fix symlinks to failed logsRadosław Piliszek1-13/+0
Stop renaming files. Swift should be able to serve text/plain files based on content, not extension. Failed logs symlinks were broken because we stopped gzipping log files and improperly rewrote the logic there. Change-Id: Idddf51730821644948f51577807f5beaa18c6262
2020-01-20Revert "Debian/source: do not force tag in build jobs"Radosław Piliszek1-1/+0
This reverts commit ca4da16836e4b3ef1d84059a63378c3f5bb2517e. This is adapted to revert only the missed part of aarch64 publisher which now blocks publishing for debian. Change-Id: I02932857454bdb09b72f539038d394760457109d
2020-01-16Merge "Revert "Add AArch64 publisher for Debian/source""Zuul1-24/+0
2020-01-15Revert "Add AArch64 publisher for Debian/source"Marcin Juszkiewicz2-27/+0
Turned out that linaro-london network pipe is too thin to support this job. Pushing images took 3 hours so job timed out. Will check it once new nodes arrive. This reverts commit f2801fabdd727fc72a28b056d79787af484424a7. Change-Id: I8897ede43f11090902fe7c0c096f17f57c1c9c67
2020-01-14Debian/source: do not force tag in build jobsMarcin Juszkiewicz2-3/+1
Multiarch publisher uses 'branch-arch' so set it in kolla-build.conf file. Change-Id: I1af17edc9671237d270c5c6fe70e4420199bdb02
2020-01-14Merge "CentOS 8: Don't force tag in build jobs"Zuul2-7/+7
2020-01-14Merge "Ubuntu: use local APT mirrors if possible"Zuul1-1/+1
2020-01-14Merge "Add AArch64 publisher for Debian/source"Zuul2-0/+27
2020-01-14Ubuntu: use local APT mirrors if possibleMarcin Juszkiewicz1-1/+1
APT has a way to fetch mirror list and autoselect best mirror. Change-Id: I8209770ca1353fd89aacef0859ca3a373645c6b2
2020-01-13CentOS 8: Don't force tag in build jobsMark Goddard2-7/+7
We should allow the tag set in kolla-build.conf to be used for the image tags, since our deploy jobs need to set it to change_XXXXXXX when images are built for the job. Change-Id: I705514ee0249ff1d309e280001d653271e3686af Partially-Implements: blueprint centos-rhel-8
2020-01-13Merge "CI: use Debian/Ubuntu mirrors in base image"Zuul1-6/+3
2020-01-13Merge "Use Debian mirror in CI jobs"Zuul1-2/+11
2020-01-13Merge "CI: Fix symlinks for failed build logs"Zuul1-6/+0
2020-01-10CI: use Debian/Ubuntu mirrors in base imageMarcin Juszkiewicz1-6/+3
So far we built 'base' image using upstream mirrors and then replaced them with OpenStack infra ones. Let do that right after we copy own APT sources.list file. Change-Id: Icb745f628c1c50d9f20df022b08ddc46fccc270c
2020-01-10Use Debian mirror in CI jobsMarcin Juszkiewicz1-2/+11
There is Debian mirror on each CI worker so we should use it. Change-Id: Id3b55ac470a977be7ee7decdef3b49e8d89a130f
2020-01-10Merge "CentOS 8: Add zuul build and publish jobs"Zuul2-1/+25
generated by cgit v1.2.3 (git 2.39.1) at 2026-11-05 20:51:14 +0000