aboutsummaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2020-04-04Merge "CI: Ansiblify setup of builders"Zuul2-12/+52
2020-04-04Merge "CI: Avoid tox"Zuul4-140/+21
2020-04-03Merge "Update hacking for Python3"Zuul1-0/+1
2020-04-03CI: Ansiblify setup of buildersRadosław Piliszek2-12/+52
CI is set up using Ansible playbooks now. This also drops redundant shell scripts. Co-authored-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Change-Id: I5264746fd04276448f4668c3bb3a218a40e8660b
2020-04-03CI: Avoid toxRadosław Piliszek4-140/+21
We don't need tox nor tell our users to use it when doing kolla builds. Tox is going away from base infra images (it is already gone from aarch64 ones). Depends-on: https://review.opendev.org/713134 Co-authored-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Change-Id: Ib1d97a783951ac42740ebf91bcc6ecaf2bf70853
2020-04-03Merge "CI: Add https match for mirror.centos.org to template-overrides"Zuul1-0/+3
2020-04-03CI: Add https match for mirror.centos.org to template-overridesMichal Nasiadka1-0/+3
Some CentOS repos (currently one - Ceph NFS Ganesha) use https://mirror.centos.org instead of http:// and we break their definition by removing mirrorlist= entry and not inserting baseurl entry due to a missing match. Change-Id: I7b29f8c6be80820042023d2b85162d5cc9a65f08
2020-04-02Use unittest.mock instead of PyPI mockRadosław Piliszek2-2/+2
Now that py2 is gone, oslotest dropped dependency on mock and will soon affect Ussuri CI [1], let's use unittest.mock built in py3. This also fixes py38 jobs and proactively prevents py36 and py37 failing due to [1]. This is because we never included mock in test-requirements (but in lower-constraints where it does not really belong at all) and instead relied on oslotest to bring it in. [1] https://review.opendev.org/716322 Change-Id: Iceedcc7ad0d087414f6f94dfc0235fda4754be63
2020-04-01Update hacking for Python3Andreas Jaeger1-0/+1
The repo is Python 3 now, so update hacking to version 3.0 which supports Python 3. Fix problems found by updated hacking version. Update local hacking checks for new flake8. Remove hacking and friends from lower-constraints, they are not needed in installations. Change-Id: I67e5ca24c550163c218fb06692de0b7c528d8318
2020-03-19CI: publish AArch64 Debian/source imagesMarcin Juszkiewicz1-1/+2
We want to test upgrades on aarch64. For this we need to publish images. AArch64 images will get "-aarch64" added to tag to not collide with x86-64 ones. Change-Id: Ibae2578b4bc18c0ab7fcc1840c39bb86659ab920
2020-03-17Merge "CI: Install tox"Zuul1-0/+5
2020-03-17CI: Install toxMark Goddard1-0/+5
tox will be removed from the base image. Install it before that happens. This change is made in a simple way that can be easily backported. Change-Id: I2a24c87aa44c1e03ba76a2fb0bd71caf54eb4211
2020-03-17CentOS 8: Switch default base image, tag as masterMark Goddard2-4/+2
Changes the default base tag and distro for CentOS images from 7 to 8. Also changes the tag used by the publisher jobs for CentOS 8 images from 'master-centos8' to 'master'. Change-Id: I5498141ade23219d63f34debc2b8e1330dec2e68 Partially-Implements: blueprint centos-rhel-8
2020-03-13CI: Use network mode = hostRadosław Piliszek1-0/+3
This avoids issues with IPv6 not enabled in docker. Change-Id: Iff80392357ef5e2dd3f2e24dbf4df299660805b9
2020-02-13Revert "Upgrade virtualenv in pre"Radosław Piliszek1-5/+0
Reverts temporary. This reverts commit 063a46a7de4471504535499ca2a972a79e4ce5e5. Change-Id: Ibf2848db954862f917a23eb0aa1594ccc4e7ef67
2020-02-12Upgrade virtualenv in preMichal Nasiadka1-0/+5
Since virtualenv 20.0 (amongst other changes) six version >1.12.0 is required. This change adds upgrade of virtualenv and six in pre - to be reverted once infra CentOS images are sorted out. Depends-On: https://review.opendev.org/707377 Change-Id: I75249055989309d0afdfc29c894beb6b1fcd1994
2020-02-05CentOS 8: Fix CentOS 7 publisher tagMark Goddard1-1/+1
Currently we use CentOS 8 nodepool images for all CI build jobs. This means we can't use the ansible_distribution_major_version fact to detect whether we are building CentOS 7 or 8 images. Due to this, all CentOS images (including CentOS 7) are currently published with a 'master-centos8' tag. This change fixes the issue by using the base_tag variable which is defined for CentOS 8 build jobs. Change-Id: I29b7b8ee742120107a11bd419ac58ab5c09b0b75 Partially-Implements: blueprint centos-rhel-8
2020-01-30Merge "CentOS 8: Update packages in images"Zuul1-1/+1
2020-01-30CI: Fix tag suffix logic for CentOS 8Mark Goddard1-1/+1
On CentOS, ansible_distribution is 'CentOS' rather than 'centos'. Our logic when setting the image tag for publisher jobs is incorrect, meaning that the centos8 publisher publishes images as 'master' rather than 'master-centos8'. Since this job only has two images it is likely to complete before the CentOS 7 publisher, so hopefully images will not be broken for long. This change fixes the issue by using a case-insensitive comparison. Change-Id: I66c93e07fe5c6c143e9cf65c6451e573bbfc51d8 Partially-Implements: blueprint centos-rhel-8
2020-01-29Merge "CentOS 8: base and openstack-base images"Zuul1-2/+17
2020-01-29CentOS 8: Update packages in imagesMark Goddard1-1/+1
* Some further changes for python2 vs python3 packages * Allow rabbitmq 3.7.*, since a newer erlang is available * Switch from qemu-img-ev to qemu-img on CentOS 8 * bridge-utils no longer available on CentOS 8 * libvirt-daemon-driver-lxc no longer available on CentOS 8 * Mark some more images buildable for CentOS 8 Change-Id: Iaf5b68ff6d944ae730ca0b1d5832172c106a6c08 Partially-Implements: blueprint centos-rhel-8 Partially-Implements: blueprint centos-rhel-python-3
2020-01-20CI: Fix symlinks to failed logsRadosław Piliszek1-13/+0
Stop renaming files. Swift should be able to serve text/plain files based on content, not extension. Failed logs symlinks were broken because we stopped gzipping log files and improperly rewrote the logic there. Change-Id: Idddf51730821644948f51577807f5beaa18c6262
2020-01-20Revert "Debian/source: do not force tag in build jobs"Radosław Piliszek1-1/+0
This reverts commit ca4da16836e4b3ef1d84059a63378c3f5bb2517e. This is adapted to revert only the missed part of aarch64 publisher which now blocks publishing for debian. Change-Id: I02932857454bdb09b72f539038d394760457109d
2020-01-16Merge "Revert "Add AArch64 publisher for Debian/source""Zuul1-24/+0
2020-01-15Revert "Add AArch64 publisher for Debian/source"Marcin Juszkiewicz2-27/+0
Turned out that linaro-london network pipe is too thin to support this job. Pushing images took 3 hours so job timed out. Will check it once new nodes arrive. This reverts commit f2801fabdd727fc72a28b056d79787af484424a7. Change-Id: I8897ede43f11090902fe7c0c096f17f57c1c9c67
2020-01-14Debian/source: do not force tag in build jobsMarcin Juszkiewicz2-3/+1
Multiarch publisher uses 'branch-arch' so set it in kolla-build.conf file. Change-Id: I1af17edc9671237d270c5c6fe70e4420199bdb02
2020-01-14Merge "CentOS 8: Don't force tag in build jobs"Zuul2-7/+7
2020-01-14Merge "Ubuntu: use local APT mirrors if possible"Zuul1-1/+1
2020-01-14Merge "Add AArch64 publisher for Debian/source"Zuul2-0/+27
2020-01-14Ubuntu: use local APT mirrors if possibleMarcin Juszkiewicz1-1/+1
APT has a way to fetch mirror list and autoselect best mirror. Change-Id: I8209770ca1353fd89aacef0859ca3a373645c6b2
2020-01-13CentOS 8: Don't force tag in build jobsMark Goddard2-7/+7
We should allow the tag set in kolla-build.conf to be used for the image tags, since our deploy jobs need to set it to change_XXXXXXX when images are built for the job. Change-Id: I705514ee0249ff1d309e280001d653271e3686af Partially-Implements: blueprint centos-rhel-8
2020-01-13Merge "CI: use Debian/Ubuntu mirrors in base image"Zuul1-6/+3
2020-01-13Merge "Use Debian mirror in CI jobs"Zuul1-2/+11
2020-01-13Merge "CI: Fix symlinks for failed build logs"Zuul1-6/+0
2020-01-10CI: use Debian/Ubuntu mirrors in base imageMarcin Juszkiewicz1-6/+3
So far we built 'base' image using upstream mirrors and then replaced them with OpenStack infra ones. Let do that right after we copy own APT sources.list file. Change-Id: Icb745f628c1c50d9f20df022b08ddc46fccc270c
2020-01-10Use Debian mirror in CI jobsMarcin Juszkiewicz1-2/+11
There is Debian mirror on each CI worker so we should use it. Change-Id: Id3b55ac470a977be7ee7decdef3b49e8d89a130f
2020-01-10Merge "CentOS 8: Add zuul build and publish jobs"Zuul2-1/+25
2020-01-10Add AArch64 publisher for Debian/sourceMarcin Juszkiewicz2-0/+27
This time proper approach involves job dependencies. First we build and publish x86-64 and aarch64 images with architecture name in image tag. Then we create multiarch manifests to create 'master' images. Change-Id: I6b9505dc326636fc6df8798c62c3a5eb1f728a51
2020-01-10CI: Fix symlinks for failed build logsMark Goddard1-6/+0
Follow up to I5b5f323471676317a2898875cbbf297082328fcc. Logs are no longer gzipped, so we do not need to modify the 000_FAILED_* symlinks. Change-Id: I5df42ac0ff91b1b97537a4fbc33fc7970f29d60e
2020-01-09CentOS 8: base and openstack-base imagesMark Goddard1-2/+17
Adds support to the base and openstack-base images for CentOS 8. These images have been removed from the list of unbuildable images, and replaced with all dependent images. Change-Id: I18fba8a5c2f99b700990cbf41c76077a1ec2408a Partially-Implements: blueprint centos-rhel-8
2020-01-09CentOS 8: Add zuul build and publish jobsMark Goddard2-1/+25
Adds build and publishing jobs for CentOS 8 images: - kolla-build-centos8-binary - kolla-build-centos8-source - kolla-publish-centos8-binary - kolla-publish-centos8-source The 'base' image has been added to the list of unbuildable images for CentOS 8 (now separate from the list for CentOS 7). This means that no images will be built - the jobs should essentially be a 'noop'. Change-Id: Ie9a0109bd4eef337358d714e4b5088b8e3de2f23 Partially-Implements: blueprint centos-rhel-8
2020-01-09Stop gzipping logs in postMichal Nasiadka1-4/+0
As per [1] we should stop compressing the logs sent to swift in order to get them back readable via a browser. [1]: http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html Change-Id: I5b5f323471676317a2898875cbbf297082328fcc
2019-12-16Add Debian/source aarch64 CI jobMarcin Juszkiewicz1-1/+1
AArch64 is getting popular and not all changes working on x86-64 work properly on aarch64 architecture. Let check them. Job is running in separate pipeline due to low number of aarch64 nodes. Authored-By: Xinliang Liu <xinliang.liu@linaro.org> Co-Authored-By: Jeffrey Zhang <zhang.lei.fly@gmail.com> Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Implements: blueprint aarch64-3rd-party-ci-kolla Depends-On: https://review.opendev.org/#/c/698606 Change-Id: I7e7802dfa4f4d9c61d01dba4b77c01cfb24301c0
2019-11-26CI: Move to CentOS 8 nodepool imagesMark Goddard1-2/+2
This change modifies the CentOS build CI jobs to use a CentOS 8 host image. NOTE: This does not affect the version of CentOS used as the base image in containers built by kolla. Partially-Implements: blueprint centos-rhel-8 Partially-Implements: blueprint centos-rhel-python3 Change-Id: Ie25b54a4e6116ed2bcb9c3b5c44eb6edbd2e6b49
2019-11-14Merge "Revert "Move to RDO Train packages""Zuul1-0/+4
2019-11-13Revert "Move to RDO Train packages"Radosław Piliszek1-0/+4
This reverts commit c78c82c9630b334cbaef040d68bce7e5ae8cc118. Change-Id: I61c68bf738673a96dd5ba256e40e8532364ff281
2019-11-05Merge "CI: drop the gate profile"Zuul1-28/+0
2019-10-29Merge "Remove /var/yum/cache from CentOS base image"Zuul1-4/+2
2019-10-28Remove /var/yum/cache from CentOS base imageMark Goddard1-4/+2
Since https://review.opendev.org/#/c/682600/, the following lines result in /var/yum/cache being present in one of the layers of the base image: RUN {{ macros.install_packages(base_centos_yum_repo_packages | customizable("centos_yum_repo_packages"), chain=True, clean=False) }} \ {% for repo in base_centos_yum_repos_to_disable | customizable('centos_yum_repos_to_disable') -%} && yum-config-manager --disable {{ repo }} \ {% endfor -%} {% for key in base_centos_yum_repo_keys | customizable('centos_yum_repo_keys') -%} && rpm --import {{ key }} \ {% endfor -%} && /bin/true {% block base_centos_repo_overrides_post_yum %}{% endblock %} RUN {{ macros.rpm_security_update(clean_package_cache) }} This is because it is not cleaned in the first RUN statement. This adds 76MB to the image. Also, using two separate RUNs which results in an extra 23MB due to updates to /var/lib/rpm/Packages. Found via https://github.com/wagoodman/dive. Change-Id: I0302ee1dfc10a2b7df127ac6a7764a84b1d74a33 Closes-Bug: #1850036
2019-10-25CI: drop the gate profileRadosław Piliszek1-28/+0
This profile has not been used since Kolla Ansible was separated. Also removes the relevant "tests". Change-Id: I29dbcea169a6e338bc9a8fb4fcde7a77c1d6fac6