aboutsummaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2022-06-23[CI] Drop bindepRadosław Piliszek1-2/+0
It is not necessary and it may be confusing. Change-Id: Ie84bce6a90de622dc76a2309fc579d881325b956
2022-05-29Use the new image naming scheme by defaultRadosław Piliszek1-1/+0
Adds a relevant reno to inform users about the change and the possibility to customise the prefix. Additionally, this patch includes the fix to Ubuntu image builds regarding rabbitmq and erlang. Both the changes are required to fix master CI. Change-Id: I6bc8b489a810849744c8bead6b9e350c5d3e36b7 Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/843752
2022-05-21[CI] Fix tags in publishingRadosław Piliszek1-1/+1
The original patch did not insert dashes as promised in the commit message. [1] [1] https://review.opendev.org/c/openstack/kolla/+/840164 Change-Id: Ibd6e06502ce56f5e0b44dea604ffee2fd9b7b8be
2022-05-02[publishing] use a new naming schemeRadosław Piliszek1-1/+2
This change switches published images names from the current format <base_distro>-<image_name>:<openstack_release>-<arch_suffix> to a preciser and image-oriented (for better variant listing) format <image_name>:<openstack_release>-<base_distro>-<base_distro_version>-<arch_suffix> Change-Id: I6a4b5c2087b94f96f72aa9d0d0781ff14d3ee6bb
2022-04-21switch to short image names by defaultMarcin Juszkiewicz1-2/+0
We can drop temporary 'use-short-names' argument and make short (kolla/debian-nova-libvirt:master) image names default. Kolla Ansible is using short names now. Change-Id: I153355353cd12aa25adaa9c87438a478748dfb28
2022-04-19add a way to not have 'install_type' in image name (temporary)Marcin Juszkiewicz1-0/+2
--use-short-names argument drops 'install_type' from image names: kolla/debian-openstack-base:14.1.0 This should allow to get rid of '-source' in image names without disrupting CI jobs. Switch publish jobs to use short names so k-a tests will have ready to use images for both long and short names. Change-Id: I29c9d51f4b518a4e2d3157ab5d6cc434fb83f2ef
2022-04-15enable logging to file for quiet modeMarcin Juszkiewicz1-0/+1
We have 'quiet' mode where only minimal data is printed to the console. But there were no logs at all then. This change generates log files (if 'logs-dir' argument is used) during quiet build. Also enables 'quiet' mode for CI so Zuul will not have to parse 29MB JSON file each time. Change-Id: If7d5c2807f0947a8bbbc1ceb8531c9b9c9287c1f
2022-04-15Revert "CI: add templated Dockerfiles to build logs"Radosław Piliszek1-1/+0
This reverts commit 09c890b12463a4b2c8767231189e7016f337fbc3. Reason for revert: That change caused all Kolla's work items to be transferred. This includes tarballs, their extracted contents, cloned git repositories, etc. to also be transferred to swift which takes extra time, pollutes logs and decreases the stability of jobs slightly (the mechanism is not designed for this kind of load). The collection of templated Dockerfiles in CI has to be reimplemented if it is wanted. Change-Id: Ideaf66ce18c993802f4d20f490caa47cec0dde5e
2022-04-11CI: drop install_type from build jobsMarcin Juszkiewicz1-1/+0
Change-Id: If524e45dc262efb253fc06329d4567412282926d
2022-03-11Unify curl use (customisation options)Maksim Malchuk1-1/+1
This change adds and unifies an ability to override hardcoded URLs for air-gapped environments via the usual blocks mechanism. Also, this change replaces ENV with ARG instruction for the variables used only in building images, and uses bash variable expansion where it possible. This change is a continuation of the I46b77978926fc2b578a68d1aaa944b2198af0685 Change-Id: I1fbad333b1bc95484e6f4c5145d5936a0e2db84f Signed-off-by: Maksim Malchuk <maksim.malchuk@gmail.com>
2021-09-08[CI] Drop support for publishing versioned image tagsRadosław Piliszek1-1/+1
Follow-up on I3259c0736a296751129aa349e8d378c0123957e6 Change-Id: I6b8935b16390a301602218ce35edfe132b140a4c
2021-08-04Merge "drop leftovers of RHEL support"Zuul1-1/+1
2021-07-29test-requirements: remove not needed entriesMarcin Juszkiewicz2-96/+0
Locally all tox tests passed without those requirements. Also removed keystoneclient test. We are building images not clients. Change-Id: I89578f0d7710cb38db12bf862584f13b49af20ef
2021-07-28drop leftovers of RHEL supportMarcin Juszkiewicz1-1/+1
As a project we never built RHEL based images so support for them was not tested. Change-Id: I27dfe34ade088228d71f6857ec4f3ab28ee63915
2021-07-01CI: Fix epel url overrideMichał Nasiadka1-3/+3
epel-release now installs epel*.repos with following baseurl: baseurl=https://download.example/pub/epel/$releasever/Everything/$basearch Change-Id: I19f57d258021ff660df6b6b95e8205b69f3bea85
2021-06-28[CI] Do not set ansible_python_interpreter for ZuulRadosław Piliszek2-11/+7
Zuul 4.6.0 does not allow to set ansible_python_interpreter. [1] Instead, with the current Zuul and Ansible, this should be automatically set to the proper python. This patch is required to restore the jobs which are ignored otherwise. [2] [3] Additionally, this change avoids the use of Ansible's pip module because it tries to use setuptools from the ansible_python_interpreter first even if another executable is set. [1] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023291.html [2] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023326.html [3] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023321.html Change-Id: Ib74eecd46617af51e23a3ccad664767b1bf6e04f
2021-06-10Revert "[CI] Add grafana to allowed-to-fail"Radosław Piliszek1-2/+0
This reverts commit a6884085e1a5336f17c2ed64f67d8f885c454207. Reason for revert: Repo is fine again. Change-Id: I60a76f42708f1746bd2c582ce25867ac34c9e865
2021-06-10[CI] Add grafana to allowed-to-failRadosław Piliszek1-0/+2
The grafana repo is broken for Debuntu. Change-Id: I7f79aeab53540df9bf84add6df3add300c9e9fa4
2021-05-20Revert "CI: add monasca-grafana to allowed-to-fail images"Marcin Juszkiewicz1-4/+0
This reverts commit 931d401887252d8830ebfb4d0b5d352f77094e9a. Reason for revert: monasca-grafana is no more Change-Id: I483db6d6eddd84b376251b38509e74d4a5c2a10b Depends-on: https://review.opendev.org/c/openstack/kolla/+/784902
2021-05-08Merge "CI: drop bashism from template overrides"Zuul1-1/+1
2021-05-04[CI] Trust only infra mirrorsRadosław Piliszek1-22/+10
Infra mirrors get their indices rebuilt to avoid broken indices (due to partial update). Unfortunately, this wipes out the cryptographic signatures. Our approach so far was disabling apt security features globally. However, this is not a valid choice for external repos. It hid an issue we introduced with new RabbitMQ repos missing proper keys installed in the image. This caused permanent failures outside of our CI. Our process should be as close as possible to users' experience. This patch makes CI trust only the mirrors that have their indices rebuilt (so infra mirrors). Change-Id: Ic5abc4b87fd76f87aba383abf43e95ba70629fcb
2021-05-04CI: drop bashism from template overridesMarcin Juszkiewicz1-1/+1
[[ is bash only In many distributions /bin/sh == bash but not in Debian and derived where it is dash (very simple POSIX shell). Change-Id: I2b084ea78b236623b174473f411bae04e624a3e9
2021-04-26move to Debian 'bullseye'Marcin Juszkiewicz1-1/+1
Bullseye is now in hard freeze cycle and goes for release. https://release.debian.org/bullseye/freeze_policy.html Co-Authored-By: Michal Nasiadka <mnasiadka@gmail.com> Change-Id: I543965a2741cebfa759576a4c75669a7bacd4208
2021-04-08Merge "[CI] Publish images to quay.io on a daily basis"Zuul2-11/+29
2021-04-06[CI] Publish images to quay.io on a daily basisRadosław Piliszek2-11/+29
Based on the discussions from the past 3 Kolla meetings [1][2][3], we established that, to avoid the DockerHub pull limit issues in our CI, we will try using quay.io. We still publish weekly to the DockerHub. [1] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-17-15.00.log.html#l-102 [2] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-24-15.00.log.html#l-137 [3] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-31-15.01.log.html#l-50 Change-Id: I7c1f0c5fc643678b29f963b6769d8f900a03b726 Depends-On: Id113a53c083d105ac9200474ff20faacef6decaf
2021-04-06CI: add monasca-grafana to allowed-to-fail imagesMark Goddard1-0/+4
The monasca-grafana image is currently failing to build. INFO:kolla.common.utils.monasca-grafana:go install -v ./pkg/cmd/grafana-server INFO:kolla.common.utils.monasca-grafana:[91mgo: cannot find main module, but found vendor/vendor.json in /grafana/src/github.com/grafana/grafana INFO:kolla.common.utils.monasca-grafana: to create a module there, run: INFO:kolla.common.utils.monasca-grafana: go mod init Let's unblock the gate and diagnose asynchronously. Change-Id: Id113a53c083d105ac9200474ff20faacef6decaf
2021-02-10Make kolla_set_configs open files in binary modeRadosław Piliszek1-0/+23
This fixes comparisons when files are not Unicode-encoded. A relevant unit test is included. It can be used as a base for other _cmp_file method unit tests if the need arises. Change-Id: Ic638516eb92d24ad247a7866fd1b5e2ac0400388 Closes-Bug: #1913952
2021-01-26Merge "Remove two missed unicode flags"Zuul1-2/+2
2021-01-25Remove two missed unicode flagsRadosław Piliszek1-2/+2
Change-Id: I799bf8edfef6ff68382d651dca6de96fa80ed733
2021-01-15CI: Use Docker proxy for pullsMichał Nasiadka1-0/+20
Change-Id: I0c4d5e1ea16c6677813a334b38b3a22ad811531d
2020-12-17CI: revert to public package mirrors after buildMark Goddard1-3/+56
When building images in CI, we use local package mirrors to reduce external network traffic. These mirrors are not necessarily reliable nor are they guaranteed to be accessible outside of the CI environment (although many are). While it is an antipattern to install packages in containers at runtime, the Bifrost container does just that. If the mirrors configured in the image are unavailable, Bifrost deployment can fail. This change fixes the issue by reverting to public package mirrors as a final step of the image build process. Closes-Bug: #1902101 Change-Id: I2592a736206eaec811290e9fbdbf2540c0518ffe
2020-12-15Fix publishing loginRadosław Piliszek1-2/+2
Login to DockerHub was failing because of trailing newlines in the encrypted credentials. This patch makes the playbook trim them before usage. Change-Id: I411f91af927ffa4d04c8021ddb5c3d584d90bdfd
2020-11-26CI: Ensure docker-py is installed on publishMichał Nasiadka1-0/+6
After a recent change [1] publish jobs are failing on missing docker python SDK. [1]: https://review.opendev.org/c/openstack/kolla/+/763146 Change-Id: I63662dd903b914fe06165b45e0a0bb5ca74b21b9
2020-11-24Merge "CI: add templated Dockerfiles to build logs"Zuul1-0/+1
2020-11-19CI: Improve publish playbookMichał Nasiadka1-3/+15
Currently we use a for loop in shell that performs push of images to Docker Hub - that doesn't really seem to fail properly on push errors (e.g. related to new Docker Hub limits). This change introduces usage of Ansible docker_* modules for doing the same job and improves logging (so it's easier to find out which image failed to publish). Change-Id: I083ce70772edd1abb873ad43f6beb73aae01383f
2020-11-17CI: add templated Dockerfiles to build logsMark Goddard1-0/+1
Change-Id: I702f8fba37e22a6bb45eae14f1fbb251bcdb4d8a
2020-10-28[CI] Use local RDO mirrorRadosław Piliszek1-1/+3
Fixes a FIXME. Change-Id: I2e6e07d6f466a7485ce6481e6e43b034fdc27f41
2020-09-16[CI] Support building source images with in-review changesMark Goddard2-22/+25
Following this change it is possible to add 'Depends-On' lines to a kolla commit message that point to reviews in other projects. For example, this could be used to test building and deploying container images containing a change to the nova project that is currently in review. It also allows to introduce jobs testing against Kolla in other projects. The kolla-build-config Ansible role can also be used by other projects, such as kolla-ansible, to generate the necessary configuration. This takes us closer to the Kolla Builder - Next Generation concept [1]. [1] http://lists.openstack.org/pipermail/openstack-discuss/2020-April/014255.html Change-Id: Ia2efa6b5d7278b75ab8dec23207f92d6bd7c58f0 Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2020-08-30Update imp module to importlibzhoulinhui1-2/+12
The imp module is deprecated[1] since version 3.4, use importlib to instead 1: https://docs.python.org/3/library/imp.html Change-Id: I79dfd923531dd3e00d23e1682865f56f0cf437d2
2020-08-28Fix kolla_set_configs --check with a directoryMark Goddard1-0/+41
There are several issues with kolla_set_configs --check: 1. We calculate the destination path incorrectly when comparing a file in a directory, due to passing arguments to os.path.relpath in the wrong order 2. For directories that have not changed, we also attempt to compare them as files, which fails when they are open()ed. 3. If the config JSON does not have a config_files key, it fails with a KeyError. The first two issues affect the fluentd container, which specifies directories as the source, without using a glob. The third affects OVN containers. This patch fixes these issues. Closes-Bug: #1890567 Change-Id: I8921befe51da4282121443849177a7ca5ebe8822
2020-08-12Merge "[CI] Add no-infra-wheels jobs"Zuul1-0/+2
2020-08-12[CI] Add no-infra-wheels jobsRadosław Piliszek1-0/+2
Since Kolla is run in the wild against PyPI mirrors which do not include the OpenDev-provided wheels, it might be nice to be able to test these scenarios in the CI. These jobs are added to the experimental queue so that they do not consume resources when not needed. Any Gerrit user may run them now to verify whether the change passes them. Change-Id: I9c33eeaf03be037651f82c831f0e07ab9a27752a
2020-08-11[CI] Fix wheel url for CentOSRadosław Piliszek1-1/+1
CentOS wheels do not differentiate between minor versions atm. Change-Id: I5365c813bab5e3205fd34eb64dc3337f192d67d4
2020-06-18CI: use wheels from infra mirrorMarcin Juszkiewicz2-0/+4
If they are available then we do not need to build them. Especially AArch64 jobs will speedup (once wheels are built). Change-Id: I79af6c37950e156018a9204fbcc7417cd7d41012
2020-06-18CI: fix line merge in CentOS buildsMarcin Juszkiewicz1-1/+1
Looks like I missed one situation with "base/centos: take care of whitespaces" change. Change-Id: Id7b5e8ddf23f9ab13806fb02042e76183bcddf05
2020-05-17base/centos: take care of whitespacesMarcin Juszkiewicz1-3/+3
Let's get rid of this warning: Change-Id: I121e2ecb30ec6e8d1b6d88d9b921894438c3e094 INFO:kolla.common.utils.base:ESC[91m[WARNING]: Empty continuation line found in: INFO:kolla.common.utils.base: RUN dnf -y install centos-release-opstools epel-release dnf-plugins-core && dnf config-manager --enable PowerTools && dnf config-manager --disable centos-ceph-nautilus && dnf config-manager --disable centos-nfs-ganesha28 && dnf config-manager --disable influxdb && rpm --import /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-OpsTools && dnf -y distro-sync --security --sec-severity=Important --sec-severity=Critical INFO:kolla.common.utils.base:[WARNING]: Empty continuation lines will become errors in a future release. INFO:kolla.common.utils.base:ESC[0m INFO:kolla.common.utils.base:Step 1/39 : FROM centos:8
2020-04-30CI: make sure that virtualenv is availableMarcin Juszkiewicz1-0/+9
Failed to find required executable virtualenv in paths: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games Change-Id: Ie6094e1c5de5c89e0180c42edf5ef94c1c9964b7
2020-04-15Merge "Remove support for CentOS 7"Zuul1-23/+0
2020-04-15Remove support for CentOS 7Marcin Juszkiewicz1-23/+0
With the move to RHEL/CentOS 8 we no longer have Python 2 in our images so there is no need for checking which Python version (2.x or 3.x) is used inside of containers. We also no longer have to support yum as a value for distro_package_manager. Partially-Implements: blueprint centos-rhel-8 Change-Id: Ie45cf3465fedddbde7856961527421883ba3d5c9
2020-04-08CI: add Centos 8 and Ubuntu jobs for aarch64Marcin Juszkiewicz1-0/+1
also simplify Debian job definition Depends-on: https://review.opendev.org/718413 Depends-on: https://review.opendev.org/718363 Depends-on: https://review.opendev.org/718236 Depends-on: https://review.opendev.org/718238 Change-Id: I2c75dbc2ea063dd3507eaaf93a484c50acae5fb5