aboutsummaryrefslogtreecommitdiff
path: root/tests/playbooks
AgeCommit message (Collapse)AuthorFilesLines
2022-09-27Move to CentOS Stream 9Marcin Juszkiewicz1-9/+7
OpenStack 'zed' requires Python 3.8+ so RHEL 8 family has to go. This changeset moves to CentOS Stream 9 while move to RockyLinux 9 is planned as final solution. CI moved to CentOS Stream 9 nodes. Depends-on: https://review.opendev.org/c/openstack/kolla-ansible/+/839715 Change-Id: I113b9984294cf8663d3fc0c8840320e1d40ea731
2022-07-26Merge "[CI] Drop bindep"Zuul1-2/+0
2022-07-25Fix container image publish to Docker HubPierre Riteau1-0/+1
Publishing container images to Docker Hub was failing with: state is present but all of the following are missing: source This is caused by the recent Ansible upgrade by Zuul [1]: the source parameter is mandatory since Ansible 2.12. [1] https://review.opendev.org/c/openstack/project-config/+/849120 Change-Id: I232fe835f5a650c258243f1ee4720480f2e6e7b1
2022-06-23[CI] Drop bindepRadosław Piliszek1-2/+0
It is not necessary and it may be confusing. Change-Id: Ie84bce6a90de622dc76a2309fc579d881325b956
2022-05-29Use the new image naming scheme by defaultRadosław Piliszek1-1/+0
Adds a relevant reno to inform users about the change and the possibility to customise the prefix. Additionally, this patch includes the fix to Ubuntu image builds regarding rabbitmq and erlang. Both the changes are required to fix master CI. Change-Id: I6bc8b489a810849744c8bead6b9e350c5d3e36b7 Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/843752
2022-05-21[CI] Fix tags in publishingRadosław Piliszek1-1/+1
The original patch did not insert dashes as promised in the commit message. [1] [1] https://review.opendev.org/c/openstack/kolla/+/840164 Change-Id: Ibd6e06502ce56f5e0b44dea604ffee2fd9b7b8be
2022-05-02[publishing] use a new naming schemeRadosław Piliszek1-1/+2
This change switches published images names from the current format <base_distro>-<image_name>:<openstack_release>-<arch_suffix> to a preciser and image-oriented (for better variant listing) format <image_name>:<openstack_release>-<base_distro>-<base_distro_version>-<arch_suffix> Change-Id: I6a4b5c2087b94f96f72aa9d0d0781ff14d3ee6bb
2022-04-21switch to short image names by defaultMarcin Juszkiewicz1-2/+0
We can drop temporary 'use-short-names' argument and make short (kolla/debian-nova-libvirt:master) image names default. Kolla Ansible is using short names now. Change-Id: I153355353cd12aa25adaa9c87438a478748dfb28
2022-04-19add a way to not have 'install_type' in image name (temporary)Marcin Juszkiewicz1-0/+2
--use-short-names argument drops 'install_type' from image names: kolla/debian-openstack-base:14.1.0 This should allow to get rid of '-source' in image names without disrupting CI jobs. Switch publish jobs to use short names so k-a tests will have ready to use images for both long and short names. Change-Id: I29c9d51f4b518a4e2d3157ab5d6cc434fb83f2ef
2022-04-15enable logging to file for quiet modeMarcin Juszkiewicz1-0/+1
We have 'quiet' mode where only minimal data is printed to the console. But there were no logs at all then. This change generates log files (if 'logs-dir' argument is used) during quiet build. Also enables 'quiet' mode for CI so Zuul will not have to parse 29MB JSON file each time. Change-Id: If7d5c2807f0947a8bbbc1ceb8531c9b9c9287c1f
2022-04-15Revert "CI: add templated Dockerfiles to build logs"Radosław Piliszek1-1/+0
This reverts commit 09c890b12463a4b2c8767231189e7016f337fbc3. Reason for revert: That change caused all Kolla's work items to be transferred. This includes tarballs, their extracted contents, cloned git repositories, etc. to also be transferred to swift which takes extra time, pollutes logs and decreases the stability of jobs slightly (the mechanism is not designed for this kind of load). The collection of templated Dockerfiles in CI has to be reimplemented if it is wanted. Change-Id: Ideaf66ce18c993802f4d20f490caa47cec0dde5e
2022-04-11CI: drop install_type from build jobsMarcin Juszkiewicz1-1/+0
Change-Id: If524e45dc262efb253fc06329d4567412282926d
2021-09-08[CI] Drop support for publishing versioned image tagsRadosław Piliszek1-1/+1
Follow-up on I3259c0736a296751129aa349e8d378c0123957e6 Change-Id: I6b8935b16390a301602218ce35edfe132b140a4c
2021-06-28[CI] Do not set ansible_python_interpreter for ZuulRadosław Piliszek2-11/+7
Zuul 4.6.0 does not allow to set ansible_python_interpreter. [1] Instead, with the current Zuul and Ansible, this should be automatically set to the proper python. This patch is required to restore the jobs which are ignored otherwise. [2] [3] Additionally, this change avoids the use of Ansible's pip module because it tries to use setuptools from the ansible_python_interpreter first even if another executable is set. [1] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023291.html [2] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023326.html [3] http://lists.openstack.org/pipermail/openstack-discuss/2021-June/023321.html Change-Id: Ib74eecd46617af51e23a3ccad664767b1bf6e04f
2021-06-10Revert "[CI] Add grafana to allowed-to-fail"Radosław Piliszek1-2/+0
This reverts commit a6884085e1a5336f17c2ed64f67d8f885c454207. Reason for revert: Repo is fine again. Change-Id: I60a76f42708f1746bd2c582ce25867ac34c9e865
2021-06-10[CI] Add grafana to allowed-to-failRadosław Piliszek1-0/+2
The grafana repo is broken for Debuntu. Change-Id: I7f79aeab53540df9bf84add6df3add300c9e9fa4
2021-05-20Revert "CI: add monasca-grafana to allowed-to-fail images"Marcin Juszkiewicz1-4/+0
This reverts commit 931d401887252d8830ebfb4d0b5d352f77094e9a. Reason for revert: monasca-grafana is no more Change-Id: I483db6d6eddd84b376251b38509e74d4a5c2a10b Depends-on: https://review.opendev.org/c/openstack/kolla/+/784902
2021-04-08Merge "[CI] Publish images to quay.io on a daily basis"Zuul2-11/+29
2021-04-06[CI] Publish images to quay.io on a daily basisRadosław Piliszek2-11/+29
Based on the discussions from the past 3 Kolla meetings [1][2][3], we established that, to avoid the DockerHub pull limit issues in our CI, we will try using quay.io. We still publish weekly to the DockerHub. [1] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-17-15.00.log.html#l-102 [2] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-24-15.00.log.html#l-137 [3] http://eavesdrop.openstack.org/meetings/kolla/2021/kolla.2021-03-31-15.01.log.html#l-50 Change-Id: I7c1f0c5fc643678b29f963b6769d8f900a03b726 Depends-On: Id113a53c083d105ac9200474ff20faacef6decaf
2021-04-06CI: add monasca-grafana to allowed-to-fail imagesMark Goddard1-0/+4
The monasca-grafana image is currently failing to build. INFO:kolla.common.utils.monasca-grafana:go install -v ./pkg/cmd/grafana-server INFO:kolla.common.utils.monasca-grafana:[91mgo: cannot find main module, but found vendor/vendor.json in /grafana/src/github.com/grafana/grafana INFO:kolla.common.utils.monasca-grafana: to create a module there, run: INFO:kolla.common.utils.monasca-grafana: go mod init Let's unblock the gate and diagnose asynchronously. Change-Id: Id113a53c083d105ac9200474ff20faacef6decaf
2021-01-15CI: Use Docker proxy for pullsMichał Nasiadka1-0/+20
Change-Id: I0c4d5e1ea16c6677813a334b38b3a22ad811531d
2020-12-15Fix publishing loginRadosław Piliszek1-2/+2
Login to DockerHub was failing because of trailing newlines in the encrypted credentials. This patch makes the playbook trim them before usage. Change-Id: I411f91af927ffa4d04c8021ddb5c3d584d90bdfd
2020-11-26CI: Ensure docker-py is installed on publishMichał Nasiadka1-0/+6
After a recent change [1] publish jobs are failing on missing docker python SDK. [1]: https://review.opendev.org/c/openstack/kolla/+/763146 Change-Id: I63662dd903b914fe06165b45e0a0bb5ca74b21b9
2020-11-24Merge "CI: add templated Dockerfiles to build logs"Zuul1-0/+1
2020-11-19CI: Improve publish playbookMichał Nasiadka1-3/+15
Currently we use a for loop in shell that performs push of images to Docker Hub - that doesn't really seem to fail properly on push errors (e.g. related to new Docker Hub limits). This change introduces usage of Ansible docker_* modules for doing the same job and improves logging (so it's easier to find out which image failed to publish). Change-Id: I083ce70772edd1abb873ad43f6beb73aae01383f
2020-11-17CI: add templated Dockerfiles to build logsMark Goddard1-0/+1
Change-Id: I702f8fba37e22a6bb45eae14f1fbb251bcdb4d8a
2020-09-16[CI] Support building source images with in-review changesMark Goddard1-4/+25
Following this change it is possible to add 'Depends-On' lines to a kolla commit message that point to reviews in other projects. For example, this could be used to test building and deploying container images containing a change to the nova project that is currently in review. It also allows to introduce jobs testing against Kolla in other projects. The kolla-build-config Ansible role can also be used by other projects, such as kolla-ansible, to generate the necessary configuration. This takes us closer to the Kolla Builder - Next Generation concept [1]. [1] http://lists.openstack.org/pipermail/openstack-discuss/2020-April/014255.html Change-Id: Ia2efa6b5d7278b75ab8dec23207f92d6bd7c58f0 Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2020-04-30CI: make sure that virtualenv is availableMarcin Juszkiewicz1-0/+9
Failed to find required executable virtualenv in paths: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games Change-Id: Ie6094e1c5de5c89e0180c42edf5ef94c1c9964b7
2020-04-03CI: Ansiblify setup of buildersRadosław Piliszek2-12/+52
CI is set up using Ansible playbooks now. This also drops redundant shell scripts. Co-authored-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Change-Id: I5264746fd04276448f4668c3bb3a218a40e8660b
2020-04-03CI: Avoid toxRadosław Piliszek2-7/+16
We don't need tox nor tell our users to use it when doing kolla builds. Tox is going away from base infra images (it is already gone from aarch64 ones). Depends-on: https://review.opendev.org/713134 Co-authored-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Change-Id: Ib1d97a783951ac42740ebf91bcc6ecaf2bf70853
2020-03-17Merge "CI: Install tox"Zuul1-0/+5
2020-03-17CI: Install toxMark Goddard1-0/+5
tox will be removed from the base image. Install it before that happens. This change is made in a simple way that can be easily backported. Change-Id: I2a24c87aa44c1e03ba76a2fb0bd71caf54eb4211
2020-03-17CentOS 8: Switch default base image, tag as masterMark Goddard1-1/+1
Changes the default base tag and distro for CentOS images from 7 to 8. Also changes the tag used by the publisher jobs for CentOS 8 images from 'master-centos8' to 'master'. Change-Id: I5498141ade23219d63f34debc2b8e1330dec2e68 Partially-Implements: blueprint centos-rhel-8
2020-02-13Revert "Upgrade virtualenv in pre"Radosław Piliszek1-5/+0
Reverts temporary. This reverts commit 063a46a7de4471504535499ca2a972a79e4ce5e5. Change-Id: Ibf2848db954862f917a23eb0aa1594ccc4e7ef67
2020-02-12Upgrade virtualenv in preMichal Nasiadka1-0/+5
Since virtualenv 20.0 (amongst other changes) six version >1.12.0 is required. This change adds upgrade of virtualenv and six in pre - to be reverted once infra CentOS images are sorted out. Depends-On: https://review.opendev.org/707377 Change-Id: I75249055989309d0afdfc29c894beb6b1fcd1994
2020-01-20CI: Fix symlinks to failed logsRadosław Piliszek1-13/+0
Stop renaming files. Swift should be able to serve text/plain files based on content, not extension. Failed logs symlinks were broken because we stopped gzipping log files and improperly rewrote the logic there. Change-Id: Idddf51730821644948f51577807f5beaa18c6262
2020-01-16Merge "Revert "Add AArch64 publisher for Debian/source""Zuul1-24/+0
2020-01-15Revert "Add AArch64 publisher for Debian/source"Marcin Juszkiewicz1-24/+0
Turned out that linaro-london network pipe is too thin to support this job. Pushing images took 3 hours so job timed out. Will check it once new nodes arrive. This reverts commit f2801fabdd727fc72a28b056d79787af484424a7. Change-Id: I8897ede43f11090902fe7c0c096f17f57c1c9c67
2020-01-14Merge "Add AArch64 publisher for Debian/source"Zuul1-0/+24
2020-01-13Merge "CI: Fix symlinks for failed build logs"Zuul1-6/+0
2020-01-10Merge "CentOS 8: Add zuul build and publish jobs"Zuul1-1/+1
2020-01-10Add AArch64 publisher for Debian/sourceMarcin Juszkiewicz1-0/+24
This time proper approach involves job dependencies. First we build and publish x86-64 and aarch64 images with architecture name in image tag. Then we create multiarch manifests to create 'master' images. Change-Id: I6b9505dc326636fc6df8798c62c3a5eb1f728a51
2020-01-10CI: Fix symlinks for failed build logsMark Goddard1-6/+0
Follow up to I5b5f323471676317a2898875cbbf297082328fcc. Logs are no longer gzipped, so we do not need to modify the 000_FAILED_* symlinks. Change-Id: I5df42ac0ff91b1b97537a4fbc33fc7970f29d60e
2020-01-09CentOS 8: Add zuul build and publish jobsMark Goddard1-1/+1
Adds build and publishing jobs for CentOS 8 images: - kolla-build-centos8-binary - kolla-build-centos8-source - kolla-publish-centos8-binary - kolla-publish-centos8-source The 'base' image has been added to the list of unbuildable images for CentOS 8 (now separate from the list for CentOS 7). This means that no images will be built - the jobs should essentially be a 'noop'. Change-Id: Ie9a0109bd4eef337358d714e4b5088b8e3de2f23 Partially-Implements: blueprint centos-rhel-8
2020-01-09Stop gzipping logs in postMichal Nasiadka1-4/+0
As per [1] we should stop compressing the logs sent to swift in order to get them back readable via a browser. [1]: http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html Change-Id: I5b5f323471676317a2898875cbbf297082328fcc
2019-09-19CI: Use docker mirror proxyRadosław Piliszek1-8/+4
TODO: Debian build still requires access to original repo. Change-Id: Ie4bac5334369a63793d36568a9d3a58a0cdc7667 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-07-15cleanup setup of Debian/Ubuntu CI nodesMarcin Juszkiewicz1-0/+2
Change-Id: I3a771793dfbbfc26f6d5716ba7a5b60c2e6154fa
2019-06-28Extract CI vars for use in kolla-ansible jobsRadosław Piliszek1-9/+2
Change-Id: If58f15e18e420aca790496132352f1c1dcdb2640 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-27Merge "Clean up test process"Zuul3-83/+57
2019-06-25Remove Oracle Linux stuff in CI codeRadosław Piliszek1-1/+0
Oracle Linux is no longer tested via CI after [1]. This patch removes OL support from Zuul files. [1] https://review.opendev.org/664217 Change-Id: I527aba3635ef82e2d2a88ee7f5250bf03e420800 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>