summaryrefslogtreecommitdiff
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2020-01-10Add AArch64 publisher for Debian/sourceMarcin Juszkiewicz2-0/+27
This time proper approach involves job dependencies. First we build and publish x86-64 and aarch64 images with architecture name in image tag. Then we create multiarch manifests to create 'master' images. Change-Id: I6b9505dc326636fc6df8798c62c3a5eb1f728a51
2020-01-10CI: Fix symlinks for failed build logsMark Goddard1-6/+0
Follow up to I5b5f323471676317a2898875cbbf297082328fcc. Logs are no longer gzipped, so we do not need to modify the 000_FAILED_* symlinks. Change-Id: I5df42ac0ff91b1b97537a4fbc33fc7970f29d60e
2020-01-09CentOS 8: base and openstack-base imagesMark Goddard1-2/+17
Adds support to the base and openstack-base images for CentOS 8. These images have been removed from the list of unbuildable images, and replaced with all dependent images. Change-Id: I18fba8a5c2f99b700990cbf41c76077a1ec2408a Partially-Implements: blueprint centos-rhel-8
2020-01-09CentOS 8: Add zuul build and publish jobsMark Goddard2-1/+25
Adds build and publishing jobs for CentOS 8 images: - kolla-build-centos8-binary - kolla-build-centos8-source - kolla-publish-centos8-binary - kolla-publish-centos8-source The 'base' image has been added to the list of unbuildable images for CentOS 8 (now separate from the list for CentOS 7). This means that no images will be built - the jobs should essentially be a 'noop'. Change-Id: Ie9a0109bd4eef337358d714e4b5088b8e3de2f23 Partially-Implements: blueprint centos-rhel-8
2020-01-09Stop gzipping logs in postMichal Nasiadka1-4/+0
As per [1] we should stop compressing the logs sent to swift in order to get them back readable via a browser. [1]: http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011875.html Change-Id: I5b5f323471676317a2898875cbbf297082328fcc
2019-12-16Add Debian/source aarch64 CI jobMarcin Juszkiewicz1-1/+1
AArch64 is getting popular and not all changes working on x86-64 work properly on aarch64 architecture. Let check them. Job is running in separate pipeline due to low number of aarch64 nodes. Authored-By: Xinliang Liu <xinliang.liu@linaro.org> Co-Authored-By: Jeffrey Zhang <zhang.lei.fly@gmail.com> Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Implements: blueprint aarch64-3rd-party-ci-kolla Depends-On: https://review.opendev.org/#/c/698606 Change-Id: I7e7802dfa4f4d9c61d01dba4b77c01cfb24301c0
2019-11-26CI: Move to CentOS 8 nodepool imagesMark Goddard1-2/+2
This change modifies the CentOS build CI jobs to use a CentOS 8 host image. NOTE: This does not affect the version of CentOS used as the base image in containers built by kolla. Partially-Implements: blueprint centos-rhel-8 Partially-Implements: blueprint centos-rhel-python3 Change-Id: Ie25b54a4e6116ed2bcb9c3b5c44eb6edbd2e6b49
2019-11-14Merge "Revert "Move to RDO Train packages""Zuul1-0/+4
2019-11-13Revert "Move to RDO Train packages"Radosław Piliszek1-0/+4
This reverts commit c78c82c9630b334cbaef040d68bce7e5ae8cc118. Change-Id: I61c68bf738673a96dd5ba256e40e8532364ff281
2019-11-05Merge "CI: drop the gate profile"Zuul1-28/+0
2019-10-29Merge "Remove /var/yum/cache from CentOS base image"Zuul1-4/+2
2019-10-28Remove /var/yum/cache from CentOS base imageMark Goddard1-4/+2
Since https://review.opendev.org/#/c/682600/, the following lines result in /var/yum/cache being present in one of the layers of the base image: RUN {{ macros.install_packages(base_centos_yum_repo_packages | customizable("centos_yum_repo_packages"), chain=True, clean=False) }} \ {% for repo in base_centos_yum_repos_to_disable | customizable('centos_yum_repos_to_disable') -%} && yum-config-manager --disable {{ repo }} \ {% endfor -%} {% for key in base_centos_yum_repo_keys | customizable('centos_yum_repo_keys') -%} && rpm --import {{ key }} \ {% endfor -%} && /bin/true {% block base_centos_repo_overrides_post_yum %}{% endblock %} RUN {{ macros.rpm_security_update(clean_package_cache) }} This is because it is not cleaned in the first RUN statement. This adds 76MB to the image. Also, using two separate RUNs which results in an extra 23MB due to updates to /var/lib/rpm/Packages. Found via https://github.com/wagoodman/dive. Change-Id: I0302ee1dfc10a2b7df127ac6a7764a84b1d74a33 Closes-Bug: #1850036
2019-10-25CI: drop the gate profileRadosław Piliszek1-28/+0
This profile has not been used since Kolla Ansible was separated. Also removes the relevant "tests". Change-Id: I29dbcea169a6e338bc9a8fb4fcde7a77c1d6fac6
2019-10-21Move to RDO Train packagesMichal Nasiadka1-4/+0
Change-Id: I396f929ecc11f87fb83585bedd39be93a605c57b
2019-09-19CI: Use docker mirror proxyRadosław Piliszek2-8/+5
TODO: Debian build still requires access to original repo. Change-Id: Ie4bac5334369a63793d36568a9d3a58a0cdc7667 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-09-18Remove support for OracleLinuxMark Goddard2-31/+1
We have agreed to remove support for Oracle Linux. http://lists.openstack.org/pipermail/openstack-discuss/2019-June/006896.html Change-Id: I961dfba1aeef2c509ecdaf376dfe6928926ffb39 Depends-On: https://review.opendev.org/682858
2019-09-17CI: CentOS - override mirrors ASAP + crmsh mirror overrideRadosław Piliszek1-13/+31
This makes mirrored repos used as soon as they are installed in the image, instead of hitting upstreams. This patch also adds crmsh override. Usable only after infra change merges. Depends-on: https://review.opendev.org/682576 Change-Id: Ic7494eff4c740b6e528da4508dc88a64e697bc04 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-09-12Drop Percona XtraBackup in favour of MariaDB BackupMarcin Juszkiewicz2-4/+0
XtraBackup started failing to install on Ubuntu and does not support MariaDB 10.3 version. Related-Bug: #1843043 Change-Id: I9cf62c8e03a02574d85e5349df1d23a51d4c99be
2019-07-21Change how build process treats unbuildable imagesMarcin Juszkiewicz1-2/+2
We have a list of images which are unbuildable for distro/buildtype/arch combos. This patch renames it from SKIPPED_IMAGES to UNBUILDABLE_IMAGES because 'skipped' images is something else in our code. Now all unbuildable images are marked as such and so are their children. At the end of build there is information provided about skipped images (due to --skip-parents or --skip-existing options) and then information about not buildable images. Both list should only contain entries related to requested build. Change-Id: If9b521339f564e483cba03d52e7c4eba271821a5
2019-07-15cleanup setup of Debian/Ubuntu CI nodesMarcin Juszkiewicz1-0/+2
Change-Id: I3a771793dfbbfc26f6d5716ba7a5b60c2e6154fa
2019-07-03CI: Clean up Zuul repo mirrors for CentOSRadosław Piliszek2-13/+15
- unify RDO mirror definition with others - drop definitions of unused mirrors: grafana, elastic - clean up the process of mirror substitution: - use the more common style of sed d command - apply more specific substitutions Change-Id: Idad2c6956cca647d4c865d6f6149ea37164db568 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-28Extract CI vars for use in kolla-ansible jobsRadosław Piliszek2-9/+11
Change-Id: If58f15e18e420aca790496132352f1c1dcdb2640 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-27Merge "Clean up test process"Zuul5-85/+58
2019-06-25Remove Oracle Linux stuff in CI codeRadosław Piliszek2-24/+0
Oracle Linux is no longer tested via CI after [1]. This patch removes OL support from Zuul files. [1] https://review.opendev.org/664217 Change-Id: I527aba3635ef82e2d2a88ee7f5250bf03e420800 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-20Clean up test processRadosław Piliszek5-85/+58
If stestr failed, then no node info was logged. Logging node info is now handled in pre and post stages of Zuul. Additionally Zuul v3 migration recommendations were applied and some unused code removed improving general readability. Change-Id: Iae9d37cb76997ba8389e21c7e2a3bf5905abe029 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-08Fix issues with Percona in Zuul and clean up a little bitRadosław Piliszek1-2/+4
Percona site has connectivity issues from OVH hosts (of Zuul). This patch makes it so that: - the internal repo is actually used - RPM GPG keys are downloaded from the actually used repo - Ubuntu mimics the RHEL behavior (i.e. the Percona repo is enabled only in the xtrabackup image) extra benefit: no need for APT preferences for Percona repo to spare MariaDB deps Change-Id: Id27831f6b404762f9e44fd6bd1c4702bf06b05f8 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-07Debian/Ubuntu: allow to use unsigned repositoriesMarcin Juszkiewicz1-6/+8
When we run Debian 'buster' or Ubuntu 18.04 in CI job they refuse to work as infra mirror is not signed. This patch instructs APT to use unsigned repos anyway. Change-Id: I530fde5b57894afda2de98d7c217e735497e3feb
2019-03-15Fix lower-constraints and kolla CI jobsMark Goddard1-2/+2
Multiple fixes to fix multiple problems. 1. Bump setuptools requirement to 21.0.0 The 16.0.0 requirement breaks the lower-constraints job on Ubuntu bionic. We see the following error: AttributeError: module 'importlib._bootstrap' has no attribute 'SourceFileLoader' 2. ubuntu-binary horizon image needs to use python3 for django manage.py 3. ubuntu-binary nova-placement-api image needs to use python3 for apache mod wsgi. 4. nova-libvirt needs exact qemu dependencies due to packaging change 5. OracleLinux repos definition was changed in official image. 6. Fetch InfluxDB gpg key for Ubuntu base image from influx server. Change-Id: Ic797d41f53a5f146d112619f1683cbfbf3a85dc2
2019-02-14Fix py36 gate jobMichal Nasiadka1-0/+1
python 3.6 pycache also includes links - so those also need to be removed Depends-On: https://review.openstack.org/636750 Change-Id: I0f995df45bf203acc79cc7bd52b9ac51577468da
2018-12-27Update hacking versionconfi-surya1-1/+2
Use latest release 1.1.0 and compatible changes w.r.t pep8 Change-Id: Ia3d1166a2746a46591e4e5a04ea91e03ddc28d93
2018-12-19Merge "Use infra mirrors for ODL and percona repos"Zuul3-4/+6
2018-12-18Merge "No need to use dict_object.keys()"Zuul1-1/+1
2018-12-18Use infra mirrors for ODL and percona reposEduardo Gonzalez3-4/+6
Change-Id: I212a53b235f2785d93d474660c87a8521f3cc8b2
2018-12-05Fix Oraclelinux build, disable collectd in gateEduardo Gonzalez2-4/+0
Oraclelinux repositories has been upgraded and previous file removed, this change update repos to new URLs. Disable collectd in gate as is currently broken and blocks mergingin voting jobs. Change-Id: I402cff1ac86a2ba108f2f5378cc98db5f6ecc673
2018-12-03No need to use dict_object.keys()confi-surya1-1/+1
for in dict_object.keys() can be replaced with for in dict_object, so just a short cleaup Change-Id: Id934eae6db05298b85b800531b9dfdcb28782cc5
2018-11-29Fix the parameter order of assertEqualconfi-surya1-1/+1
On assertEqual, the order of parameters should be (expected, observed). But, some part of kolla tests was written with invalid order. This patch fix the problem. Change-Id: I9fcfb3923716243ddb1886223e932ec12829fb2e Related-Bug: #1277104
2018-11-20Suppress log copy output in gatesEduardo Gonzalez1-0/+2
Copying collectd logs is half of the job ouput. This change is to remove the verbosity of the syncronize tasks by applying --quiet to only show errors Change-Id: I39b47b844aab87d043a2cd745103d6589f3632e3
2018-09-24Merge "Fix epel mirror replacement in gates"Zuul1-0/+1
2018-09-21Disable debug logs for image buildsMark Goddard1-1/+1
Logs emitted when building via the tox environments can exceed the maximum length supported by subunit [1], causing the following message: Length too long: <length> This change disables debug logging in these tox environments to reduce the length of the output. [1] https://github.com/testing-cabal/subunit/blob/8cdd703980c314dddf95cc0556f67bc80358ddcd/python/subunit/v2.py#L208 Change-Id: Icb5793a8ea58edafe2f3a249eb1da7d4ae2e395f
2018-09-19Fix epel mirror replacement in gatesEduardo Gonzalez1-0/+1
Change-Id: I7b74497931de5e2a89fc1a2b827a1cf6d64ab7e9
2018-07-10Add CI script to retrieve info from build logsMartin André2-0/+83
This should serve as a base for retrieving useful information from the kolla build logs. For now, the script warns about obsolete package names and helps track packages that are installed too many times in different images. It only supports rpm-based distros for now. Change-Id: I160b6ede1336bd0c202621a48ca0218f72fc1270
2018-07-10Show disk space used by docker images in CIMartin André1-1/+1
The `docker system df` command can show the total size of the docker cache. If you pass it the `-v` option, it will break it down per image, replacing the use of `docker ps -a` and `docker images`. This should be very useful in CI to see the variation in the images size. Change-Id: I407434d88f59df65693974265551c624420d4aaf
2018-07-09Stop creating an empty system_logs dir in CIMartin André1-1/+1
The system logs from the building node are copied to the system_log directory. There is no need to create an empty system_logs directory. It was certainly a typo. Change-Id: I1f0eea485550bd7b41c9954a6b7077251518b31d
2018-06-04Merge "Bump Ubuntu base image to 18.04"Zuul1-4/+5
2018-05-26Bump Ubuntu base image to 18.04Jeffrey Zhang1-4/+5
Ubuntu 18.04 has been released. We need upgrade to it this cycle. Changes made in this patch - Bump ubuntu repo from xenial to bionic. Some repos do not have bionic packages, so still using xenial repos. - Drop mariadb, percona and nfs-ganesha repo, because these packages are already provided by Ubuntu official repo. - Since qdrouterd does not have bionic repo and xenial packages does not work on Ubuntu bionic, just add it into ignore image list. - Use python-rtslib-fb and targetcli-fb rather than python-rtslib and targetcli - use xen-utils package name rather than with package version one. - Seems unsigned repo won't work on Ubuntu bionic, stop using infra mirrored unsigned repo in gate building job. Needed-By: https://review.openstack.org/568728 Implement blueprint: ubuntu-bionic Change-Id: I4e3b0ca669cfbf6316bf591f2d8428fa1a0d6182
2018-05-08Create symlinks for failed builds logsMartin André1-0/+6
This allows to know which image failed to build without having to parse the huge job-output.txt file. This commit creates a convenient 000_FAILED_image_name.log symlink to the relevant log files when kolla is configured to output to a log directory. This creates symlinks only for the parent image with error, i.e. it skips images that failed to build because of parent error. Change-Id: I05954e2335dc3fac469276809c91f9c87e3ecab2
2018-04-04Merge "No use of mox/mox3"Zuul1-1/+1
2018-04-03Merge "Revert "Seem there are some wrong in infra ubuntu repo""Zuul1-5/+4
2018-03-30No use of mox/mox3Surya Prakash Singh1-1/+1
Now onwards no support of mox/mox3, please check storyboard link for reference https://storyboard.openstack.org/#!/story/2001546 Change-Id: Ic1fa65951f1e43e1279d8c72fcfc5e09609faa70
2018-03-21Support push kolla tag image to hub.docker.com siteJeffrey Zhang1-1/+1
Change-Id: I8a21f60a37ba038e46c29d0bcff9ffbd2457a257