summaryrefslogtreecommitdiff
path: root/kolla/image
AgeCommit message (Collapse)AuthorFilesLines
2022-03-04Build CentOS Stream 8 imagesMichal Nasiadka1-2/+6
This is part of the effort to allow a migration path for operators using CentOS 7 and Train today. Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/831265 Change-Id: I75373eb21c4269c20f72603ad4cf162a472de25b (cherry picked from commit 67d6d28b6208cc004a50f19be1386d88c2404bc4)
2022-01-26CI: make it work againMarcin Juszkiewicz1-0/+4
Python changes: - limit pip to 20.x as this is last version working on both Python 2 and 3. - cap 'setuptools' to be older than 58 to have use_2to3 functionality (fixes 'anyjson' installation) - upgrade pip in 'elasticsearch-curator' image to get it built on CentOS 7 Unbuildable images: - 'bifrost-base' under CentOS 8 (Error: Cannot find a valid baseurl for repo: epel) - 'monasca-grafana' under CentOS 7/8 - 'sensu-client' under CentOS 7 (aws-eventstream requires Ruby version >= 2.3) - dropped *-upgrade CI jobs as Stein is EOL - pin 'qpid-proton-c' package for CentOS 7 to not install EPEL one (cinder-volume, openstack-base and tripleoclient) - bump 'libvirt-python' in 'masakari-monitors' to 7.10.0 (newer branches install package from distribution but CentOS 7 lacks it) - pin 'unf_ext' gem in Sensu images as CentOS 7 lacks Ruby 2.2+ (fixed sensu-server) - install 'ca-certificates' for newer Let's Encrypt certificates support (so we can fetch upper-constraints) - make Zuul fetch openstack/requirements project files (make 'openstack-base' pass) (like 2nd fix) Co-Authored-by: Pierre Riteau <pierre@stackhpc.com> Closes-Bug: #1943617 Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/826464 Change-Id: I8ee32e53cda581493b2a4bb73ca72ab05014b9d4
2021-06-18Fix _get_images_dir when pip-installed with --usertrain-em9.4.0James Pic1-0/+1
There are two cases where pip installs kolla share into ~/.local/share/kolla: - with `pip install --user kolla` - with `pip install kolla` as non-root This patch helps kolla find the share dir in these cases. Closes-Bug: #1930544 Change-Id: I0b3eb6744a34a601266179fb358510a5c500e6ba (cherry picked from commit db78657c231663f3e8ebbc18de43c06ddaa94c97)
2021-02-17Fix several issues (Train)Marcin Juszkiewicz1-2/+1
* sensu: drop Ubuntu support Upstream removed Ubuntu repositories. Train/Stein only * Bifrost: pin IPA builder to 2.4.0 Train & earlier IPA builder master branch now requires diskimage-builder 3.4.0, but Python 2 is supported only up to DIB 2.38. This change works around the issue by pinning IPA builder to 2.4.0, which has a Python 2 compatible dependency on DIB. Change-Id: Ice125e101a689fd3df9d1cd9a093a026f9747a3e
2020-12-23Mark helm-repository unbuildableRadosław Piliszek1-0/+2
The chart repository is gone and the building fails. Change-Id: I205eb2209cb0ccaecee247b95c65ed65bf4ed9e0
2020-12-15Support CentOS 8.3abraden1-0/+16
Backport this until Train. CentOS 8.3 renamed system repos. [1] This caused failures when disabling and enabling. More details in the referenced bug report. Notice CentOS 8.2 and below will no longer work. Train backport also includes some fixes for the fallout from the new pip resolver. * cap bandit<1.6.3, since bandit no longer supports Python 2. * mark kuryr-libnetwork unbuildable for source images. * mark almanach-base & dragonflow-base unbuildable for Debian & Ubuntu source images. * Don't install networking-hyperv in source neutron-server images. pip complains of a conflict. (https://bugs.launchpad.net/kolla/+bug/1907826) [1] https://wiki.centos.org/Manuals/ReleaseNotes/CentOS8.2011#Yum_repo_file_and_repoid_changes Change-Id: I2d67b3ed7b7c521bc755ec9a87365c9962a9eeff Closes-Bug: #1907213 Closes-Bug: #1907826 Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com> Depends-On: https://review.opendev.org/766211 Depends-On: https://review.opendev.org/767157
2020-11-06curator: Add wheel to elasticsearch-curatorMichal Nasiadka1-0/+1
boto part cherry picked from change [1]. Disabling mongodb build due to missing packages in CentOS repos. [1]: https://review.opendev.org/755339/ Change-Id: Idf980eedcd318b88101b3a82442b9b99838fd84c (cherry picked from commit 34460d636e9e62f30a0d17eda2d743658ccb0b33)
2020-07-27Fix masakari-monitors image on CentOS 8Mark Goddard1-1/+0
Train only. The version of libvirt-python allowed by upper-constraints in Train (5.7.0) does not support CentOS 8. This prevented the masakari-monitors image from building. This change modifies the upper constraints file in the masakari-monitors image to use 5.10.0, the earliest version that does support CentOS 8. Change-Id: Ia980be14fdf9c4fc15bb379b940ae491de035725
2020-07-01Merge "Add Logstash 6 for Monasca on Centos 8" into stable/trainZuul1-0/+2
2020-06-25Add Logstash 6 for Monasca on Centos 8Doug Szumski1-0/+2
On Centos 8 we have Elasticsearch and Kibana 6, but Logstash (used by Monasca) is stuck on 2 which is not compatible. See the product compatibility matrix [1]. This adds Logstash 6, so that Monasca can use the full ELK 6 stack on Centos 8. Note that Monasca doesn't officially support ELK 6, but it does work. [1] https://www.elastic.co/support/matrix#matrix_compatibility Partial-Bug: #1884090 Change-Id: Id6f79e301cc109a029913f5628bab1848c138e7f
2020-06-19CI: Install python deps, fix mod_wsgi in cyborg-api, disable masakari-monitorsMichal Nasiadka1-0/+1
setuptools is missing from infra image - so it needs to be installed. Copy cat of a kolla-ansible change: https://review.opendev.org/#/c/735808/ Fixes also cyborg-api to use py3 mod_wsgi in centos8 Temporarily disables masakari-monitors build, because it fails on centos8 due to problems with libvirt-python===5.7.0 (upper-constraints): Missing type converters: virTypedParameterPtr:1 ERROR: failed virConnectSetIdentity Depends-On: https://review.opendev.org/#/c/736744/ Change-Id: I6068abcbc0e73eeab77b0aa99983a95adc6defd3
2020-05-17switch to official CentOS 8 repositoriesMarcin Juszkiewicz1-0/+4
RDO builds of stable/train for CentOS 8 went into phase when we do not need to use delorean builds. EPEL is disabled like it is in Ussuri (RDO packages may conflict with it). Erlang for RabbitMQ is used from CentOS 8 'rabbitmq-38' repo while RabbitMQ is still 3.7.* from same place as usual. 'python3-pika' is dropped from openstack-base as it is EPEL only package and is not used by any image (dropped in Ussuri in https://review.opendev.org/#/c/710003/ patch) AArch64 is not supported until CentOS 8.2 release. Change-Id: I9d3ed54f4d10ef7ad2d52ed3aeca15f3968cd163
2020-04-25Do not try to build skipped/unbuildable imagesMarcin Juszkiewicz1-1/+2
When build is done with logging to separate files we have a lot of files with logs like this: INFO:kolla.common.utils.mongodb:Skipping mongodb This patch stops that. Builds will be a bit faster as we do not push skipped or unbuildable images into build queue anymore. Change-Id: Id8198451e77669d1472f3a21fd3a97f0e6e67cd8 (cherry picked from commit 0de8a57f9e5659f13db97bfe27ea5b0c7d452454)
2020-04-22Merge "CentOS 8: Add rabbitmq-3.7.24 image (CentOS 7 only)" into stable/trainZuul1-0/+3
2020-04-15CentOS 8: Add rabbitmq-3.7.24 image (CentOS 7 only)Mark Goddard1-0/+3
The CentOS 7 rabbitmq image contains 3.7.10, and the CentOS 8 rabbitmq image contains 3.7.24. These versions are not compatible, which prevents a rolling migration from CentOS 7 to CentOS 8. This change adds a rabbitmq-3.7.24 image, available for CentOS 7 images only. This provides a path for migration, by first upgrading all CentOS 7 rabbitmq containers to use this image. Depends-On: https://review.opendev.org/720218 Change-Id: Icff279be07c4767dd0b18c697894373f46102bf1 Partially-Implements: blueprint centos-rhel-8
2020-04-09Add elasticsearch6 and kibana6 imagesSylvain Baubeau1-0/+4
Elasticsearch and Kibana only support CentOS 8 from version 6.x, but in Train Kolla uses ELK 5.x. This change adds new elasticsearch6 and kibana6 images based on ELK 6.x only for CentOS 7 and 8. This enables two things: 1. provide elasticsearch and kibana for CentOS 8 in Train 2. provide a migration path from CentOS 7 to 8 that does not involve a simultaneous major upgrade, by first upgrading CentOS 7 to ELK 6.x. The new images are based on the upgrade to 6.x in Ussuri in I8b52b2630a72393bf4b9c7095fc67db6c36c27fa. This includes a switch to start using oss tagged binaries. These binaries contain only features that are available under the Apache 2.0 license. Related: blueprint elasticsearch-kibana-version-upgrade Co-authored-by: Dincer Celik <hello@dincercelik.com> Change-Id: I8b52b2630a72393bf4b9c7095fc67db6c36c27fa
2020-04-04Fix --skip-existing and --skip-parentsMark Goddard1-23/+20
There are currently a few corner cases with the --skip-existing and --skip-parents flags. Examples: 1. kolla-build --type source --skip-parents monasca-grafana This does not try to build the monasca-grafana image. This appears to be an issue when the image is a grandchild. 2. kolla-build --type source --skip-parents This will build all images. Expect it to skip parents. 3. kolla-build --type source --skip-existing This will build all images. Expect it to skip existing images. The filter_images method does quite a lot, including handling whether images are buildable, regex/profile matching, and which images to skip. The matching and skipping parts are done in a single pass, which can lead to some weird effects due to dependencies between the images and their statuses. Also, skipping is only currently applied when there is a regex/profile filter. This change splits out the matching and skipping into two separate passes. In the first pass, we mark all buildable images that match the filter as matched. In the second, we iterate over matched images, applying the skip existing and skip parents rules. Change-Id: I2f895aea0cc59d808129e9fc636af0890196af33 Closes-Bug: #1867614 Related-Bug: #1810979 (cherry picked from commit dfddcce3a5bc98cbd177c984fd9d0a8bab51d40c)
2020-03-25Merge "CentOS 8: Drop trickle install to build freezer" into stable/trainZuul1-1/+0
2020-03-25Merge "CentOS 8: enable monasca-grafana image" into stable/trainZuul1-1/+0
2020-03-25CentOS 8: Drop trickle install to build freezerMark Goddard1-1/+0
Trickle was previously installed from EPEL7, but is not available in EPEL8. It does not appear critical to the functioning of freezer, so drop it to allow freezer images to build for CentOS 8. Change-Id: I3e12ab51e9f01d383268d75ce72903686564ada6 Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit 548144fc3c2564c9c44a3a42372a1f3b8f2fef34)
2020-03-24CentOS 8: Build bifrost imageMark Goddard1-1/+0
Also enables CentOS 8 ansible bifrost job. Depends-On: https://review.opendev.org/713508 Change-Id: Iec3d51abe50b05f90f764a4058be620cad1f9388 Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit a7ba77fa898092bdc6d423391e9478260d476f4c)
2020-03-20CentOS 8: enable monasca-grafana imageMark Goddard1-1/+0
Change-Id: Id67c58580d1eaad86cacc5094ee80a734ac1eb26 Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit b0c1647352dda3e785612c6c66e07b97290ae85d)
2020-03-20CentOS 8: Enable hacluster and masakari imagesMarcin Juszkiewicz1-2/+1
CentOS 8.1 came with HA repo. So we can use it. hacluster-pcs image is disabled as we lack 'crmsh' package for it. Partially-Implements: blueprint centos-rhel-8 Co-Authored-By: Mark Goddard <mark@stackhpc.com> Change-Id: I1c786eda399eca4464c9d68ac040c2965350f775 (cherry picked from commit 92224ccb518c90d7c269158d074d811aee2f05f0)
2020-03-13Build collectd image for CentOS8yatinkarel1-2/+0
Required packages are available in RDO repo, so this should build fine. Partially-Implements: blueprint centos-rhel-8 Change-Id: I14cc9d0f2c5d72c6dad89de2ac6dcffda8510285 (cherry picked from commit 2089165388c6da609973d9083f40b163382dbcc3)
2020-03-12kibana: enable for non-x86 on Debian/UbuntuMarcin Juszkiewicz1-2/+2
As upstream generated 'all' package as 'amd64' one I took some time and repackaged it. manual cherry-pick from https://review.opendev.org/#/c/707787/ Change-Id: Ie84ed771ffa9ecd70b945673727895c8edad30eb
2020-02-26CentOS 8: Use upstream Ceph/masterMichal Nasiadka1-7/+0
The only Ceph version that will support CentOS 8 is Octopus. It will be released end of March 2020 - so for now let's use master. Change-Id: I5955acb41e7346802d76f4f2b244cbf5c36f5bf2 Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit 70423f19596f92ed01c89e7d62f8c46a6dba6a23)
2020-02-26CentOS 8: Remove shellinabox from ironic-conductorMark Goddard1-1/+0
shellinabox is used by ironic-conductor to provide a browser-based shell to access the consoles of nodes. It is not used by all console drivers, and is not used in the integration with nova serial consoles. The package was previously installed from EPEL7, but is not currently provided by EPEL8. This change removes the package to allow the ironic-conductor image to build. Change-Id: I210d9fddd6948dab1feb5abf59a50bce86f21f0f Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit 397651ec4b5b93a55d0b8b8f69dfb37dd85cfc8d)
2020-02-26CentOS 8: Update packages in imagesMark Goddard1-103/+37
* Some further changes for python2 vs python3 packages * Allow rabbitmq 3.7.*, since a newer erlang is available * Switch from qemu-img-ev to qemu-img on CentOS 8 * bridge-utils no longer available on CentOS 8 * libvirt-daemon-driver-lxc no longer available on CentOS 8 * Mark some more images buildable for CentOS 8 Depends-On: https://review.opendev.org/709553 Change-Id: Iaf5b68ff6d944ae730ca0b1d5832172c106a6c08 Partially-Implements: blueprint centos-rhel-8 Partially-Implements: blueprint centos-rhel-python-3 (cherry picked from commit 4b4e26262b9e03190c639481fb60a8f4f92c532a)
2020-02-26CentOS 8: base and openstack-base imagesMark Goddard1-2/+103
Adds support to the base and openstack-base images for CentOS 8. These images have been removed from the list of unbuildable images, and replaced with all dependent images. This change also includes backports of a number of other changes related to the base image: * CentOS 8: disable repo_gpgcheck for grafana image (Ice120e8001fd9e8bb37ca4f2df26259cf798ee0e) * CentOS 8: base image fixes for RabbitMQ, fluentd & InfluxDB (Ibbb720390ff17e11249a5aa77163c15c0971209a) Change-Id: I18fba8a5c2f99b700990cbf41c76077a1ec2408a Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit 3c618a1f6f0beca723e031fbe323b159400ad08f)
2020-01-14CentOS 8: Add zuul build and publish jobsMark Goddard1-1/+15
Adds build and publishing jobs for CentOS 8 images: - kolla-build-centos8-binary - kolla-build-centos8-source - kolla-publish-centos8-binary - kolla-publish-centos8-source The 'base' image has been added to the list of unbuildable images for CentOS 8 (now separate from the list for CentOS 7). This means that no images will be built - the jobs should essentially be a 'noop'. Change-Id: Ie9a0109bd4eef337358d714e4b5088b8e3de2f23 Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit b060623b907348e518bdf1afede0b641be56c415)
2019-12-09Vitrage: build images for DebianViktor Michalek1-1/+0
Change-Id: I73b1964b7b22f1a2d5637209b86559b79602131b
2019-10-23Do not build rally image for Ubuntu binaryRadosław Piliszek1-0/+1
UCA does not provide rally and the Ubuntu rally depends on python2 packages which conflict with python3 packages. Change-Id: I36c1feaecf2e07e2d9fb8a7f42e899477eaabae4 Closes-bug: #1848295
2019-10-16handle push error properlyMarcin Juszkiewicz1-2/+9
If there was some error during pushing then Kolla was greeting with "all went fine" message anyway: INFO:kolla.common.utils.aodh-api:Trying to push the image ERROR:kolla.common.utils.aodh-api:Get http://10.101.16.1:5000/v2/: dial tcp 10.101.16.1:5000: connect: no route to host INFO:kolla.common.utils.aodh-api:Pushed successfully This patch changes that. Now if there is an error during push then proper exception is raised to PushTask and image is marked with PUSH_ERROR status. This way at the end of build it is easy to spot which images did not got pushed to registry: INFO:kolla.common.utils:=========================== INFO:kolla.common.utils:Images that failed to build INFO:kolla.common.utils:=========================== ERROR:kolla.common.utils:base Failed with status: push_error ERROR:kolla.common.utils:nova-api Failed with status: push_error ERROR:kolla.common.utils:nova-base Failed with status: push_error ERROR:kolla.common.utils:nova-compute Failed with status: push_error ERROR:kolla.common.utils:nova-compute-ironic Failed with status: push_error ERROR:kolla.common.utils:nova-conductor Failed with status: push_error Closes-Bug: #1848019 Change-Id: Id2ab97bf4c0dc3423268a0ea435b56f4a65f7196
2019-10-02Merge "debian: enable congress and zaqar images"Zuul1-2/+0
2019-10-01mistral-event-engine: enable for Debian/UbuntuMarcin Juszkiewicz1-2/+0
Depends-On: https://review.opendev.org/685901 Change-Id: I0c5e5cc895238094e30fac49dfc6e7bd880ca55e
2019-10-01debian: enable congress and zaqar imagesMarcin Juszkiewicz1-2/+0
Change-Id: I331d8ed68ab32d7c56e891cf2e71c4a8157a26de
2019-09-26added broken images to UNBUILDABLE_IMAGESMarcin Juszkiewicz1-1/+3
Change-Id: I52933c535023e8681bbde887364a188450c15663
2019-09-20Merge "Fix retries when pushing images"Zuul1-0/+3
2019-09-19Merge "ppc64le: add UNBUILDABLE_IMAGES entries"Zuul1-1/+35
2019-09-19Fix retries when pushing imagesMark Goddard1-0/+3
Currently the retry mechanism is broken for pushing because the image state gets set to an error state, and is never reset to 'built'. This prevents the PushTask from setting success to True. This change sets the image state to 'built' if the push succeeds, ensuring it overrides any previous failures. Change-Id: I93fc0e383da8fec6b3ca31f8094321c2a0c3af71 Closes-Bug: #1844697
2019-09-19Merge "build.py: fix pep8 warnings"Zuul1-6/+6
2019-09-19ppc64le: add UNBUILDABLE_IMAGES entriesMarcin Juszkiewicz1-1/+35
Change-Id: I6b8f52a1f2227ecb74e3ae59ef1e67d5b5ce1886
2019-09-18Merge "build: enable Octavia for Ubuntu/binary"Zuul1-1/+0
2019-09-18Remove support for OracleLinuxMark Goddard1-8/+1
We have agreed to remove support for Oracle Linux. http://lists.openstack.org/pipermail/openstack-discuss/2019-June/006896.html Change-Id: I961dfba1aeef2c509ecdaf376dfe6928926ffb39 Depends-On: https://review.opendev.org/682858
2019-09-18build: enable Octavia for Ubuntu/binaryMarcin Juszkiewicz1-1/+0
Change-Id: Icc68b404d8713a9fcf0026374378d1645fe30d52
2019-09-17build.py: fix pep8 warningsMarcin Juszkiewicz1-6/+6
Change-Id: Ifaeed6917636e2bcb5ea3bda32ae0393ebb08a4f
2019-09-12Drop Percona XtraBackup in favour of MariaDB BackupMarcin Juszkiewicz1-2/+0
XtraBackup started failing to install on Ubuntu and does not support MariaDB 10.3 version. Related-Bug: #1843043 Change-Id: I9cf62c8e03a02574d85e5349df1d23a51d4c99be
2019-08-31disable 'hacluster-pcs' on aarch64 due to lack of packageMarcin Juszkiewicz1-0/+1
Change-Id: I3000136fa883f510b24133907a66efd194b40266
2019-08-19debian: add some images to unbuildable listMarcin Juszkiewicz1-1/+6
We do not have package repositories for opendaylight, telegraf, xtrabackup images. bifrost tries to install 'mysql-server' package which is not present in Debian 'buster' monasca-grafana has some SSL related issues Change-Id: I795771569a3dcb9730063bd951c230806a08b3c0
2019-08-08Bump up pkg versions in kolla-toolboxMichal Nasiadka1-0/+2
Currently we use Ansible 2.2 in kolla_toolbox, while lowest supported version is 2.6 - bumping up to 2.8. * Use upper constrains in Dockerfile.j2, instead of pinning them in here - Ansible is pinned to 2.8.* * Add no_log=True in kolla_keystone_user * Add endpoint_type as a param in kolla_keystone_service - now AnsibleModule requires all options to be defined, otherwise it throws an UnsupportedParameter error * Add openstack_release variable in kolla/common/config.py which is used for fetching upper-constraints.txt for desired release Change-Id: I2cb0ea2fde1b408d48b39bf7a54b898e850d31aa