summaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2021-03-19Fix url for get_pip macrostein-eolDincer Celik1-1/+1
Stein only. Change-Id: I1d175b603bbc3adbd371a2d66401ed380378ea9e
2021-02-15Fix Mistral source images to respect upper-constraintsRadosław Piliszek2-1/+5
Backport to all supported branches. Change-Id: I4a13bbe959e3324f05d5cf78a3be2415eb2ba7ec (cherry picked from commit 004d9eb5d575fcb140b4d90fb30ced0a81dd3e66)
2021-02-15sensu: drop Ubuntu supportMarcin Juszkiewicz2-3/+2
Upstream removed Ubuntu repositories. Train/Stein only Change-Id: Ice125e101a689fd3df9d1cd9a093a026f9747a3e
2021-01-27CI: Use Docker proxy for pulls + Ruby fixes + get_pipMark Goddard5-3/+31
For Stein (due to CentOS 7) includes as well: - get_pip macro: fix for Python 2.7 - sensu-client: Pin simpleidn Ruby gem simpleidn Ruby gem started requiring Ruby 2.2. - monasca-grafana: Pin git Ruby gem fpm Ruby gem started requiring git Ruby gem git Ruby gem started requiring Ruby 2.3 - mark helm-repository as unbuildable It no longer builds, it's not used, it's been removed... Change-Id: I0c4d5e1ea16c6677813a334b38b3a22ad811531d Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com> Depends-On: https://review.opendev.org/772501 (cherry picked from commit a8c12def858b57349207cab5fa8dabb3c23bdfa0)
2020-12-17Cap bandit to 1.6.3 (was Support CentOS 8.3)abraden1-1/+1
This patch is a backport of some parts of the Train backport of I2d67b3ed7b7c521bc755ec9a87365c9962a9eeff, which also includes some fixes for the fallout from the new pip resolver. * cap bandit<1.6.3, since bandit no longer supports Python 2. Change-Id: I2d67b3ed7b7c521bc755ec9a87365c9962a9eeff Closes-Bug: #1907826 Co-Authored-By: Radosław Piliszek <radoslaw.piliszek@gmail.com> Depends-On: https://review.opendev.org/767308
2020-12-10[CI] EM - Stop periodicsRadosław Piliszek4-25/+0
This stops periodic jobs from running on Stein as it reached EM state. This includes image publishing on a daily basis. Change-Id: I6abfd6e6ab1c438b215b9738b53c3384844000a0
2020-12-09[CI] Stop testing lower-constraints and fix py27 jobRadosław Piliszek2-2/+1
This patch disables the lower-constraints job as it started failing and we agreed during the PTG to drop it anyway. [1] For Train and below additionally blacklist bandit 1.6.3 as it was improperly released as a universal wheel. [2] [1] http://lists.openstack.org/pipermail/openstack-discuss/2020-October/018445.html [2] https://github.com/PyCQA/bandit/issues/663 Change-Id: Icfedd16ef9aed84e9f9be939e832c35e0d735efe Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/766180 (cherry picked from commit bc0a41cd02cd11df0907a31f181782cebda74f86)
2020-11-20Bump (final) versions for Steinstein-em8.0.5Mark Goddard1-7/+7
Change-Id: Ieb406271eea9e09d6e63820afc77369c932d7626
2020-11-06Add mongodb to skipped imagesMichal Nasiadka1-0/+4
Mongodb builds for CentOS and Oraclelinux are failing with missing mongodb package. [0]: https://376645110508c67547f1-711d728cec9366cabf90489c3301c285.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/kolla/stable/stein/kolla-publish-centos-source/02c19f5/kolla/build/000_FAILED_mongodb.log [1]: https://be16c502bd559ea2be0a-e7edb05e06a1172316eb4206e173039e.ssl.cf5.rackcdn.com/periodic/opendev.org/openstack/kolla/stable/stein/kolla-publish-centos-binary/7906290/kolla/build/000_FAILED_mongodb.log [2]: https://c0896a76e4bfc649b00b-bb1c7e0df0c2b154f674f44976092bb9.ssl.cf5.rackcdn.com/periodic/opendev.org/openstack/kolla/stable/stein/kolla-publish-oraclelinux-source/97b0841/kolla/build/000_FAILED_mongodb.log [3]: https://130e95a9c5888f92af5c-5775ad363b5cad1640e005d0e8356875.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/kolla/stable/stein/kolla-publish-oraclelinux-binary/31aefed/kolla/build/mongodb.log Change-Id: Ia6e81509379a77009d3d416522ec91ad51d6611b
2020-10-16Merge "Add sysfsutils to nova-compute ubuntu source" into stable/steinZuul2-0/+6
2020-10-16Merge "Bump versions for Stein" into stable/steinZuul2-41/+38
2020-10-14Checks for heat_user_domain explicitlyFabian Bermel1-2/+4
The script should check for heat_user_domain explicitly instead of matching on "heat" Closes-Bug: #1839824 Change-Id: Iac83444487d2aa96a0f90086029f43922d1e7856 (cherry picked from commit 5e946cac490077011709c7587dc5e0b06927464f)
2020-10-14Add sysfsutils to nova-compute ubuntu sourceRadosław Piliszek2-0/+6
This fixes the FC Cinder backend usage in Nova. Change-Id: I036cfe3af3dd96625f986a820c78a10e6558b086 Closes-bug: #1884484 (cherry picked from commit 0c8702c96f852eae7a1fb784a260c01c15fb86f3)
2020-10-14Bump versions for SteinMark Goddard2-41/+38
Also, make Bifrost buildable again. The longstanding Bifrost issues in Stein have now been fixed [1] for CentOS. [1] https://review.opendev.org/#/c/749014/ Change-Id: I030bbe32bd489c3031b065f74de83c658356d4b2
2020-09-14Fix kolla_set_configs --check with a directoryMark Goddard3-5/+53
There are several issues with kolla_set_configs --check: 1. We calculate the destination path incorrectly when comparing a file in a directory, due to passing arguments to os.path.relpath in the wrong order 2. For directories that have not changed, we also attempt to compare them as files, which fails when they are open()ed. 3. If the config JSON does not have a config_files key, it fails with a KeyError. The first two issues affect the fluentd container, which specifies directories as the source, without using a glob. The third affects OVN containers. This patch fixes these issues. Closes-Bug: #1890567 Change-Id: I8921befe51da4282121443849177a7ca5ebe8822 (cherry picked from commit c5320eb22386c34d83435fa0b9aa03b178996b52)
2020-09-05Add glusterfs-fuse package to manila-share containerLinPeiWen1-2/+4
Change-Id: I2b4cfdb25f3ff82d8d6fdebba8b75a818c10a388 (cherry picked from commit 9ca43b9ed7814045a0219e17524f4e2aed2f1771)
2020-09-03Upgrade Fluentd Monasca pluginDoug Szumski2-1/+6
Switch to YAJI JSON parser as suggested in [1]. [1] https://docs.fluentd.org/quickstart/faq#i-got-encoding-error-inside-plugin-how-to-fix-it Closes-Bug: #1889065 Change-Id: I2ecd3b029b956e000feaaa9e10a169521ba53d66 (cherry picked from commit 556d4353aa846765557cfdd3c6e087a25248c517)
2020-09-03[CI] Fix wheel url for CentOSRadosław Piliszek1-1/+1
CentOS wheels do not differentiate between minor versions atm. Change-Id: I5365c813bab5e3205fd34eb64dc3337f192d67d4 (cherry picked from commit a3ef68d91c60c9d451450ae0e371e25402bb4c6f)
2020-09-03Fix ironic build issues - LANG relatedMichal Nasiadka2-0/+15
ironic drivers-requirements installation fails with: UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 2: ordinal not in range(128) Squashed ,,cherry-pick'' from stable/train - adding LANG block and locale-gen for Ubuntu family in base Dockerfile: https://review.opendev.org/#/c/684808/ https://review.opendev.org/#/c/691835/ https://review.opendev.org/#/c/694099/ Temporarily blocks bifrost building as well - to revert! Change-Id: I79ee884ad35bf5166c9ea303d73416271ff5f637
2020-07-06Drop systemd support from nsswitch.conf on RHEL-based distros8.0.4Michele Baldessari2-1/+9
A bit like we did for I3e0e86026f5a4a78473bed824cd1682d3a020cd5 we should remove the nss-systemd lookup from containers. The reasons for this are as follows: 1) Just like for I3e0e86026f5a4a78473bed824cd1682d3a020cd5 when this nss module is triggered it tries to talk to dbus. It triggers a bunch of selinux denials and it makes little sense to open all containers to talk to dbus. In particular, if a container is run as non-privileged and bind-mounts /run from the host, we will hit selinux denials like the following: type=USER_AVC msg=audit(1592337775.860:74119): pid=1284 uid=81 auid=4294967295 ses=4294967295 subj=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 msg='avc: denied { send_msg } for msgtype=method_call interface=org.freedesktop.DBus member=Hello dest=org.freedesktop.DBus spid=406228 scontext=system_u:system_r:container_t:s0:c162,c886 tcontext=system_u:system_r:system_dbusd_t:s0-s0:c0.c1023 tclass=dbus permissive=0 exe="/usr/bin/dbus-daemon" sauid=81 hostname=? addr=? terminal=?'UID="dbus" AUID="unset" SAUID="dbus" 2) It just makes little sense in a kolla-world to have containers talk to dbus/systemd and it saves us some time when a lookup triggers the systemd module for whatever reason. Especially because the nss-systemd module does a few things which are not useful in a container (ensures that the root and nobody users and groups remain resolvable, SystemD's DynamicUser= feature, provide Lookup API via Varlink) The sed regex gives us the wanted results: $ diff -u /etc/nsswitch.conf.orig /etc/nsswitch.conf --- /etc/nsswitch.conf.orig 2020-06-19 07:18:10.974580755 +0000 +++ /etc/nsswitch.conf 2020-06-19 07:20:12.260230103 +0000 @@ -53,9 +53,9 @@ # group: db files # In order of likelihood of use to accelerate lookup. -passwd: sss files systemd +passwd: sss files shadow: files sss -group: sss files systemd +group: sss files hosts: files dns myhostname services: files sss netgroup: sss Related-Bug: #1883849 Change-Id: I81e5b7abf4571fece13a029e25911e9e4dece673 (cherry picked from commit dc2ddfa9750f94430a5b04b62fc1fa6adcb234f8)
2020-06-26Merge "Bump versions for Stein" into stable/steinZuul1-2/+2
2020-06-26Bump versions for SteinMark Goddard1-2/+2
Change-Id: Id31883d93628958de61e8cd22de482c48b9c6c0b
2020-06-26CI: use wheels from infra mirrorMarcin Juszkiewicz2-0/+4
If they are available then we do not need to build them. Especially AArch64 jobs will speedup (once wheels are built). Change-Id: I79af6c37950e156018a9204fbcc7417cd7d41012 (adapted by hand)
2020-06-25CI: Install python deps, mark oraclelinux rsyslog as skippedMichal Nasiadka3-1/+46
setuptools is missing from infra image - so it needs to be installed. Copy cat of a kolla-ansible change: https://review.opendev.org/#/c/735808/ Disables rsyslog build on oraclelinux (both source and binary) and tripleoclient (binary). Depends-On: https://review.opendev.org/737829 Change-Id: I6068abcbc0e73eeab77b0aa99983a95adc6defd3
2020-06-09Bump versions for SteinMark Goddard1-5/+5
Change-Id: Iaa16955b9b4b078901ce17934721b7780cc43b37
2020-06-09Fix multiple issuesMark Goddard3-3/+9
Both issues affect Train and earlier releases. 1. Fix monasca-grafana by pinning more Ruby gems childprocess 3.0.0 and ffi 1.13.0 depend on Ruby 2.3. 2. Bump bifrost to 6.0.4 Bifrost had a fix to stop using the master branch of DIB which dropped support for Python 2. 3. Drop docker-client from OracleLinux sensu-client image The package fails to install due to a missing dependency on subscription-manager. Change-Id: Ida7e20833360bbca69c6aafc4f5d7cb375bb106f Closes-Bug: #1882070 (cherry picked from commit 3784d32d9ceacf0dad8057092752f1ae7be37ed3)
2020-05-25CI: Ignore moreRadosław Piliszek2-0/+7
This aligns Kolla with Kolla Ansible. Change-Id: I02ee643d0f46e6ff1ed376362b4ee35ddadf7960 (cherry picked from commit 8500eaee2a030c2720a008f8a9a073ec20fad70e) (cherry picked from commit d3587d44d7c631fcba63df9dc199280988ae6551) (cherry picked from commit c88e60d6805e0d32ac404bff863f6b541ffa7b64)
2020-05-25CI: Ignore .zuul.dRadosław Piliszek2-1/+1
Zuul handles jobs updates just fine, no need to run kolla build jobs when touching .zuul.d for different reasons. Change-Id: I201a194fa473a63b880cefc00febb543b40bcec8 (cherry picked from commit a0087490fffa11e72eaafc490ae67954f0966831)
2020-05-01Bump versions for Stein8.0.3Mark Goddard1-3/+3
Change-Id: Ic06bdcf30b7df7447b1bcbf2f688a9d148a59c67
2020-04-28drop tripleo-common-tempest-pluginMarcin Juszkiewicz1-4/+0
This is not needed plugin without any branches or releases. And wants Python 3 while we have Py2 for CentOS 7. Change-Id: I9cab91b82941ea125b16d19e68722ce41a1f11f2 14:41 < hrw> is tripleo-common-tempest-plugin your stuff? 14:43 <@EmilienM> yes and it does nothing. I thought we removed that? 14:43 <@EmilienM> apparently it's still here https://github.com/openstack/tripleo-common-tempest-plugin 14:43 <@EmilienM> we should burn it, weshay|ruck ^ 14:44 < hrw> EmilienM: also fine to drop from train? 14:44 <@EmilienM> burn it everywhere you can 14:44 < hrw> THANKS 14:44 <@EmilienM> it has never been useful 14:44 <@EmilienM> and people who started it left 14:48 <@weshay|ruck> EmilienM, yup
2020-04-26[rally] Fixes Ubuntu binaryDincer Celik2-1/+12
This is a follow up for [1]. "rally-manage db" command was deprecated since 0.10.0 but Ubuntu ships 0.9.1 for Bionic. [1] https://bugs.launchpad.net/kolla/+bug/1856693 Closes-Bug: #1872283 Change-Id: I5fb0fc4e6a8bf7ab07abc9c78f0673e3e764b4d1
2020-04-23Add nfs dependencies to glance containerRajat Dhasmana2-3/+12
Glance API image lacked nfs programs/utils to be able to mount NFS exports. This affected Glance usage with Cinder backend when NFS was used as Cinder backend. Closes-Bug: #1868574 Change-Id: I3aac1e6a7f7c5f839b036f15713af949fba206cc (cherry picked from commit cac9d46aa6dbac6631bdcae67db125a88e1c3234)
2020-04-17Merge "Add vitrage-persistor image" into stable/steinZuul2-0/+48
2020-04-14Ensure proper JSON in keystone bootstrapRadosław Piliszek2-1/+8
This fixes the issue when keystone-manage output included backslashes and/or double quotation marks which broke JSON string. Change-Id: Ifae18c407210c12745d29fc4c95dca69aeafe6a8 Closes-bug: #1866017 (cherry picked from commit 33d184a731458bb45d1206bdae4fb172629a76e7)
2020-04-11Add vitrage-persistor imageQ.hongtao2-0/+48
Kolla was missing vitrage-persistor image required by Vitrage for data storage. Change-Id: Id5e143636f9a81e7294b775f3d8b9134bee58054 Closes-Bug: #1869319 (cherry picked from commit ad06096448a585a16ad73b610b0adc81b597ccec)
2020-04-08Sensu: Remove ceph and process-checks plugins from clientMark Goddard1-2/+0
The sensu image became unbuildable, failing to install the ceph plugin: Unable to resolve dependencies: sensu-plugins-ceph requires english (= 0.6.3) This has happened because the author of the 'english' gem has seen fit to publish a new 0.7.0 release, and 'yank' [1] all previous releases from rubygems. This change removes the ceph and process-checks plugins, which both suffer from a dependency on the yanked english 0.6.3. [1] https://rubygems.org/gems/english/versions/0.6.3 Change-Id: I9d34413fa10b5a2920aca60b08141bfaddcc7415 Closes-Bug: #1871600 (cherry picked from commit 818dc4d6ff12a3119be072e0c68e2d2c8da9b799)
2020-04-07Bump versions (Stein)Dincer Celik1-1/+1
Change-Id: Ie4a85d84aef4dda7acee10c08f1377d521479963
2020-04-07Make deploy jobs voting againMark Goddard3-24/+8
These were temporarily made non-voting in I8c2da6437333210a7926f2deb926ab5d1c93c3c6 to allow us to fix CI. Change-Id: I498aa50a0d59d090486d60c2b34b4f2fd077d401
2020-04-03Fix invalid test in cinder data migration scriptGauvain Pocentek2-1/+6
The extend_start.sh script for cinder-api uses an incorrect test to check if the MAX_NUMBER variable is set. This leads to a incorrect cinder-manage command being run if this variable is not set, making the database migration fail. This change fixes the test to properly use the MAX_NUMBER variable. Change-Id: Ie46da709db0de09a9cf641b3c154275282f213fc Closes-Bug: #1866827 (cherry picked from commit ff42ff20048ef3b7d2f8df04ada8ff4bf7b710e0)
2020-04-03Fix multiple CI issuesMark Goddard5-8/+36
1. Pin openstacksdk and client libraries in kolla-toolbox Stein and below only. openstacksdk released 0.45.0 (and possibly 0.44.0 as well) which dropped py2 compat but did not advertise the fact. It was amended later but it will now always affect kolla images until pinned to older. The observable error is: "ImportError: No module named queue" Since Train we pin u-c, but not before that. This change introduces a version constraint for openstacksdk and client libs: - python-novaclient - python-cinderclient - python-keystoneclient - python-glanceclient 2. Make deploy jobs non-voting For similar reasons to 1., the deploy jobs fail when using the openstack client for testing. Due to a dependency loop between these two projects, we must make these jobs non-voting to fix the image build. This should be reverted ASAP. 3. CI: Add https match for mirror.centos.org to template-overrides Some CentOS repos (currently one - Ceph NFS Ganesha) use https://mirror.centos.org instead of http:// and we break their definition by removing mirrorlist= entry and not inserting baseurl entry due to a missing match. Original Change-Id: I7b29f8c6be80820042023d2b85162d5cc9a65f08 Change-Id: I8c2da6437333210a7926f2deb926ab5d1c93c3c6 Closes-Bug: #1870349
2020-03-24Bump service versions (Stein)Mark Goddard1-1/+1
Change-Id: I9c94d95287ef8956556de5d48b7e88b69457e60f
2020-03-18Merge "mariadb: install mariabackup on Debian" into stable/steinZuul1-0/+1
2020-03-18Merge "CI: Install tox" into stable/steinZuul1-0/+5
2020-03-18mariadb: install mariabackup on DebianMarcin Juszkiewicz1-0/+1
On AArch64 systems we are unable to deploy Stein due to lack of mariabackup command. Change-Id: I00b8c945470a0f63f23f2d0da74eed3189f5d9e5 Closes-bug: #1867750
2020-03-18CI: Install toxMark Goddard1-0/+5
tox will be removed from the base image. Install it before that happens. This change is made in a simple way that can be easily backported. Change-Id: I2a24c87aa44c1e03ba76a2fb0bd71caf54eb4211 (cherry picked from commit a81413fc52b0eaf1eefc3302ba425ac9b93d5a4d)
2020-03-17kibana, nova-libvirt: handle it properly for non-x86Marcin Juszkiewicz2-0/+32
manual backport from master changes: - https://review.opendev.org/#/c/712987/ - https://review.opendev.org/#/c/713403 Upstream kibana package contains NodeJS x86-64 binaries so can not be used directly on non-x86 architectures. I took upstream packages, removed NodeJS binary from it and added 'nodejs' dependency. Package is present in my Linaro OBS repository where I keep other packages needed for aarch64 kolla run. Via APT pinning I mark them as not wanted so they are not used on any architecture with two exceptions: 1. libvirt - we need fixed version to be able to use ThunderX servers 2. kibana - to be able to run it at all For x86-64 upstream kibana package is used. Closes-bug: #1867365 Change-Id: I955619d6992f8714ae753dc155e248d255340ecf
2020-03-16Merge "Adds python3-systemd for ansible deploy interface" into stable/steinZuul2-0/+9
2020-03-13Merge "Bump stein versions" into stable/steinZuul1-1/+1
2020-03-11Adds python3-systemd for ansible deploy interfaceAntony Messerli2-0/+9
When doing a source install, ironic doesn't have python3-systemd as a dependency and the current ironic-conductor container doesn't install the required dependencies which causes the ansible deploy interface to fail with the error, "Systemd bindings do not exist". This adds the needed dependencies when doing a source build. This installs the needed files for both rpm and deb builds on python 2.x and 3.x. Change-Id: I5d1bcb0f7d7902b4e122c12697483433bcf52ca2 Closes-Bug: #1861427 (cherry picked from commit 4a67e58f7971641c55247f02985e13ef391ca7ab)
2020-03-11Add ssh clients to Ironic Conductor containerAntony Messerli2-0/+9
Adds ssh clients to Ironic Conductor container for ansible deploy interface. Change-Id: Ib995c6ebe5ee76ee1a39e4b5918a79bd61b87a01 Closes-Bug: #1862079 (cherry picked from commit 7234e8b2f72275c85caa146a6d9e49d1ab8281b7)