summaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2019-06-18Add sha256 in ceph fetch keysMichal Nasiadka1-0/+2
fetch_ceph_keys.py is using insecure sha1 function, this patch adds sha256 beside sha1 - in order to remove sha1 safely in U release. Change-Id: I32ba1abd204c9dba4bbe3132b5650b0e391616af Closes-Bug: #1826327
2019-06-18Add a variable to configure repos disabled in base CentOS imageRadosław Piliszek1-6/+11
[1] disabled CentOS Ceph Nautilus repo for Stein. It turned out to be a problem for TripleO ([2]) which does not use upstream Ceph repo and actually relies on CentOS Ceph Nautilus repo. We did not leave the option to override our customization. This patch adds a customizable variable to base CentOS image: centos_yum_repos_to_disable [1] https://review.opendev.org/651601 [2] https://review.opendev.org/664244 Change-Id: I867ca75cafe853b206beae2f81dfb79b62d05557 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-17base: do not use non-free repositories for UbuntuMarcin Juszkiewicz3-12/+12
Remove restricted and multiverse from ubuntu. restricted is supported software that is non-free. multiverse is unsupported software that is non-free. We should not use any of them. And they are not mirrored by OpenStack infra. Change-Id: I34b9d56559eada96abec13814a2aa91b57055710
2019-06-17Merge "grafana/aarch64: use package from upstream repositories"Zuul4-17/+11
2019-06-17openstack-base: add several popular python modulesMarcin Juszkiewicz1-0/+10
During building of all source images there are Python modules repeating in several targets. bcrypt: bifrost, ceilometer, cinder, dragonflow, freezer, keystone, manila, mistral, neutron, nova, rally, sahara, tacker, tempest, vmtp logutils: aodh, barbican, blazar, ceilometer, cloudkitty, designate, dragonflow, gnocchi, heat, ironic, kuryr, magnum, mistral, neutron, octavia, panko, qinling, solum, tacker, tempest, vitrage, watcher, zun pecan: aodh, barbican, blazar, ceilometer, cloudkitty, designate, dragonflow, gnocchi, heat, ironic, kuryr, magnum, mistral, neutron, octavia, panko, qinling, solum, tacker, tempest, vitrage, watcher, zun psutil: ceilometer, cinder, designate, dragonflow, freezer, heat, ironic, magnum, manila, mistral, monasca-agent, murano, neutron, nova, octavia, panko, searchlight, senlin, tacker, vitrage, watcher, zaqar, zun pymongo: almanach, aodh, freezer, horizon, monasca-agent, neutron-server-opendaylight, panko, vmtp, zaqar pyroute2: dragonflow, kuryr, mistral, neutron, nova, octavia, tacker setproctitle: aodh, ceilometer, cloudkitty, dragonflow, gnocchi, heat, kuryr, neutron, octavia, qinling, tacker, tempest, vitrage, zun simplegeneric: aodh, blazar, ceilometer, cloudkitty, glance, ironic, magnum, mistral, octavia, panko, qinling, searchlight, solum, watcher PyNaCl: bifrost, ceilometer, cinder, dragonflow, freezer, manila, mistral, neutron, nova, rally sahara, tacker, tempest, vmtp WSME: aodh, blazar, ceilometer, cloudkitty, glance, ironic, magnum, mistral, octavia, panko, qinling, searchlight, solum, watcher Change-Id: I3990254258289fae8fbaf505de0f8cdede435111
2019-06-17There is no Java 8 in Debian 'buster'Marcin Juszkiewicz3-4/+25
Debian 'buster' release contains Java 11 only. So kafka, logstash, storm images needed adjustments. Change-Id: I9f1e809d0ef1955b832dd384912f880088426306
2019-06-17Change port of docker registrypengdake2-3/+3
The port of docker registry is conflict with keystone. So we need to change port of docker registry. Change-Id: If15c0caf76b5406f590b05030e43d65ca14c8788 Signed-off-by: pengdake <19921207pq@gmail.com>
2019-06-17Run nova api_db sync before db syncMark Goddard1-2/+2
Backport: Stein, Rocky Since cells v2 was introduced, nova operators must run two commands to migrate the database schemas of nova's databases - nova-manage api_db sync and nova-manage db sync. It is necessary to run them in this order, since the db sync may depend on schema changes made to the api database in the api_db sync. Executing the db sync first may fail, for example with the following seen in a Queens to Rocky upgrade: nova-manage db sync ERROR: Could not access cell0. Has the nova_api database been created? Has the nova_cell0 database been created? Has "nova-manage api_db sync" been run? Has "nova-manage cell_v2 map_cell0" been run? Is [api_database]/connection set in nova.conf? Is the cell0 database connection URL correct? Error: (pymysql.err.InternalError) (1054, u"Unknown column 'cell_mappings.disabled' in 'field list'") [SQL: u'SELECT cell_mappings.created_at AS cell_mappings_created_at, cell_mappings.updated_at AS cell_mappings_updated_at, cell_mappings.id AS cell_mappings_id, cell_mappings.uuid AS cell_mappings_uuid, cell_mappings.name AS cell_mappings_name, cell_mappings.transport_url AS cell_mappings_transport_url, cell_mappings.database_connection AS cell_mappings_database_connection, cell_mappings.disabled AS cell_mappings_disabled \nFROM cell_mappings \nWHERE cell_mappings.uuid = %(uuid_1)s \n LIMIT %(param_1)s'] [parameters: {u'uuid_1': '00000000-0000-0000-0000-000000000000', u'param_1': 1}] (Background on this error at: http://sqlalche.me/e/2j85) Despite this error, the command actually exits zero, so kolla does not notice the failure. This change reorders these two commands to run the api_db sync before the db sync. Change-Id: I0514c02aaee1a413a7979c3a426e0484df839861 Closes-Bug: #1832860
2019-06-15Merge "[neutron] Do not migrate all subprojects"Zuul1-1/+1
2019-06-15Merge "Remove Neutron LBaaS support"Zuul8-86/+11
2019-06-14doc: Start using openstackdoctheme's extlink extensionchenxing7-18/+17
This ensures we have version-specific references to other projects [1]. Note that this doesn't mean the URLs are actually valid - we need to do more work (linkcheck?) here, but it's an improvement nonetheless. [1] https://docs.openstack.org/openstackdocstheme/latest/#external-link-helper Change-Id: I7c979dacd89ebead404b751d596ba120b38f00f3
2019-06-12Move to releases.openstack.orgtonybrad1-3/+3
Change-Id: I7ec146d0edc96f5ce925792530c42d7eedf8a409
2019-06-11Fix lower-constraints test fail due to failing dep buildRadosław Piliszek2-2/+1
Ubuntu Bionic updated OpenSSL package to new release: from 1.1.0 to 1.1.1 It caused cryptography in version from lower-constraints to fail to build in Zuul. Additionally, constrained cryptography version did not match the requirement for constrained PyOpenSSL. This commit bumps the version to the minimum required by constrained PyOpenSSL. It works because manylinux1 (binary) wheel exists. This version agrees also with upper-constraints for Queens. Dependency on cryptography is removed as it is not used directly by kolla (and requirements checker requires lower-constraints matching version - let's not create an illusion of usage). Change-Id: I8ae19f212049cae5dfb4e8dd6ec6cd14a8c46e0e Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-10Merge "Fix issues with Percona in Zuul and clean up a little bit"Zuul8-99/+17
2019-06-10Merge "Debian/Ubuntu: allow to use unsigned repositories"Zuul1-6/+8
2019-06-10Disable and remove OracleLinux CI jobsMark Goddard1-58/+0
We have agreed to remove support for Oracle Linux, starting by disabling the CI jobs. http://lists.openstack.org/pipermail/openstack-discuss/2019-June/006896.html Change-Id: Ic7e7bedf36f98e3f7a0e2a22ec76136f4414c765
2019-06-09Fix ownership of ironic inspector DHCP hostsdirMark Goddard1-1/+2
If you run with enable_ironic set to true and ironic_inspector_pxe_filter set to dnsmasq (the default in stein), ironic inspector can fail with the following in the logs: Permission denied: u'/var/lib/ironic-inspector/dhcp-hostsdir/<MAC address>' A node must be registered with a port for this to happen. Weirdly this happens on centos/source, ubuntu/source, and ubuntu/binary, but not centos/binary. This change changes the ownership of /var/lib/ironic-inspector/dhcp-hostsdir to ironic-inspector user to make it writeable. Change-Id: I19447727f19dbd9c0a3e17d218b48ddc4c253587 Closes-Bug: #1832026
2019-06-08Fix issues with Percona in Zuul and clean up a little bitRadosław Piliszek8-99/+17
Percona site has connectivity issues from OVH hosts (of Zuul). This patch makes it so that: - the internal repo is actually used - RPM GPG keys are downloaded from the actually used repo - Ubuntu mimics the RHEL behavior (i.e. the Percona repo is enabled only in the xtrabackup image) extra benefit: no need for APT preferences for Percona repo to spare MariaDB deps Change-Id: Id27831f6b404762f9e44fd6bd1c4702bf06b05f8 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-07Add script to check for forbidden instructionsMartin André2-0/+50
When building images for binary type, it is expected to not install executables from untrusted sources, and gem, sensu-install, npm or pip packages for instance should come from the distro itself. This commit adds a `validate-binary-build.sh` script that checks for forbidden commands in the rendered Dockerfile templates for the binary type builds and hooks this script with the pep8 CI job. The output is just informative for now until we've fixed the culprit Dockerfiles, then we'll make the script return an error code and with the ability to fail the pep8 CI check. This should prevent unwanted commands from entering binary type Dockerfiles. Change-Id: I66e54bd18f4256cdca6c0c50626de4f975c246b8
2019-06-07Debian/Ubuntu: allow to use unsigned repositoriesMarcin Juszkiewicz1-6/+8
When we run Debian 'buster' or Ubuntu 18.04 in CI job they refuse to work as infra mirror is not signed. This patch instructs APT to use unsigned repos anyway. Change-Id: I530fde5b57894afda2de98d7c217e735497e3feb
2019-06-07grafana/aarch64: use package from upstream repositoriesMarcin Juszkiewicz4-17/+11
We were installing 5.2.4 version instead of just latest one like it is done on x86-64. Change-Id: If8434c6c05e415ac8d601260d02b25facbdef1f5
2019-06-07Merge "Use packagecloud/ubuntu rabbitmq repo for all archs"Zuul2-0/+6
2019-06-07Remove crane imageMark Goddard8-99/+5
This image was deprecated in the Stein cycle. Change-Id: I249b78cd263c97c4a9223523c77f8c325f3e649a
2019-06-07Remove nova-consoleauthStephen Finucane2-31/+8
The nova-consoleauth service was deprecated during the Rocky release [1] and has not been necessary since unless you're using cells v1. As Kolla has never supported cells v1, which is finally being removed during Train [2], we can get ahead of the curve and stop deploying nova-consoleauth immediately. [1] https://specs.openstack.org/openstack/nova-specs/specs/rocky/implemented/convert-consoles-to-objects.html [2] https://blueprints.launchpad.net/nova/+spec/remove-cells-v1/ Change-Id: I19d467adbc1dab6709ce9667b18f1bb6dff12c1e Signed-off-by: Stephen Finucane <stephenfin@redhat.com> Depends-On: I099080979f5497537e390f531005a517ab12aa7a
2019-06-07Remove Neutron LBaaS supportCarlos Goncalves8-86/+11
The project has been retired and there will be no Train release [1]. This patch removes Neutron LBaaS support in Kolla. [1] https://review.opendev.org/#/c/658494/ Depends-On: https://review.opendev.org/#/c/663875/ Change-Id: I99484c48ed09f7e015e134bdff1f298c359c6905
2019-06-07Merge "Ignore EM releases in version-check.py"Zuul1-0/+4
2019-06-07Merge "Debian/Ubuntu: more python3 packages for binary"Zuul29-85/+93
2019-06-07Merge "Debian/Ubuntu: move to Python 3 for source images"Zuul36-62/+105
2019-06-06Merge "Remove tripleo-ui"Zuul5-90/+4
2019-06-06Debian/Ubuntu: more python3 packages for binaryMark Goddard29-86/+94
backport: Stein During the switch to Stein UCA, we did not switch all packages to python 3 for Debian/Ubuntu binary images. This change switches some more of those packages. Change-Id: I0bff21384d88ea678608392de2db1ba418c96665 Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
2019-06-06Debian/Ubuntu: move to Python 3 for source imagesMarcin Juszkiewicz36-62/+105
Commit 43b74ccc157c0b50138c3785ed91dab504895571 enabled use of Python 3 based packages but not switched to use Python 3. Some of images still contain Python 2. There are two reasons: - Ceph (ceph-common depends on Py2) - python3-ldappool on Ubuntu 18.04 In Ceph situation Py3 packages were added. For second one we can not do anything - Py2 dependency got dropped in Ubuntu 18.10 version. Removed neutron-server-plugin-networking-infoblox due to being not maintained. Once https://review.opendev.org/#/c/657578/ get merged someone may revert that part. Implements: blueprint debian-ubuntu-python3 Depends-on: Ie2a1077f7def0743f1403341985e2109aa490026 Change-Id: Ibfe0c2b8be98db56c61f74fb0247488ab3749ef4
2019-06-06Merge "Blacklist bandit 1.6.0"Zuul2-2/+3
2019-06-05[neutron] Do not migrate all subprojectsJason1-1/+1
Instead of migrating all Neutron subprojects at bootstrap time, target specifically the neutron, neutron-fwaas, and neutron-vpnaas subprojects speficially. If a subproject is not specified, all subprojects are migrated, which is not the intended behavior. Change-Id: Icb8d572b7f084804e0423a8a3171dd66646b3885
2019-06-05Allow building images if parent was skippedJason1-1/+3
This fixes a bug where if an image had a parent that was skipped, it would never get built. Normally when a parent finishes building it triggers the build of its children. This process is kicked off by Kolla finding the grandparents that have no parents above them. However, sometimes parents should be skipped, and in this case they would never get scheduled, and so their children would never build, producing a strange error without much information. Fix is to allow building an image if its parent is explicitly marked as having been skipped. The use-case for this is when you want to iterate on building an image without going through the cost of re-running the parent builds. In particular, if your builds are using Git sources, which break Docker caches, the cost of parent builds is high and the feedback loop during development has a much higher latency. Allowing some way for images to be rebuilt in a targeted manner is helpful when in the development phase. Change-Id: I6b6897d20626825bcd235b9a85859644effbd222 Closes-Bug: #1810979
2019-06-05Remove tripleo-uiAlex Schultz5-90/+4
The tripleo-ui project has been removed from the upstream. Remove the references to the tripleo-ui containers. Change-Id: I353ecd3ed04c78fd21f0108c5e1355280d3f3bb9 Closes-Bug: #1831478
2019-06-05Merge "create missing apache2 directory on Debian/Ubuntu"Zuul23-0/+23
2019-06-05Use packagecloud/ubuntu rabbitmq repo for all archsMarcin Juszkiewicz2-0/+6
Change-Id: I880a33b56a2fe9b86de57326c80310a6a83c5e50
2019-06-05Merge "Ceph: Update to Nautilus on CentOS and OracleLinux"Zuul5-9/+51
2019-06-03Merge "Use the default policy.json for Qinling"Zuul1-1/+1
2019-06-03create missing apache2 directory on Debian/UbuntuMarcin Juszkiewicz23-0/+23
Ubuntu/source deployment of several images (horizon, placement-api, zun) failed with: + exec /usr/sbin/apache2 -DFOREGROUND apache2: Syntax error on line 80 of /etc/apache2/apache2.conf: DefaultRuntimeDir must be a valid directory, absolute or relative to ServerRoot Change-Id: Ie2a1077f7def0743f1403341985e2109aa490026
2019-06-02Merge "Update contributor guide"Zuul6-17/+355
2019-05-31Ceph: Update to Nautilus on CentOS and OracleLinuxMark Goddard5-9/+51
The CentOS Stein OpenStack distribution depends on the Ceph Nautilus release, while Kolla currently deploys Luminous on CentOS. This change switches CentOS and OracleLinux builds to use Ceph Nautilus. Support for auth UID has been removed in the Nautilus release [1][2], so we have removed the --set-uid argument from calls to ceph-authtool. Also ceph-osd bootstrap mode fails when no mon config is provided, so we added --no-mon-config (mon config is injected later after bootstrap). Due to ceph-nfs build issues (ceph upstream nfs-ganesha rpms relied on older version of userspace-rcu, than CentOS Storage SIG packages) we need to move to ceph upstream rpm repos. [1] https://github.com/ceph/ceph/commit/d6def8ba1126209f8dcb40e296977dc2b09a376e [2] http://docs.ceph.com/docs/master/releases/nautilus/ Co-Authored-By: Michal Nasiadka <michal.nasiadka@nokia.com> Change-Id: I000398f587c5f4d6cc8995e34e162eebc77bc3e3 Implements: blueprint centos-ceph-nautilus
2019-05-29Use td-agent-gem to install fluentd monasca plugin on ubuntuMark Goddard2-9/+10
If monasca is enabled on ubuntu, we see the following error in fluentd: [error]: config error file="/etc/td-agent/td-agent.conf" error_class=Fluent::ConfigError error="Unknown output plugin 'monasca'. Run 'gem search -rd fluent-plugin' to find plugins" This is because we use 'fluent-gem install' to install the gem, which works on CentOS but on Ubuntu it is necessary to use 'td-agent-gem install'. Change-Id: I515f9764ca93a41a871e520696193a9298856d08 Closes-Bug: #1830147
2019-05-29Use the default policy.json for QinlingGaetan Trellu1-1/+1
To avoid complexity and possible issue during the Qinling usage we should build the Qinling Docker images with the policy.json file. The reason why is because Qinling doesn't have default policies. Change-Id: I13f64fcbfb3150efcb94af267f463eaddb11621d Closes-Bug: #1830900 Implements: blueprint qinling-support
2019-05-28Merge "Install fluentd gem on debian/ubuntu for non x86_64"Zuul4-7/+31
2019-05-28Merge "create missing apache2 directory on Debian/Ubuntu"Zuul2-0/+2
2019-05-24Merge "Bump Monasca Fluentd plugin version"Zuul1-1/+1
2019-05-24Install iputils package in neutron containersSlawek Kaplonski1-0/+2
This package provides e.g. arping tool which is used by Neutron services. On e.g. RHEL7 it was probably installed as some dependency to other package but on RHEL8 it's missing which cause some errors e.g. in neutron_l3_agent container. Change-Id: I9c087164f32cb8a69d2155bc68b6f62233ad58c6 Related-Bug: https://bugzilla.redhat.com/show_bug.cgi?id=1713321
2019-05-23create missing apache2 directory on Debian/UbuntuMarcin Juszkiewicz2-0/+2
Ubuntu/source deployment of horizon and placement-api failed: + exec /usr/sbin/apache2 -DFOREGROUND apache2: Syntax error on line 80 of /etc/apache2/apache2.conf: DefaultRuntimeDir must be a valid directory, absolute or relative to ServerRoot Once directory is in place it works fine. Change-Id: Icbd500e5b16deb0eafc0821a1c117794ddb8ae62
2019-05-23Bump Monasca Fluentd plugin versionDoug Szumski1-1/+1
Bump version to include support for setting log message field name. Change-Id: Ib3953b49247bb36ac8ce25578c05c6bcb2a1905a Partial-Bug: #1830184