summaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2019-08-15Add prometheus_client to monasca-agent imagePierre Riteau1-1/+2
The prometheus_client package is required to use the Prometheus plugin. It makes sense to include this dependency by default since Kolla Ansible can deploy many Prometheus exporters, making it easy to scrape their metrics and store them in Monasca. The increase in size of the container image is negligible. Change-Id: I9b0a162513ed436930c4541b758fc9cb2ef97e96 (cherry picked from commit a74aa1bd21b04eceede6cf425a5e56dcacec1412)
2019-08-15Add partition detection to fix osd initialization failurewangwei1-1/+29
The changes in the following commit did not completely solve the problem of osd initialization failure: https://review.opendev.org/652612 In order to solve this problem, the partprobe command consistent with ceph-disk is added, and then a loop is added to detect the partition, which is acquired every 1s. When the partition appears, the osd initialization is continued. Change-Id: I0ca255c6358132d9e3acfa6b610b70a78756512c Closes-bug: #1824787 (cherry picked from commit 342c9f0cd0dc4b97870dc40fab6c5a7d241b40ed)
2019-08-15Ensures monasca-thresh data and worker dirs exist and are empty on start upIsaac Prior1-1/+30
This prevents the filesystem from filling up with Apache Storm temporary files which will otherwise not be cleared. Change-Id: Ib07e32f4e67e500f10986103d781dfd3874ffdd2 Partial-Bug: #1839149 (cherry picked from commit 16d4cd91d24d48e4cdf90d5c06991b52e00803ba)
2019-08-15Delete default gnocchi & aodh wsgi conf in Ubuntu binaryEddie Yen2-0/+8
Ubuntu distro package will create default wsgi conf in apache during gnocchi-api and aodh-api installation. We need to delete them since we only use the conf that pushed by kolla-ansible. Change-Id: Ib31e733eba12deebdf469c306dfba4191a1b89f5 Related-Bug: 1832306 Related-Bug: 1836520 (cherry picked from commit 5eb780d0b0d12186c57b828320c3421b98b97840)
2019-08-15There is no Java 8 in Debian 'buster' (part 2)Marcin Juszkiewicz2-2/+17
Debian 'buster' release contains Java 11 only. So opendaylight and monasca-thresh images needed adjustments. Change-Id: I78f8be44436b8c8e5f58fea40a762c17e6b510a8 (cherry picked from commit e04428f8f52e3ef14997b16bb1f3f3e3bf1bdfe5)
2019-08-15There is no Java 8 in Debian 'buster'Marcin Juszkiewicz3-4/+25
Debian 'buster' release contains Java 11 only. So kafka, logstash, storm images needed adjustments. Change-Id: I9f1e809d0ef1955b832dd384912f880088426306 (cherry picked from commit 307ae614546c4d094bae5b49477b0de88b708738)
2019-08-07Stein-only: update packagesRadosław Piliszek1-5/+5
Change-Id: I67e1d77d34a7198321d170d8ffacff9b39308170 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-08-03TrivialFix: remove unused ganesha nfs repo fileRadosław Piliszek1-5/+0
Change-Id: Iab036be2b25867a268f4cef6f735dc64f8910fa0 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit 92b3b5699661d3b7707d48cf2fc4801118aca1ab)
2019-08-03Merge "Update build profiles for Placement split" into stable/steinZuul1-0/+3
2019-08-02Update build profiles for Placement splitDoug Szumski1-0/+3
The Placement API is now a separate project, but anyone building Nova is likely to want it. This change ensures that it is built alongside Nova. Change-Id: I05433f5bb2313e2adff39850a970d4430340c852 (cherry picked from commit d4e89eb932d660b4e610460b3ec9792a3e08091c)
2019-08-02ceph mds cap 'allow *' in extend_startRadosław Piliszek1-1/+1
This applies the fix made in kolla-ansible (see [1]) to kolla ceph mon image directly. [1] https://review.opendev.org/670035 Change-Id: I1822a8c610db72654bbacc7148e25a837090b680 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit b1d4ed51f41721c86a33d766fdfd80aaccf1df60)
2019-07-23Merge "nova-libvirt: in Debian qemu-kvm is x86 only" into stable/steinZuul1-1/+4
2019-07-22storm: fetch storm archive from upstreamMarcin Juszkiewicz1-1/+1
URL in Dockerfile was giving us 404 error Change-Id: I16d5f79c00473e5113aee3739defc822b516bda4 (cherry picked from commit c73815347e2e6a456c29dc1f6d93d7ed5c8f7c59)
2019-07-17nova-libvirt: in Debian qemu-kvm is x86 onlyMarcin Juszkiewicz1-1/+4
This package provides just a wrapper script /usr/bin/kvm which run qemu-system-x86 in kvm mode for backwards compatibility. Change-Id: I0cc03a1ab5a79ae49fa7d13ac549e21d3ec5295d (cherry picked from commit 408554475ba02d89206a7fa01824d7277bfc2664)
2019-07-16Bump Monasca Fluentd output pluginDoug Szumski1-1/+1
This resolves an issue where the previous version of the plugin would fail to re-send buffered logs if a post to the Monasca Log API failed. With this new version of the plugin, logs are correctly buffered and resent. Change-Id: Ic1d93a8ea5f2571edfacf50809d51a8b77959a73 (cherry picked from commit d7e6c28272a2efddec8a1747067e4fdee4ff50ba)
2019-07-05Merge "CI: set the same gate queue for kolla and kolla-ansible" into ↵8.0.0.0rc28.0.0Zuul2-0/+2
stable/stein
2019-07-05Merge "Fixes ceph-osd deploys with loop devices." into stable/steinZuul1-1/+6
2019-07-04CI: set the same gate queue for kolla and kolla-ansibleRadosław Piliszek2-0/+2
This is to ensure that any Depends-On does not cause Zuul not to pick up the change for gating due to no notifications between queues. Previously W+1-ing a change which depended on non-merged change from the other project caused it to remain in the same state. Change-Id: I1815c3f30c3208b31501d1b7c2bd6be99db437e5 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit 4884203a9ed8e1a2e67d3877e195359d4e3ad726)
2019-07-04Fixes ceph-osd deploys with loop devices.Dincer Celik1-1/+6
Change-Id: I98405e3fb32cbec2d9863817a913ed71c5597e15 Closes-Bug: #1834678 (cherry picked from commit f5ac80e332c2a057ee68d95983492bc7e1156b9a)
2019-07-03Extract CI vars for use in kolla-ansible jobsRadosław Piliszek2-10/+12
Adapted for stable/stein (oraclelinux still tested) Change-Id: If58f15e18e420aca790496132352f1c1dcdb2640 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit 8270ae20f9a8d528d5bea9e275a84a3ef4cf23aa)
2019-07-01Update versions:Michael1-2/+2
./tools/version-check.py Update ironic-inspector-8.2.2 Update neutron-14.0.2 Change-Id: Ie856fcc179933c5b58f8944ea6b57a402d83843b
2019-06-28Merge "Clean up test process" into stable/steinZuul10-133/+62
2019-06-28Merge "Run nova api_db sync before db sync" into stable/steinZuul1-2/+2
2019-06-27Merge "Fix deployment of ceph-nfs container failing due to wrong USER" into ↵Zuul1-3/+0
stable/stein
2019-06-27Clean up test processRadosław Piliszek10-133/+62
If stestr failed, then no node info was logged. Logging node info is now handled in pre and post stages of Zuul. Additionally Zuul v3 migration recommendations were applied and some unused code removed improving general readability. Change-Id: Iae9d37cb76997ba8389e21c7e2a3bf5905abe029 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit c7ac0f0de0c65afe54974a7ea727feb27c0f60eb)
2019-06-27Merge "Fix ownership of ironic inspector DHCP hostsdir" into stable/steinZuul1-1/+2
2019-06-27Run nova api_db sync before db syncMark Goddard1-2/+2
Backport: Stein, Rocky Since cells v2 was introduced, nova operators must run two commands to migrate the database schemas of nova's databases - nova-manage api_db sync and nova-manage db sync. It is necessary to run them in this order, since the db sync may depend on schema changes made to the api database in the api_db sync. Executing the db sync first may fail, for example with the following seen in a Queens to Rocky upgrade: nova-manage db sync ERROR: Could not access cell0. Has the nova_api database been created? Has the nova_cell0 database been created? Has "nova-manage api_db sync" been run? Has "nova-manage cell_v2 map_cell0" been run? Is [api_database]/connection set in nova.conf? Is the cell0 database connection URL correct? Error: (pymysql.err.InternalError) (1054, u"Unknown column 'cell_mappings.disabled' in 'field list'") [SQL: u'SELECT cell_mappings.created_at AS cell_mappings_created_at, cell_mappings.updated_at AS cell_mappings_updated_at, cell_mappings.id AS cell_mappings_id, cell_mappings.uuid AS cell_mappings_uuid, cell_mappings.name AS cell_mappings_name, cell_mappings.transport_url AS cell_mappings_transport_url, cell_mappings.database_connection AS cell_mappings_database_connection, cell_mappings.disabled AS cell_mappings_disabled \nFROM cell_mappings \nWHERE cell_mappings.uuid = %(uuid_1)s \n LIMIT %(param_1)s'] [parameters: {u'uuid_1': '00000000-0000-0000-0000-000000000000', u'param_1': 1}] (Background on this error at: http://sqlalche.me/e/2j85) Despite this error, the command actually exits zero, so kolla does not notice the failure. This change reorders these two commands to run the api_db sync before the db sync. Change-Id: I0514c02aaee1a413a7979c3a426e0484df839861 Closes-Bug: #1832860 (cherry picked from commit 84a07102e2db92333ce416a520151f1a1856f162)
2019-06-27Merge "Add sha256 in ceph fetch keys" into stable/steinZuul1-0/+2
2019-06-27Merge "Use td-agent-gem to install fluentd monasca plugin on ubuntu" into ↵Zuul2-5/+6
stable/stein
2019-06-27Fix deployment of ceph-nfs container failing due to wrong USERRadosław Piliszek1-3/+0
The startup script requires to be run as root, not ceph. All other ceph images follow this rule. Also removed redundant blank line. Change-Id: I1d69ec0ca97dbbacccfe737fca03c9739244b900 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit dc879dff3bf5cea9d64469395fe140b2ac7e4a3d)
2019-06-26Move back to CentOS StorageSIG repos for Ceph and GaneshaGiulio Fidente2-30/+4
Recently a new repo was created in CentOS to distribute Ganesha, and the repo made a dependency of the Ceph Nautilus repo package [1] When centos-release-ceph-nautilus 1.2-1 will go out, it should not be necessary to disable the CentOS Ceph repos pulled in by dependency of the RDO repositories, as done in [2] 1. https://github.com/CentOS-Storage-SIG/centos-release-ceph/commit/f1a17c9d145cabfa1dfd3102fe7e2fc584f6a907 2. https://review.opendev.org/#/c/651601/ Change-Id: I6bf0cbfaffc22147c5bec03b5897719de53366ed (cherry picked from commit cf47864ab1e4fa6192ea96727d01b3e935b7a1fc)
2019-06-18Add sha256 in ceph fetch keysMichal Nasiadka1-0/+2
fetch_ceph_keys.py is using insecure sha1 function, this patch adds sha256 beside sha1 - in order to remove sha1 safely in U release. Change-Id: I32ba1abd204c9dba4bbe3132b5650b0e391616af Closes-Bug: #1826327 (cherry picked from commit 0a2dc8aa1d267da3c1c2925b3f292bd96aa50edb)
2019-06-18Fix ownership of ironic inspector DHCP hostsdirMark Goddard1-1/+2
If you run with enable_ironic set to true and ironic_inspector_pxe_filter set to dnsmasq (the default in stein), ironic inspector can fail with the following in the logs: Permission denied: u'/var/lib/ironic-inspector/dhcp-hostsdir/<MAC address>' A node must be registered with a port for this to happen. Weirdly this happens on centos/source, ubuntu/source, and ubuntu/binary, but not centos/binary. This change changes the ownership of /var/lib/ironic-inspector/dhcp-hostsdir to ironic-inspector user to make it writeable. Change-Id: I19447727f19dbd9c0a3e17d218b48ddc4c253587 Closes-Bug: #1832026 (cherry picked from commit 41bcd7b4961fd52066b79804fdce9f81cc129735)
2019-06-18Use td-agent-gem to install fluentd monasca plugin on ubuntuMark Goddard2-5/+6
If monasca is enabled on ubuntu, we see the following error in fluentd: [error]: config error file="/etc/td-agent/td-agent.conf" error_class=Fluent::ConfigError error="Unknown output plugin 'monasca'. Run 'gem search -rd fluent-plugin' to find plugins" This is because we use 'fluent-gem install' to install the gem, which works on CentOS but on Ubuntu it is necessary to use 'td-agent-gem install'. Change-Id: I515f9764ca93a41a871e520696193a9298856d08 Closes-Bug: #1830147 (cherry picked from commit c585ca5055c7a92fdbe5826030d3529e5c397540)
2019-06-18Merge "Debian/Ubuntu: more python3 packages for binary" into stable/steinZuul29-86/+94
2019-06-18Merge "Bump service versions for Stein" into stable/steinZuul1-8/+8
2019-06-17Merge "[neutron] Do not migrate all subprojects" into stable/steinZuul1-1/+1
2019-06-16[neutron] Do not migrate all subprojectsJason1-1/+1
Instead of migrating all Neutron subprojects at bootstrap time, target specifically the neutron, neutron-fwaas, and neutron-vpnaas subprojects speficially. If a subproject is not specified, all subprojects are migrated, which is not the intended behavior. Change-Id: Icb8d572b7f084804e0423a8a3171dd66646b3885 (cherry picked from commit f36d7aacf28bc75a4b0ece73b45aa09591cd262c)
2019-06-14Fix issues with Percona in Zuul and clean up a little bitRadosław Piliszek8-99/+17
Percona site has connectivity issues from OVH hosts (of Zuul). This patch makes it so that: - the internal repo is actually used - RPM GPG keys are downloaded from the actually used repo - Ubuntu mimics the RHEL behavior (i.e. the Percona repo is enabled only in the xtrabackup image) extra benefit: no need for APT preferences for Percona repo to spare MariaDB deps Change-Id: Id27831f6b404762f9e44fd6bd1c4702bf06b05f8 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit de58339a0e1704ae1ade4e032a73bb4708ecfaf1)
2019-06-14Debian/Ubuntu: allow to use unsigned repositoriesMarcin Juszkiewicz1-6/+8
When we run Debian 'buster' or Ubuntu 18.04 in CI job they refuse to work as infra mirror is not signed. This patch instructs APT to use unsigned repos anyway. Change-Id: I530fde5b57894afda2de98d7c217e735497e3feb (cherry picked from commit 5859180c2c78c62defca37446722b5f15fdbefb7)
2019-06-14Fix lower-constraints test fail due to failing dep buildRadosław Piliszek3-3/+3
Ubuntu Bionic updated OpenSSL package to new release: from 1.1.0 to 1.1.1 It caused cryptography in version from lower-constraints to fail to build in Zuul. Additionally, constrained cryptography version did not match the requirement for constrained PyOpenSSL. This commit bumps the version to the minimum required by constrained PyOpenSSL. It works because manylinux1 (binary) wheel exists. This version agrees also with upper-constraints for Queens. Dependency on cryptography is removed as it is not used directly by kolla (and requirements checker requires lower-constraints matching version - let's not create an illusion of usage). For stable/stein additionally fix version of sphinx to pass CI. Change-Id: I8ae19f212049cae5dfb4e8dd6ec6cd14a8c46e0e Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> (cherry picked from commit 39a2cf066c4c79436629017155302d36243aa338)
2019-06-09Merge "Bump Monasca Fluentd plugin version" into stable/steinZuul1-1/+1
2019-06-07Bump service versions for SteinMark Goddard1-8/+8
Change-Id: Ibe4fbc7857996361229c15fa5670906bd81660cb
2019-06-07Debian/Ubuntu: more python3 packages for binaryMark Goddard29-86/+94
backport: Stein During the switch to Stein UCA, we did not switch all packages to python 3 for Debian/Ubuntu binary images. This change switches some more of those packages. Change-Id: I0bff21384d88ea678608392de2db1ba418c96665 Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> (cherry picked from commit aa59f0db6f88ed0a03169b473fdf6d541d34df9f)
2019-06-06Switch to RDO Stein release on CentOS & OracleMark Goddard3-8/+14
This change switches from the Delorean yum repositories to the RDO Stein release repository. centos-release-openstack-stein pulls in centos-release-ceph-nautilus, which conflicts with upstream ceph packages. Disable the CentOS Ceph repo to work around this. Change-Id: I1df5dd28adc65ff461a893b60c57d7b5da96d653
2019-06-06Ceph: Update to Nautilus on CentOS and OracleLinuxMark Goddard5-9/+51
The CentOS Stein OpenStack distribution depends on the Ceph Nautilus release, while Kolla currently deploys Luminous on CentOS. This change switches CentOS and OracleLinux builds to use Ceph Nautilus. Support for auth UID has been removed in the Nautilus release [1][2], so we have removed the --set-uid argument from calls to ceph-authtool. Also ceph-osd bootstrap mode fails when no mon config is provided, so we added --no-mon-config (mon config is injected later after bootstrap). Due to ceph-nfs build issues (ceph upstream nfs-ganesha rpms relied on older version of userspace-rcu, than CentOS Storage SIG packages) we need to move to ceph upstream rpm repos. [1] https://github.com/ceph/ceph/commit/d6def8ba1126209f8dcb40e296977dc2b09a376e [2] http://docs.ceph.com/docs/master/releases/nautilus/ Co-Authored-By: Michal Nasiadka <michal.nasiadka@nokia.com> Change-Id: I000398f587c5f4d6cc8995e34e162eebc77bc3e3 Implements: blueprint centos-ceph-nautilus (cherry picked from commit e0cae62c4aab001fa7b5cc324f178793f4e88f3c)
2019-05-31Merge "Fix multiple mon deployment failures" into stable/steinZuul1-1/+11
2019-05-31Merge "Add CI trigger for ceph jobs" into stable/steinZuul3-0/+6
2019-05-25Install iputils package in neutron containersSlawek Kaplonski1-0/+2
This package provides e.g. arping tool which is used by Neutron services. On e.g. RHEL7 it was probably installed as some dependency to other package but on RHEL8 it's missing which cause some errors e.g. in neutron_l3_agent container. Change-Id: I9c087164f32cb8a69d2155bc68b6f62233ad58c6 Related-Bug: https://bugzilla.redhat.com/show_bug.cgi?id=1713321 (cherry picked from commit 68b998f27efb252a73b0ee4e496d4a3ce32206e2)
2019-05-24Merge "Improve doc of kolla-build '--docker-dir' option" into stable/steinZuul1-1/+2