summaryrefslogtreecommitdiff
path: root/docker/openstack-base/Dockerfile.j2
AgeCommit message (Collapse)AuthorFilesLines
2022-03-02Remove missing collectd packagesMichal Nasiadka1-1/+0
Since CentOS Linux 8 repository retirement from CentOS mirrors - we need to use CentOS Stream 8 version of Opstools repo. Listed below packages are missing from the repo, and according to the maintainer dpdk_telemetry is not going to show up at all (it's basically dead). The rest of the packages might show up at a later stage - but it's not a priority for the maintainer. - collectd-dpdk_telemetry - collectd-libpod-stats - collectd-sensubility - python3-sqlalchemy-collectd Change-Id: I5f446fc276e245c1e6974ceeb6ff3dccd84ee502 (cherry picked from commit 405fca90f2c8d3763ac56ce8b925611d136bba6c)
2022-01-26CI: make it work againMarcin Juszkiewicz1-1/+5
Python changes: - limit pip to 20.x as this is last version working on both Python 2 and 3. - cap 'setuptools' to be older than 58 to have use_2to3 functionality (fixes 'anyjson' installation) - upgrade pip in 'elasticsearch-curator' image to get it built on CentOS 7 Unbuildable images: - 'bifrost-base' under CentOS 8 (Error: Cannot find a valid baseurl for repo: epel) - 'monasca-grafana' under CentOS 7/8 - 'sensu-client' under CentOS 7 (aws-eventstream requires Ruby version >= 2.3) - dropped *-upgrade CI jobs as Stein is EOL - pin 'qpid-proton-c' package for CentOS 7 to not install EPEL one (cinder-volume, openstack-base and tripleoclient) - bump 'libvirt-python' in 'masakari-monitors' to 7.10.0 (newer branches install package from distribution but CentOS 7 lacks it) - pin 'unf_ext' gem in Sensu images as CentOS 7 lacks Ruby 2.2+ (fixed sensu-server) - install 'ca-certificates' for newer Let's Encrypt certificates support (so we can fetch upper-constraints) - make Zuul fetch openstack/requirements project files (make 'openstack-base' pass) (like 2nd fix) Co-Authored-by: Pierre Riteau <pierre@stackhpc.com> Closes-Bug: #1943617 Depends-On: https://review.opendev.org/c/openstack/kolla-ansible/+/826464 Change-Id: I8ee32e53cda581493b2a4bb73ca72ab05014b9d4
2021-01-24Improve pip install process for offline deployment.Gaël THEROND (Fl1nt)1-5/+1
* "Use distribution-provided pip" * "Use python's pip module invocation method" * "Install pip earlier in order to avoid multiple installation" * "Remove pip_version variable requirement and call" (cherry picked from commit b93c40a3635fbce72e48dc29120e50484cba36ca) - fixed source type builds. - in openstack-base: install virtualenv using upper-constraints (just like in kolla-toolbox) Co-authored-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org> Co-authored-by: Radosław Piliszek <radoslaw.piliszek@gmail.com> Depends-on: https://review.opendev.org/c/openstack/kolla-ansible/+/772198 Closes-bug: #1893204 Change-Id: Id0e738044a1931f9d611a7281a48ea4a593f1cf1
2020-09-03Revert "openstack-base: pin setuptools < 46 to get horizon working"Radosław Piliszek1-5/+0
This reverts commit ca8b61516401d61d90e2940fa130c8f55a8b6e45. This is to fix recent breakage caused by setuptools and virtualenv incompatibilities. Includes bifrost version bump to fix its building. Change-Id: Ia6c415b18374cefa3f160229d1f58cb209df348e Closes-Bug: #1893920 Depends-On: https://review.opendev.org/749576
2020-05-17switch to official CentOS 8 repositoriesMarcin Juszkiewicz1-1/+0
RDO builds of stable/train for CentOS 8 went into phase when we do not need to use delorean builds. EPEL is disabled like it is in Ussuri (RDO packages may conflict with it). Erlang for RabbitMQ is used from CentOS 8 'rabbitmq-38' repo while RabbitMQ is still 3.7.* from same place as usual. 'python3-pika' is dropped from openstack-base as it is EPEL only package and is not used by any image (dropped in Ussuri in https://review.opendev.org/#/c/710003/ patch) AArch64 is not supported until CentOS 8.2 release. Change-Id: I9d3ed54f4d10ef7ad2d52ed3aeca15f3968cd163
2020-03-18Fix Horizon build after switch to pyscss2 which lacks binary wheelRadosław Piliszek1-0/+2
It now requires pcre-dev package to finish building. Change-Id: I4e003c9aa32579d467c489a53741e20ced2f4b52 Closes-bug: #1867888
2020-03-12openstack-base: pin setuptools < 46 to get horizon workingMarcin Juszkiewicz1-0/+5
pyScss used by Horizon fails to work with setuptools > 46 version. It's last release was in 2016 so probably no one fix it. Let make sure that we get older version of setuptools. Broken due to https://bugs.launchpad.net/kolla/+bug/1866961 Change-Id: I2a3fa657a3e1a9b8b0acb0b50bd4f3e98078f4ff
2020-02-26CentOS 8: base and openstack-base imagesMark Goddard1-2/+9
Adds support to the base and openstack-base images for CentOS 8. These images have been removed from the list of unbuildable images, and replaced with all dependent images. This change also includes backports of a number of other changes related to the base image: * CentOS 8: disable repo_gpgcheck for grafana image (Ice120e8001fd9e8bb37ca4f2df26259cf798ee0e) * CentOS 8: base image fixes for RabbitMQ, fluentd & InfluxDB (Ibbb720390ff17e11249a5aa77163c15c0971209a) Change-Id: I18fba8a5c2f99b700990cbf41c76077a1ec2408a Partially-Implements: blueprint centos-rhel-8 (cherry picked from commit 3c618a1f6f0beca723e031fbe323b159400ad08f)
2019-12-05Install etcd3gw to fix Ubuntu binary tooz coordination9.0.0.0rc29.0.0Radosław Piliszek1-0/+1
Change-Id: Ib56e62d1fb4d0fc4a6c627b87a929be0bc614d1e Closes-bug: #1852086 (cherry picked from commit 0186c5e3cafeae0bb1c39bdef0df6ade827552d5)
2019-10-04Revert "Adding python*-pyngus package to openstack base"Mark Goddard1-2/+0
This partially reverts commit 73f9b5e47c7cab658ef75ac3dcdc2f006ebc7557. It was fixed in RDO on the packaging side: https://review.rdoproject.org/r/#/c/22745/ Ubuntu packages do not have a dependency on python3-pyngus, so that package has been left in place. Change-Id: Iea8fd1ac30400c67f76aec6d37ee7614f9c51770
2019-09-27Adding python*-pyngus package to openstack baseArx Cruz1-0/+3
This package is required by amqp on RHEL job scenario003 Change-Id: I7370c371c9f3f458e7f2b363d4341fbfbfe4fe89
2019-07-01Add python-sqlalchemy-collectd clientMike Bayer1-0/+2
sqlalchemy-collectd was added in I2bcaa44c184bb24e5caeeb8d204dda627de59c91, however it also must be installed alongside anywhere that python-sqlalchemy is installed since it provides an in-process plugin that transmits metrics to a remote collectd daemon. Also adds the python3 version of the package to the py3 version of the collecd/Dockerfile.j2. Note this is currently an *RPM only* package, and as of this commit is not yet availble for other packaging systems. Change-Id: If598da717653a383a2d3b3373c56517f8bca832f
2019-06-17openstack-base: add several popular python modulesMarcin Juszkiewicz1-0/+10
During building of all source images there are Python modules repeating in several targets. bcrypt: bifrost, ceilometer, cinder, dragonflow, freezer, keystone, manila, mistral, neutron, nova, rally, sahara, tacker, tempest, vmtp logutils: aodh, barbican, blazar, ceilometer, cloudkitty, designate, dragonflow, gnocchi, heat, ironic, kuryr, magnum, mistral, neutron, octavia, panko, qinling, solum, tacker, tempest, vitrage, watcher, zun pecan: aodh, barbican, blazar, ceilometer, cloudkitty, designate, dragonflow, gnocchi, heat, ironic, kuryr, magnum, mistral, neutron, octavia, panko, qinling, solum, tacker, tempest, vitrage, watcher, zun psutil: ceilometer, cinder, designate, dragonflow, freezer, heat, ironic, magnum, manila, mistral, monasca-agent, murano, neutron, nova, octavia, panko, searchlight, senlin, tacker, vitrage, watcher, zaqar, zun pymongo: almanach, aodh, freezer, horizon, monasca-agent, neutron-server-opendaylight, panko, vmtp, zaqar pyroute2: dragonflow, kuryr, mistral, neutron, nova, octavia, tacker setproctitle: aodh, ceilometer, cloudkitty, dragonflow, gnocchi, heat, kuryr, neutron, octavia, qinling, tacker, tempest, vitrage, zun simplegeneric: aodh, blazar, ceilometer, cloudkitty, glance, ironic, magnum, mistral, octavia, panko, qinling, searchlight, solum, watcher PyNaCl: bifrost, ceilometer, cinder, dragonflow, freezer, manila, mistral, neutron, nova, rally sahara, tacker, tempest, vmtp WSME: aodh, blazar, ceilometer, cloudkitty, glance, ironic, magnum, mistral, octavia, panko, qinling, searchlight, solum, watcher Change-Id: I3990254258289fae8fbaf505de0f8cdede435111
2019-06-07Merge "Debian/Ubuntu: more python3 packages for binary"Zuul1-31/+31
2019-06-06Debian/Ubuntu: more python3 packages for binaryMark Goddard1-31/+31
backport: Stein During the switch to Stein UCA, we did not switch all packages to python 3 for Debian/Ubuntu binary images. This change switches some more of those packages. Change-Id: I0bff21384d88ea678608392de2db1ba418c96665 Co-Authored-By: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
2019-06-06Debian/Ubuntu: move to Python 3 for source imagesMarcin Juszkiewicz1-3/+3
Commit 43b74ccc157c0b50138c3785ed91dab504895571 enabled use of Python 3 based packages but not switched to use Python 3. Some of images still contain Python 2. There are two reasons: - Ceph (ceph-common depends on Py2) - python3-ldappool on Ubuntu 18.04 In Ceph situation Py3 packages were added. For second one we can not do anything - Py2 dependency got dropped in Ubuntu 18.10 version. Removed neutron-server-plugin-networking-infoblox due to being not maintained. Once https://review.opendev.org/#/c/657578/ get merged someone may revert that part. Implements: blueprint debian-ubuntu-python3 Depends-on: Ie2a1077f7def0743f1403341985e2109aa490026 Change-Id: Ibfe0c2b8be98db56c61f74fb0247488ab3749ef4
2019-04-10Install "procps(-ng)" in the base imageCédric Jeanneret1-1/+0
Providing tools like "ps", "pgrep" and related is interesting since it helps debugging a container in some cases. It is also useful for healthchecks in case we want to fetch running service PID and use it in another command, like "lsof". Change-Id: I91b1c407caa6b03ae522e649592300f9eddfc07e
2019-03-21Move top package installed in every *-base container to openstack-baseJon Schlueter1-0/+2
- python*-oslo-upgradecheck was being installed in a number of different *-base containers that I checked Change-Id: Iddd8a191e5523ec048dff324993abadcfc020132
2019-03-20Merge "Do not explictly specify mysql related RPMS"Zuul1-2/+0
2019-03-15Merge "Move to Debian 'buster'"Zuul1-1/+1
2019-03-14Move to Debian 'buster'Marcin Juszkiewicz1-1/+1
Buster is at freeze phase so safe to update and use. Will give us Python 3 based OpenStack packages (usually release delayed). Change-Id: I48c2d252a834716f1bcf10b18f2d32fe541e8137
2019-03-13Do not explictly specify mysql related RPMSJon Schlueter1-2/+0
These should be pulled in via oslo-db or other rpms that use them. Change-Id: Ie048053b23f02d324552a72aabbef96671eb37c1
2019-03-13Drop tcp_wrappers package requirementBernard Cafarelli1-2/+1
Originally added in [1] when improving the base image, nothing appears to require this package currently. Also, this legacy package is not maintained and has been dropped from Fedora (and upcoming RHEL 8) [2] [1] https://review.openstack.org/#/c/295048/ [2] https://fedoraproject.org//wiki/Changes/Deprecate_TCP_wrappers Change-Id: I2983932898f877da2e31a5a968f6c91e5a9d760b
2019-03-12Add python3 packages for RHEL systemsAlex Schultz1-4/+87
RDO is currently working on python3 support for the next version of CentOS/RHEL based systems. This package uses the distro_python3 flag that was added as part of I4028991bad92c0e8e21066cc4173c06ce5eba393 to use the python3 specific package names. This change only adds python3 package names for RHEL systems. Conflicts-With: https://review.openstack.org/#/c/636457/ Change-Id: Iad6b70b433a0dd1b0f8ae6790fd280594517661a Related-Blueprint: python3-support
2019-03-12replace 'distro_python3' variable with 'distro_python_version'Marcin Juszkiewicz1-2/+8
RHEL7 derived distros use Python 2.7 RHEL8 uses Python 3.6 Ubuntu 18.04 uses Python 3.6, but we haven't enabled it yet. Debian:buster uses Python 3.7, but we haven't enabled it yet. We have several places in code where "/lib/pythonX.Y/site-packages" is used so we need to know value of X.Y rather than py2/py3 switch. How to check for Python 2: {% if distro_python_version == '2.7' %} Breaks: Iad6b70b433a0dd1b0f8ae6790fd280594517661a Change-Id: Ie24f109af19ae0438c21e0d43cb3cc947812b4ce
2019-03-12Merge "Introduce 'get_pip' macro"Zuul1-3/+1
2019-03-11Introduce 'get_pip' macroMarcin Juszkiewicz1-3/+1
We have code for it in four places so it is a good candidate for macro. Change-Id: Icadcbbe5b386bdf688fd67e8160b40974f047377
2019-03-11Drop python2-pika_pool rpmJon Schlueter1-1/+0
As a follow up to I7204aab66a252e0fdc3c0eebf5232903340a7e5d also drop the rpm for pika_pool Change-Id: I3db311cfa5310d26b672b17928cdbd72ea655f8b
2019-03-08openstack-base: drop pika-poolMarcin Juszkiewicz1-1/+0
Last release of pika-pool was in 2015 and targetted pika 0.10 release: INFO:kolla.common.utils.openstack-base:pika-pool 0.1.3 has requirement pika<0.11,>=0.9, but you'll have pika 0.13.0 which is incompatible. None of our images requires pika-pool (tested by dropping it and then building all images). Change-Id: I7204aab66a252e0fdc3c0eebf5232903340a7e5d
2019-02-28drop some of the xll related packagesJon Schlueter1-12/+0
these are containers, we should not have X11 display libraries installed in base containers. If they are being pulled in via packages those chains of dependencies should be looked at closely and pruned as they have no real use on container images. Change-Id: I19000564445254ba4d168f24deef6a901391d2e2
2019-02-25Merge "Simplify package list from openstack-base image"Zuul1-48/+0
2019-02-22Merge "debian/ubuntu: drop mysql compat stuff, unify on openssl 1.1"Zuul1-22/+2
2019-02-21Simplify package list from openstack-base imageMartin André1-48/+0
Remove the packages that are already pulled implicitly as a dependency. A shorter package list should make it more manageable. Change-Id: I690de645436065eee298a455221be8a6a0ae8083
2019-02-20pypi package msgpack-python is deprecated, drop explicit installJon Schlueter1-2/+0
according to https://pypi.org/project/msgpack-python/ it's deprecated and should use msgpack. and this is supported by looking at a build source container image and noting that pip lists msgpack 0.6.0 msgpack-python 0.5.6 also msgpack is pulled in via dependency of oslo.serialization We should be able to rely on it coming in via that dependency automaticly Change-Id: Id2706b3b38e57daf1166f98a59dc3ecd30fd4fa7
2019-02-19debian/ubuntu: drop mysql compat stuff, unify on openssl 1.1Marcin Juszkiewicz1-22/+2
Now with Ubuntu 'bionic' being used we can drop libmysqlclient-compat-dev package use and just go with mariadb packages directly. Also move to OpenSSL 1.1 for both distributions. Change-Id: I147385a3da15878121c0a436b5c26ba100e9802d
2019-02-01Drop python2-crypto as not needed in openstack-baseJon Schlueter1-1/+0
pycrypto has mostly replaced by python2-cryptography In patch I77b5210cd6e63aa3b01aa2b5b3372dd50009b9ad the source entries were all flipped to prefer cryptography instead of pycrypto, let's drop python2-crypto and let any remaining packages that do need it pull it in explicitly Change-Id: Ie0f426fbe396ed9b5a3b86406c64e12e87dd81a7
2019-01-31Merge "remove python-beaker from openstack-base rpm list"Zuul1-1/+0
2019-01-29remove python-beaker from openstack-base rpm listJon Schlueter1-1/+0
this package is a WSGI helper for caching, not in openstack requirements, and only referenced in refstack and airship. If it's used by any packages that I missed it should be implicitly installed where used/needed instead of in openstack-base and not used Change-Id: Iafd6678846e7c495cc96a6d3a7681d70a4bf8171
2019-01-29remove test dependencies from openstack-baseJon Schlueter1-4/+0
these containers should not need unittest support packages in general, tempest may need one of these but that should be installed as needed not for all container images. - testtools - introduced in - unittest2 - introduced in Ia3a9756c58f0ead3b20e435f1d1546408f4a8b36 - zake - introduced in Ie05ba975bc2f88cd9ee896aafc60171d6ca8d10b - fixtures - introduced in Ia3a9756c58f0ead3b20e435f1d1546408f4a8b36 Change-Id: Ic2325afc6ce3ee9f8a8c03ad19050809255df2f5
2019-01-17Use base_package_typeAlex Schultz1-4/+4
This change updates the docker files to use base_package_type instead of doing specific distro checks for the rhel/deb generic cases. The base_distro is still available and is used when a specific distro needs a customization but if the differences are purely rpm vs deb, then the base_package_type can be used. Change-Id: I8d720bb185df65a0178061ccf20b1ab2265da2c5
2018-12-11Required changes for mariadb 10.3Eduardo Gonzalez1-1/+1
Mysql-python is a deprecated package and fails to build currently. Make use of mysqlclient as is a fork of mysql-python with many bug fixes a python3 support. percona xtrabackup doenst work with mariadb 10.3, replaces to use mariadb-backup tool. https://jira.mariadb.org/browse/MDEV-15774 Change-Id: Icefe3a77fb12d57c869521000d458e3f58435374
2018-07-12Add more shared libs to base imageMartin André1-0/+8
These are some of the obvious candidates that were installed 10 times or more in the different images. Change-Id: I3ca2a3855689ffa64aef7ee46e58dc4b0dac77d3
2018-07-10Stop using deprecated rpm package namesMartin André1-24/+24
These packages produce a warning during the installation, we should switch to their new names, usually to be specific about their use of python2. Change-Id: I0a80e822f64222d9a32aabd1fd834bcf794d6320
2018-06-25Remove git and pip from centos binary openstack-base package listJon Schlueter1-2/+0
Change-Id: I4e8624f403bd59327ba81cba01f098e6d4d82060 Closes-bug: #1778528
2018-06-20Use RDO version of python-msgpack on RDOSteven Dake1-1/+1
python2-msgpack is python2 only, is from EPEL, and is ancient. Use a propery tested and validated version of msgpack. Closes-Bug: #1704894 Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net> Change-Id: I3b33f7a9ad48e2a06ede1f79426231d720b851ae
2018-04-26Merge "Collapse down multiple yum install in openstack-base"Zuul1-10/+6
2018-04-25Collapse down multiple yum install in openstack-baseJon Schlueter1-10/+6
For rhel/centos/oraclelinux there were 2 yum install sections, collapse/folded the 3 packages from that section into the other blocks in sorted order Change-Id: I8a3d212314891635509aeeb346998ace713feefa
2018-04-24Clean python requirements from base imageAlfredo Moralejo1-3/+0
openstack-base image includes a list of dependencies to be installed in the image. However some of the packages in this list seems not to be used by any or very few OpenStack services according to the info found in codesearch. This patch removes some python packages from this list as we are in the process of cleaning dependencies in RDO. Change-Id: I209b16cfd7dff6ce20bc2417a6079fb8597f6774 Closes-Bug: #1766493
2018-01-30openstack-base: provide Postgresql headers for source buildsMarcin Juszkiewicz1-0/+1
Change-Id: I3c766faac2aeb50071ca2c4c3ed01da35fcacbd0
2018-01-23Merge "Consume RDO packaged mariadb version"Zuul1-19/+1
generated by cgit v1.2.3 (git 2.39.1) at 2026-11-05 21:04:25 +0000