aboutsummaryrefslogtreecommitdiff
path: root/docker/ceph
AgeCommit message (Collapse)AuthorFilesLines
2020-02-14Remove kolla Ceph container imagesMichal Nasiadka12-479/+0
This change removes ceph* Dockerfiles and relevant kolla python code bits. Kolla-Ansible part has been removed, and K-A was the only consumer. Change-Id: I9568261fdbbe4b9156d0e07c414ec911ca2e8557
2019-11-29Enable repos only when neededMarcin Juszkiewicz1-0/+2
Disable external repositories by default and enable only when needed. Depends-on: https://review.opendev.org/696480 Implements: blueprint repos-off-by-default Change-Id: Icf2a8397a8349e0fe849d88d160409fd234480a9
2019-10-18Merge "Fix fetch_ceph_keys to run in python3"Zuul1-1/+1
2019-10-17Fix fetch_ceph_keys to run in python3Michal Nasiadka1-1/+1
Quick fix to convert bytes object to string, that can be serialized by JSON. Change-Id: I7d3db8e43eccc06aaf21e84990317133fa515a1f
2019-10-14Add disk dev name check functionEddie Yen1-39/+20
This patch will add new function in extend_start.sh for OSD creation. Not only support loop device but also others that disk dev layout is end with numbers. Change-Id: Iee5f8b8581d70166de6eba1bdc9e42766fe8cb48 Closes-Bug: #1847014
2019-08-01ceph mds cap 'allow *' in extend_startRadosław Piliszek1-1/+1
This applies the fix made in kolla-ansible (see [1]) to kolla ceph mon image directly. [1] https://review.opendev.org/670035 Change-Id: I1822a8c610db72654bbacc7148e25a837090b680 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-07-10Add partition detection to fix osd initialization failurewangwei1-1/+29
The changes in the following commit did not completely solve the problem of osd initialization failure: https://review.opendev.org/652612 In order to solve this problem, the partprobe command consistent with ceph-disk is added, and then a loop is added to detect the partition, which is acquired every 1s. When the partition appears, the osd initialization is continued. Change-Id: I0ca255c6358132d9e3acfa6b610b70a78756512c Closes-bug: #1824787
2019-06-28Fixes ceph-osd deploys with loop devices.Dincer Celik1-1/+6
Change-Id: I98405e3fb32cbec2d9863817a913ed71c5597e15 Closes-Bug: #1834678
2019-06-19Fix deployment of ceph-nfs container failing due to wrong USERRadosław Piliszek1-3/+0
The startup script requires to be run as root, not ceph. All other ceph images follow this rule. Also removed redundant blank line. Change-Id: I1d69ec0ca97dbbacccfe737fca03c9739244b900 Signed-off-by: Radosław Piliszek <radoslaw.piliszek@gmail.com>
2019-06-18Merge "Add sha256 in ceph fetch keys"Zuul1-0/+2
2019-06-18Add sha256 in ceph fetch keysMichal Nasiadka1-0/+2
fetch_ceph_keys.py is using insecure sha1 function, this patch adds sha256 beside sha1 - in order to remove sha1 safely in U release. Change-Id: I32ba1abd204c9dba4bbe3132b5650b0e391616af Closes-Bug: #1826327
2019-05-31Ceph: Update to Nautilus on CentOS and OracleLinuxMark Goddard3-5/+25
The CentOS Stein OpenStack distribution depends on the Ceph Nautilus release, while Kolla currently deploys Luminous on CentOS. This change switches CentOS and OracleLinux builds to use Ceph Nautilus. Support for auth UID has been removed in the Nautilus release [1][2], so we have removed the --set-uid argument from calls to ceph-authtool. Also ceph-osd bootstrap mode fails when no mon config is provided, so we added --no-mon-config (mon config is injected later after bootstrap). Due to ceph-nfs build issues (ceph upstream nfs-ganesha rpms relied on older version of userspace-rcu, than CentOS Storage SIG packages) we need to move to ceph upstream rpm repos. [1] https://github.com/ceph/ceph/commit/d6def8ba1126209f8dcb40e296977dc2b09a376e [2] http://docs.ceph.com/docs/master/releases/nautilus/ Co-Authored-By: Michal Nasiadka <michal.nasiadka@nokia.com> Change-Id: I000398f587c5f4d6cc8995e34e162eebc77bc3e3 Implements: blueprint centos-ceph-nautilus
2019-05-22Merge "Fix multiple mon deployment failures"Zuul1-1/+11
2019-04-18Fix multiple mon deployment failureswangwei1-1/+11
When 4 or 5 mons are deployed, all mons will always be in the election state, and the ceph cluster cannot be accessed. After comparing with ceph-deploy, I found that when the cluster was initialized, it did not use monmap. When adding a new mon node, it needs to use monmap. According to the above situation, I fixed the problem. Change-Id: Idbfc6741d371adcb06ed97d578d75d3bce862743 Closes-bug: #1824783
2019-04-15Fix the problem of osd initialization failedwangwei1-0/+1
When deploying osd, if the user does not use the extra block partition, the kolla will automatically partition the disk and then clean up the data on the disk partition. Sometimes the disk partition will not be updated, there will be an error not finding the partition. This commit fixes the problem. Change-Id: I14708f38614dcb75268c2f460ae3d921748c2d10 Closes-bug: #1824787
2019-03-27Fix the problem that the crush map is changedwangwei1-2/+6
When deploying ceph osd with kolla, each osd deployment will move the host bucket to default in the crush map. If we adjust the crush map, we have to re-adjust the crush map after adding osd or fixing osd. This commit fixes this problem. Change-Id: Ifdc3a1fd5fe37da529b2aee9811b12f744cff3bf Closes-bug: #1821681
2019-01-17Use base_package_typeAlex Schultz2-4/+4
This change updates the docker files to use base_package_type instead of doing specific distro checks for the rhel/deb generic cases. The base_distro is still available and is used when a specific distro needs a customization but if the differences are purely rpm vs deb, then the base_package_type can be used. Change-Id: I8d720bb185df65a0178061ccf20b1ab2265da2c5
2018-10-23ceph-base/dind: switch to btrfs-progs packageMarcin Juszkiewicz1-1/+1
Starting with 4.4.1 release btrfs-tools were renamed to btrfs-progs so *-tools package became transitional one. Next stable Debian release will not have 'btrfs-tools' package at all. Change-Id: I188eaad233c1dbdbfd1c115e02b0e1c66e307c20
2018-10-10ceph-nfs: Debian got nfs-ganesha in backports - use themMarcin Juszkiewicz1-1/+1
Change-Id: Idf3c07384848eb54bca4595e50034bf980a7f77c
2018-09-27ceph: stick to luminous on Ubuntu (in proper way)Marcin Juszkiewicz1-16/+3
Previous attempt broke Debian builds. Pinning Ceph packages instead of giving version during install. Change-Id: I791e479ba265ba61ffd882da18f85cdbece67e55
2018-09-21Fix ceph version in ubuntuwangwei1-2/+16
The ceph version supported by kolla is now luminous, but the latest ceph version of ubuntu's apt source is mimic, so there will be problems with ceph deployment. This patch solves this problem by specifying the version of the ceph package installed. Change-Id: Ibea3498589b6c3c1512e558919c6ea00c95686cb Closes-bug: #1793667
2018-08-27Fix bluestore disk naming format in kollawangwei1-8/+8
The current bluestore disk label naming is inconsistent with the filestore. The filestore naming format is that the disk prefixes belonging to the same osd are the same and the suffixes are different. This patch keeps the bluestore's disk naming as well. Change-Id: I090cf055ebedc555b5ada35e140b7a7bb2a4cf8f
2018-06-20Allow Kolla Ceph to deploy bluestore OSD with 4 partitionstone.zhang1-20/+53
Enhance the deployment of Kolla-Ceph bluestore OSD. Deploy bluestore OSD including up to 4 partitions: * one partition is for bluestore OSD information * one partition is for bluestore block * one partition is for bluestore block.wal * one partition is for bluestore block.db Deploy bluestore OSD deployment with LOOP devices. Partially-Implements: blueprint kolla-ceph-bluestore Change-Id: I00eaa600a5e9ad4c1ebca2eeb523bca3d7a25128 Signed-off-by: tone.zhang <tone.zhang@arm.com>
2018-06-07Allow Kolla Ceph to deploy bluestore OSDs in KollaTone Zhang1-21/+89
Support Kolla Ceph to deploy blustore OSDs. With the patch, Kolla Ceph can deploy bluestore OSDs on ONE, TWO or THREE storage devices. Before deploy bluestore OSD, please prepare devices. The detailed Please refer to [1] for devices initialization. extend_start.sh: initialize and start bluestore OSD find_disk.py: search the devices for bluestore OSD [1]: specs/kolla-ceph-bluestore.rst Partially-Implements: blueprint kolla-ceph-bluestore Change-Id: I832f490de63e1aeb68814697cda610a51b622c1f Signed-off-by: Tone Zhang <tone.zhang@arm.com>
2018-05-26Bump Ubuntu base image to 18.04Jeffrey Zhang1-4/+2
Ubuntu 18.04 has been released. We need upgrade to it this cycle. Changes made in this patch - Bump ubuntu repo from xenial to bionic. Some repos do not have bionic packages, so still using xenial repos. - Drop mariadb, percona and nfs-ganesha repo, because these packages are already provided by Ubuntu official repo. - Since qdrouterd does not have bionic repo and xenial packages does not work on Ubuntu bionic, just add it into ignore image list. - Use python-rtslib-fb and targetcli-fb rather than python-rtslib and targetcli - use xen-utils package name rather than with package version one. - Seems unsigned repo won't work on Ubuntu bionic, stop using infra mirrored unsigned repo in gate building job. Needed-By: https://review.openstack.org/568728 Implement blueprint: ubuntu-bionic Change-Id: I4e3b0ca669cfbf6316bf591f2d8428fa1a0d6182
2018-02-22Add cap mgr 'allow *' for ceph admin keyJeffrey Zhang1-1/+1
Some ceph cluster commands require this caps Change-Id: Idfa19667f1fb83f2cb89712c594513188d859359 Closes-Bug: #1750967
2018-01-19Add ceph-nfs containercaowei1-0/+30
Change-Id: I06325d4601128a0b5a2235370fa44012427c29e3 Implements: blueprint ceph-nfs-container
2017-12-05Bump to ceph luminousJeffrey Zhang1-0/+7
Add ceph-mgr images Change-Id: I875f84012a92d4f8b9dcb212d917cf61167270b8 Implements: blueprint ceph-luminous
2017-05-03Override image's meta info.Jawon Choo6-6/+6
centos based images have wrong label info, these changes fix own image's name and build-date. Change-Id: I1d13f8f386c8db12b5fbe5f8ecbbf9e3fbb4ba1c Closes-Bug: #1680341
2017-04-24ceph: take care of ceph-fuse package availabilityMarcin Juszkiewicz1-2/+16
'ceph-fuse' package is not available for all architectures. In Debian/Ubuntu 'ceph-fuse' package is built only for x86_64 architecture. CentOS lacks 'ppc64le' package. Partially-Implements: blueprint multiarch-and-arm64-containers Change-Id: I06cea15166bee77dca7b418e85d3a4080892068e
2017-04-20Use LABEL instead of MAINTAINER (deprecated) in all Dockerfile.j2Chen6-6/+6
Use LABEL instruction instead of MAINTAINER (deprecated) instruc- tion as suggested by Docker's official dockerfile guide. docs.docker.com/engine/reference/builder/#maintainer-deprecated Closes-Bug: #1683652 Change-Id: Ie87a1ddf31aefcd0b623fd2837d78de420e76898
2017-04-04debian: enable all images enabled for UbuntuMarcin Juszkiewicz1-1/+1
Debian support is not maintained in Kolla so it got a bit behind Ubuntu one. This changeset enables Debian for all images. Jessie (even with backports) may be too old for some images though. Also unify distro check to ['debian', 'ubuntu'] to keep alphabetical order like it is done for RPM distributions. Partially-Implements: blueprint multiarch-and-arm64-containers Change-Id: I056233fbfa277e0e2360c07c3f80d9558c554357
2017-03-28Alphabetize packagesEduardo Gonzalez1-9/+9
Some images have packages sorted alphabetically and some not. Unify common style between all images. Change-Id: I906ed89c10b12886665618752f525ba71d83d991
2017-02-05Remove include_header and include_footer in all DockerfilesJeffrey Zhang3-3/+0
include_header and include_footer parameter is already removed, remove them in all Dockerfiles. Add missing footer block. Change-Id: I90da03eb9f95a3827361d5f5ede65fde7d6be2b3
2017-01-23Add ceph fs containersKevin Fox3-0/+20
This PS adds containers for cephfs support. Including the ceph-mds and fuse cephfs filesystem. Change-Id: Ie270d6bbe08b608cfdba1bc378e9624f7fb3e791
2017-01-17use static uid/gid in imagesSam Yaple1-2/+3
This centralizes all user and group creation into a single source. This will fix any current and furture uid/gid mismatches (such as with nova-libvirt). In the process, we also unify users between the distros in a standard way. The users in the following containers change from thier defaults: Ubuntu: _chrony user is now chrony Ubuntu: memcache user is now memcached All: qemu user is used for ownership and socket permissions All uid and gid numbers are customizable via kolla-build.conf Co-Authored-By: Kris Lindgren <klindgren@godaddy.com> Change-Id: I120f26ab0683dc87d69727c3df8d4707e52a4543 Partially-Implements: blueprint static-uid-gid
2017-01-05Remove footer block and variable in *-base imagesJeffrey Zhang1-2/+0
Change-Id: I39aa88489f744f779150695f3f55ef80d42e1c61 Closes-Bug: #1653247
2016-11-03Remove Fedora supportChristian Berendt1-1/+1
Closes-bug: #1616387 Change-Id: Id97f88b9baa3d48d33ce120962450a374282d044
2016-09-22Install the required packages for ceph-base imageJeffrey Zhang1-2/+6
Ceph need use mkfs.ext4, mkfs.btrfs and mkfs.xfs command. Closes-Bug: #1626601 Change-Id: Ifbf8805afd7388335bbb51075ff76182f3d201b3
2016-09-22Fix permission for /var/log/kolla folderJeffrey Zhang1-1/+2
Docker will change the name volume folder permission to image already set. /var/log/kolla is not created and well configured in image. This patch set creates and configures proper permission /var/log/kolla in base image. This patch set also fixed the ceph image by adding ceph user to kolla group. TrivialFix Change-Id: Ib5ef0187e90de2699b3cda31e819b4babb07e0af
2016-09-13Add header blocks to all DockerfilesPaul Bourke4-0/+9
Change needed to add header blocks to all Dockerfiles, similar to the base. Use case is to easily run something before packages are installed, e.g. to COPY a local rpm in that can be added to the package list. Change-Id: I1bbfdf0b762da0a392aa8bf47781315b45377bee Closes-Bug: 1618969
2016-09-09Change ceph version to JewelMichal (inc0) Jastrzebski1-4/+0
This patch changes version of ceph from hammer to jewel. Also removed versionlock as it seems we don't use it in ubuntu, and actually might be risky if we miss security patch on ceph. Change-Id: Ib8f88c2f914a4b635e59a509fa0194605eb73165 Implements: blueprint upgrade-ceph-to-jewel
2016-08-19Handle empty package list for install_packagesShaun Smekel1-1/+1
Currently if the install_packages macro is run with an empty package list, it will add a yum or apt-get command with no packages listed. This bug fix aims to omit this line when no packages have been given, or, the operator wants to use the "_override" / "_remove" functionality to disable all packages being installed in a Dockerfile. Co-Authored-By: Paul Bourke <paul.bourke@oracle.com> Change-Id: Ifaaaebfccc3adb0f2f68a35ac08e59378bc87fdb Closes-bug: 1612446
2016-08-08Customizations for CephEduardo Gonzalez4-18/+26
This patchset contains customization of Dockerfile of Ceph containers Change-Id: I20bc27f2c4c6025ea35c8b48c40aee9919553254 Partially-implements: blueprint third-party-plugin-support Signed-off-by: Eduardo Gonzalez <dabarren@gmail.com>
2016-06-29Use the disk size as the osd weight when osd_initial_weight is autoJeffrey Zhang1-0/+4
In most of case, the disks used by ceph have different size. Use the default value 1 may block the ceph when one disk is full. Use the disk size as osd weight will more reasonally. TrivialFix Change-Id: Ib875c7289188cbb9380355baf0c8048f1eb09332
2016-05-26Update ubuntu dockerfiles for formattingSwapnil Kulkarni (coolsvap)1-1/+1
Change-Id: If4be00b937e14ec93443dcb7249cf17099d57cbe Closes-Bug: #1569417
2016-05-05Make Heka collect Ceph logsMauricio Lima4-0/+25
Change-Id: Ibaa5f8ba600afafa111d2ef204ee9192b8babdfc Closes-Bug: #1570529
2016-03-19Allow external ceph journals and fix bootstrapSamYaple1-20/+17
This allows us to specify external journals for osds which can greatly improve performance when the external journals are on the solid-state drives. The new lookup and startup methods fix the previous races we had preventing osds from being created properly. This retains the same functionality as before and is completely compatible with the previous method and labels, however this does set new labels for all new bootstrap OSDs. This was due to a limitation in the length of the name of a GPT partition. Closes-Bug: #1558853 DocImpact Partially-Implements: blueprint ceph-improvements Change-Id: I61fd10cb35c67dabc53bd82270f26909ef51fc38
2016-03-19Allow user to choose filesystem for osdSamYaple2-1/+10
Change-Id: I9c770a08219d2eead5ece8e3462157359cd920cb Partially-Implements: blueprint ceph-improvements
2016-03-09Remove storage_hostnameSamYaple1-3/+3
This was an attempt to get storage_interface to work properly but that work will not be completed and functional this cycle. There are design topics that need to be discussed about it that were brought to light by the RAX gate failing for it. TrivialFix Change-Id: I65579f9e0e0dcf3fa51c0ea031ff474145457c40
generated by cgit v1.2.3 (git 2.39.1) at 2026-11-05 20:29:56 +0000