summaryrefslogtreecommitdiff
path: root/tools
AgeCommit message (Collapse)AuthorFilesLines
2017-07-16Merge "Add bandit check to all python code"Jenkins1-3/+3
2017-07-13Merge "Remove ignore tempest project in version-check"Jenkins1-2/+1
2017-07-10Remove ignore tempest project in version-checkEduardo Gonzalez1-2/+1
Tempest is present in openstack/releases project Change-Id: Ib4c48108ecfe9eb9e3276ed039af083438385837 Closes-Bug: #1703395
2017-07-10Fix gnocchi in version_check scriptEduardo Gonzalez1-0/+1
Gnocchi is moved out of openstack/releases project. Version-check need to be updated with gnocchi in skipped projects. Closes-Bug: #1703386 Change-Id: I2b37aeb7042756be534559615878e698275783c6
2017-07-06Add bandit check to all python codeEduardo Gonzalez1-3/+3
Bandit was not running in all directories due missing -r parameter. Also, this change fix bandit errors. * Add nosec to subprocess module * Change /tmp/releases to .releases * Change /tmp/ to tmp/, tmp/ is not checked and in unittest is not an issue, simpler that mocking tempfile and make more complex tests. Change-Id: I42bafa4707a9a4d1faeb01cb9b5a843f56280deb
2017-07-06Merge "Migrate cinder-api under apache"Jenkins1-0/+5
2017-07-04Migrate cinder-api under apacheEduardo Gonzalez1-0/+5
Cinder-api in ubuntu binary was migrated under apache because ubuntu packages removed support to system services. This change migrate other install_types under apache to unify all types. Change-Id: Iad6792142019134513a378a7ad9955888ef320e9
2017-06-30Merge "Upgrade from docker-py to docker"Jenkins1-1/+1
2017-06-22Merge "Get OpenStack service versions from openstack/releases repo"Jenkins1-109/+124
2017-06-21Upgrade from docker-py to dockerHongbin Lu1-1/+1
The pypi package 'docker-py' [1] has been renamed to 'docker' [2]. It is better to move to the new 'docker' package because the old package will be deprecated and all the new features will go into the new package only. Package 'docker' has been added to requirements [3]. The old package 'docker-py' is still allowed to be in the global requirements during the transition period but it should be removed after all or most of the projects finsih the migration. [1] https://pypi.python.org/pypi/docker-py [2] https://pypi.python.org/pypi/docker [3] https://review.openstack.org/#/c/423715/ Change-Id: I3ffd8bb6461e8b7edacc5e833754f00c4249b854
2017-06-21Fix deploy gateMichal (inc0) Jastrzebski1-1/+1
Enabling multiscenario gates broken deployment gates in Kolla. Sorry:( Change-Id: I46e6cea62555145d8e9d6962e9bb0f036077a305
2017-06-08Fix kolla deploy gatesMichal (inc0) Jastrzebski1-1/+12
Since we changed kolla-ansible gating, we need to change logic in kolla too Change-Id: Ie9196d01b9ce1ca0199cd657cecd4ca33a1f050e
2017-05-20Get OpenStack service versions from openstack/releases repoJeffrey Zhang1-109/+124
In old implementation, version-check always get the latest versions rather than versions for certain release. it is useless for stable branch. And it parses from tarballs.openstack.org site, which is very slow. In this new implementation, version-check gets versions from openstack/releases repo, which is faster and accurate. It also support get versions for certain OpenStack release. For example, get the Ocata latest release version. ./verion-check.py --openstack-release ocata Closes-Bug: #1554337 Change-Id: Ie8951625817d82f38cf820cf9bd44ae447e2eb75
2017-05-01Add ssh-keyscan to unblock kolla gateEduardo Gonzalez1-3/+6
As a change to remove puppet from infra nodepool, ssh-keyscan is needed for each node [0] Permissions to ssh/config file should be 600 instead of current 664 [1] Refs: [0] http://lists.openstack.org/pipermail/openstack-dev/2017-April/116036.html [1] http://logs.openstack.org/68/461368/1/check/gate-kolla-ansible-dsvm-deploy-centos-binary-centos-7-nv/0a94da7/console.html#_2017-05-01_12_06_08_440775 Closes-Bug: #1687408 Change-Id: I338e457fff35d8a28bd9f96e88dbb4ee55a47864
2017-04-20Use LABEL instead of MAINTAINER (deprecated) in all Dockerfile.j2Chen1-1/+1
Use LABEL instruction instead of MAINTAINER (deprecated) instruc- tion as suggested by Docker's official dockerfile guide. docs.docker.com/engine/reference/builder/#maintainer-deprecated Closes-Bug: #1683652 Change-Id: Ie87a1ddf31aefcd0b623fd2837d78de420e76898
2017-04-12Merge "Switch to RDO proxy mirrors"Jenkins1-6/+7
2017-04-11Merge "Get correct tag name when job is running in release pipeline"Jenkins1-2/+8
2017-04-10Switch to RDO proxy mirrorsMohammed Naser1-6/+7
We download a large number of packages from trunk.rdoproject.org, the OpenStack Infra team has setup a per-region caching proxy to speed up builds and reduce reliance on the internet. This patch switches builds to use the new mirror and also stops defining our own mirror variables and rely on the one provided by nodepool instead. As part of this patch, we also drop getting the delorean.repo file from buildlogs.centos.org as it could be out of sync and essentially broken (until the job to sync runs). We prefer going to trunk.rdoproject.org as it will be proxied and cached. Change-Id: Ia28225de715089bbf5b023d1e134f2fb7da93fbd
2017-03-30Merge "Update Docker to 1.13.1"Jenkins2-2/+5
2017-03-22Gate fixes: disable bifrost-base, fix ubuntu base imageMohammed Naser1-0/+1
At the moment, Bifrost has caused a few failures which have blocked the gate, the latest of which is documented in the bug listed below (alongside with another one that caused another gate failure). In order to let patches flow though, we're disabling it from the gate build checks as agreed on the Kolla meeting on the 22nd of March 2017. Also, the Ubuntu base image seems to have a missing /etc/protocols which is created by the netbase package. This has been added to the base images. There are issues with subunit getting a very large log all at once which causes failures that is causing issues. We also enable logging to a local folder which will make troubleshooting image builds easier to read and avoid sending a large blob of data to subunit. Change-Id: Iee1f8b06ec1066015ea5c6a6a245723402e35a6a Related-Bug: #1674483 Related-Bug: #1673776 Closes-Bug: #1675101
2017-03-20Get correct tag name when job is running in release pipelineJeffrey Zhang1-2/+8
It is different to get the branch name and tag name in post and release pipeline. With this patch, we can push tag registry tarballs. Change-Id: Ifd1a3fe3da5548c340947946c27649a3059eb8b0
2017-03-18Remove global privilege escalation for deploy_aio.shMohammed Naser1-1/+1
At the moment, deploy_aio.sh is called with sudo which results in the environment being wiped. This means that all Zuul environment variables are removed and therefore when zuul-cloner runs to checkout the branch of kolla-ansible, it will always fallback to master as ZUUL_BRANCH is unset. This patch removes the global usage of sudo in the tox.ini file as there is existing usage of sudo in the bash script itself. This will mean that we will only escalate privileges when needed rather for the whole script and the environment variables should be passed on properly resulting in the matching release of kolla-ansible being checked out. Closes-Bug: #1673756 Change-Id: I477a843e696be7136c020be6408afea01967879d
2017-03-15Update Docker to 1.13.1Mohammed Naser2-2/+5
There were a few issues blocking Kolla from going up to the latest version of Docker which is 1.13. Most of these issues seem to have been addressed by 1.13.1. This patch updates the version installed by Kolla to 1.13.1 for the testing infrastructure to prevent the following bug which is causing gate failures: https://github.com/docker/docker/issues/28336 Change-Id: I0d3569b589ee792c9aa6eaa7c539219fcc784271
2017-02-14Merge "Using CI mirror host"Jenkins1-29/+57
2017-02-08Fix pushing images to local registrySayantani Goswami1-1/+0
Adding -e REGISTRY_PROXY_REMOTEURL=https://registry-1.docker.io to the docker run command in the start-registry script configures the local registry as a pull through cache. However, pushing of images to the local registry fails. Pushing to a registry configured as a pull-through cache is unsupported. For more information, reference the proxy section in Docker Documentation (https://docs.docker.com/registry/configuration/) Corresponding change to the documentation has been made to the multinode.rst file in the Kolla-ansible repository https://review.openstack.org/#/c/426858/ Change-Id: I636912f9958490bf751bfa0f449998c61d273241 Closes-Bug: #1659738
2017-02-07Using CI mirror hostJeffrey Zhang1-29/+57
Depends-On: Ib83ed5e437ca868f0e42ce740ad1125d2fa48ff4 Change-Id: I9af17fac07b88badb5db498a940db9356e2e202f Partially-Implements: blueprint mirrors
2017-01-31Revert "Removed percona from ubuntu repos"Sam Yaple1-0/+1
This reverts commit af7a1da8076f7a253795c2a431b3eeec4cd348d7. Co-Authored-By: Michal (inc0) Jastrzebski <inc007@gmail.com> Change-Id: I81df3bf01f618dbc7f771ee2e188eaa562ffe9db Closes-Bug: #1659981
2017-01-23Fix spelling mistake in setup_Debian.shYao Lu1-1/+1
TrivialFix Change-Id: I4782a64dc1ad97c089d1ceb8b43a06bca37c662f Signed-off-by: Yao Lu <lu.yao135@zte.com.cn>
2017-01-20Fix the gate failureJeffrey Zhang3-9/+7
* Push images all the time * Pin docker-engine version Change-Id: Ie778f719655c1136e563ede9e494b37817e247fa
2017-01-18Merge "Remove custom images"Jenkins1-3/+7
2017-01-17Remove Ansible and Globals.yml in diag scriptzhuzeyu1-7/+0
Ansible and Globals.yml have moved into kolla-ansible repo. TrivialFix Change-Id: Ie14af3659bf64cc04554ae1d1a74e86656802e0a
2017-01-16Remove custom imagesEduardo Gonzalez1-3/+7
Allow remove custom images with a regex Change-Id: I7f8bbd59509f543150e58165575ad7b530dc38ba
2017-01-13Use ZUUL_REFNAME to get branch info during pack registryJeffrey Zhang1-1/+2
1. ZUUL_REFNAME is used in post and release pipeline. 2. change the tarball name to <base_distro>-<install_type>-registry-<branch>.tar.gz it is usefull in tag pipeline. we will get name like: centos-source-registry-4.0.0.tar.gz Change-Id: I23b16983d02a5758cb251bed8b026ced992559fe
2017-01-11Merge "Configure local registries to proxy docker hub"Jenkins1-0/+1
2017-01-06Merge "Remove kolla-genpwd from setup.cfg"Jenkins3-148/+0
2017-01-06Configure local registries to proxy docker hubMatt McEuen1-0/+1
Added the REGISTRY_PROXY_REMOTEURL parameter to the registry creation script, so that the registry will mirror images from Docker Hub (while still being able to host custom-built images). Updated the Multinode guide to reflect this. Change-Id: Ib789241fd2947b06fb0dc5732a0bf28431e1403d Closes-Bug: #1647436
2017-01-06Merge "packing and uploading registry"Jenkins2-0/+19
2017-01-05Remove kolla-genpwd from setup.cfgPaul Bourke3-148/+0
This is now in kolla-ansible Co-Authored-By: caoyuan <cao.yuan@99cloud.net> Change-Id: I787a8ba7053f55480125dda64737466300bf7357
2017-01-03Merge "Clean up kolla-ansible related files from Kolla"Jenkins3-3/+4
2017-01-02packing and uploading registryMichal (inc0) Jastrzebski2-0/+19
Partially-Implements: blueprint pack-registry Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net> Change-Id: I6816c6d3fc2f4224553f8a22e2ebb87e8616db37
2016-12-29Clean up kolla-ansible related files from KollaSayantani Goswami3-3/+4
- Remove globals.yml and passwords.yml files. - The gate was still using these files from the kolla directory. Modified the gate to prevent using these files from the kolla directory. - Modified the deploy_aio.sh file to populate passwords in passwords.yml using kolla-ansible. Change-Id: I1ed7849d54cab6d5a9217dced73327ea13f06636 Closes-Bug: #1653035
2016-12-28Merge "Removed percona from ubuntu repos"Jenkins1-1/+0
2016-12-23Run sudo with -H parameter to set the proper home dirJeffrey Zhang1-1/+1
Change-Id: Ib273f50bd7fb889e0025f58c11dd89f39ca8e4ca Closes-Bug: #1652112
2016-12-20Removed percona from ubuntu reposSam Yaple1-1/+0
16.04 provides the percona-xtrabackup scripts in the main repos, so the specific percona repo can be removed. Unfortunately, mariadb10.0 does not build with galera built-in. So until ubuntu packages mariadb10.1, we will be dependant on the external repos for mariadb with galera built in. Labels keys so they are easily identified in the future. In Jinja2 the comments cannot go inline while generating the list. Change-Id: I5e6c2f884c8d59bbc574b71ac731d1b4db18b68c
2016-12-20Fix syntax issue in gate_run.sh scriptJeffrey Zhang1-1/+1
Change-Id: I98005ea6ac1457d89ef6636cf772155d7a7034d9 Closes-Bug: #1651388
2016-12-19Merge "Collect logs at the end of gate"Jenkins1-0/+77
2016-12-19Switch Ubuntu to overlay2 docker driverSam Yaple1-3/+4
With 4.4 kernel we can use the improved overlay2 driver instead of btrfs for significantly better performance when creating layers. Change-Id: I3b0dfd6db5298dfb34ec160eed910ca76feeb423
2016-12-16Collect logs at the end of gateJeffrey Zhang1-0/+77
Collecting more logs will be helpful for use to debug the gate. Closes-Bug: #1650552 Change-Id: I5e243c4e5075215cbed57b65655c99f2ddcadaaf
2016-12-08Fix dir specs typo errorjeckxie1-1/+1
Change-Id: I9426b176a0d7af452c569590b771e4661b4652a2
2016-12-05Add run_gate.sh script for CIJeffrey Zhang1-0/+4
Use single unified gate script will be helpful to works after the jobs is done. Change-Id: Ic0bbeef4b431132b4f992a696dc5e83c43821b91 Closes-Bug: #1647379