diff options
| author | Michael Still <mikal@stillhq.com> | 2026-08-14 06:22:22 +1000 |
|---|---|---|
| committer | Michal Nasiadka <mnasiadka@gmail.com> | 2026-08-19 14:40:16 +0000 |
| commit | 762181ae4918e3e261df06ed983a1ef1cb61b10c (patch) | |
| tree | 33c3f9be23ba766fb124cee90ea10984d31fe1fc /releasenotes/notes/nova-scheduler-healthcheck-retries-12e681b16f6322aa.yaml | |
| parent | fe4f6adaf01e93af39cd28d3ad57d45b1db11884 (diff) | |
| download | kolla-ansible-762181ae4918e3e261df06ed983a1ef1cb61b10c.tar.gz kolla-ansible-762181ae4918e3e261df06ed983a1ef1cb61b10c.zip | |
Extend the nova_scheduler healthcheck timeout.
Nova changed in 2026.1 how long their services take to gracefully
shutdown.
The default value of [DEFAULT]/graceful_shutdown_timeout has been
changed from 60 to 180 seconds for all Nova services. [...]
Operators using external system (e.g. k8s, systemd) to manage the
Nova services should ensure that their service stop timeouts are
set to at least graceful_shutdown_timeout to avoid forcefully
killing service before Nova finish its graceful shutdown.
Kolla-Ansible failed to update the period of time that ansible waits
for Nova services to shut down. This causes both CI failures and
failures for deployers when trying to manage some Nova containers.
Prompt: Michael asked for assistance debugging why CI jobs were
failing with nova-scheduler timeouts.
Assisted-By: Claude Opus 5 (1M context, high effort) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5 (1M context, high effort) <noreply@anthropic.com>
Closes-Bug: #2162860
Change-Id: If7c5a6d885b19e39cfc305440424f10de3a5ea05
Signed-off-by: Michael Still <mikal@stillhq.com>
(cherry picked from commit 4ce86ef1db631c15e6e5e142d2908f73348377d4)
Diffstat (limited to 'releasenotes/notes/nova-scheduler-healthcheck-retries-12e681b16f6322aa.yaml')
| -rw-r--r-- | releasenotes/notes/nova-scheduler-healthcheck-retries-12e681b16f6322aa.yaml | 13 |
1 files changed, 13 insertions, 0 deletions
diff --git a/releasenotes/notes/nova-scheduler-healthcheck-retries-12e681b16f6322aa.yaml b/releasenotes/notes/nova-scheduler-healthcheck-retries-12e681b16f6322aa.yaml new file mode 100644 index 000000000..2cf4e2e8c --- /dev/null +++ b/releasenotes/notes/nova-scheduler-healthcheck-retries-12e681b16f6322aa.yaml @@ -0,0 +1,13 @@ +--- +fixes: + - | + The ``nova_scheduler`` container healthcheck asserts an established AMQP + connection, but every deploy and every reconfigure signals the scheduler + to restart its workers and they take + ``[DEFAULT]/manager_shutdown_timeout`` (160 seconds by default) to come + back. The default 30 second interval with 3 retries only covers 90 + seconds of that, so the container could be reported unhealthy for the + rest of the restart even though the scheduler was fine. + ``nova_scheduler_healthcheck_retries`` now defaults to 8, which covers + the whole window, and is documented in the sample ``globals.yml``. + `LP#2162860 <https://bugs.launchpad.net/kolla/+bug/2162860>`__ |