This is a big one, I’ll try to include the essential information needed.
OpenStack Instance Creation Problem
Setup
- Fresh OpenStack Yoga deployed using Kolla-Ansible on 4 servers Proxmox cluster
- OVS
- OPNsense VM for routing and firewall
- Two main networks (both through OPNsense):
- vlan-interne (10.0.1.0/24): Internal OpenStack network (ens18 on the servers)
- vlan-externe (10.1.1.0/24): External OpenStack network (ens19 on the servers, without ip)
- Multinode: 3 Controller, 4 Compute, 3 Network, 3 Storage, and 1 Monitoring nodes
Problem
Unable to create instances in OpenStack. Error message:
“Error waiting for instance to become ready: unexpected state ‘ERROR’, wanted target ‘ACTIVE'”
Nova Compute Logs
The Nova compute logs show the following error:
<code>Traceback (most recent call last):
File "/var/lib/kolla/venv/lib/python3.9/site-packages/eventlet/hubs/poll.py", line 111, in wait
listener.cb(fileno)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/eventlet/greenthread.py", line 221, in main
result = function(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/utils.py", line 656, in context_wrapper
return func(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 1895, in _allocate_network_async
raise e
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 1873, in _allocate_network_async
nwinfo = self.network_api.allocate_for_instance(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1217, in allocate_for_instance
created_port_ids = self._update_ports_for_instance(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1359, in _update_ports_for_instance
vif.destroy()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__
self.force_reraise()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
raise self.value
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1328, in _update_ports_for_instance
updated_port = self._update_port(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 586, in _update_port
_ensure_no_port_binding_failure(port)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 295, in _ensure_no_port_binding_failure
raise exception.PortBindingFailed(port_id=port['id'])
nova.exception.PortBindingFailed: Binding failed for port 59ab1ad8-4352-4d58-88b4-f8fb3d741f0d, please check neutron logs for more information.
</code>
<code>Traceback (most recent call last):
File "/var/lib/kolla/venv/lib/python3.9/site-packages/eventlet/hubs/poll.py", line 111, in wait
listener.cb(fileno)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/eventlet/greenthread.py", line 221, in main
result = function(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/utils.py", line 656, in context_wrapper
return func(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 1895, in _allocate_network_async
raise e
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 1873, in _allocate_network_async
nwinfo = self.network_api.allocate_for_instance(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1217, in allocate_for_instance
created_port_ids = self._update_ports_for_instance(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1359, in _update_ports_for_instance
vif.destroy()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__
self.force_reraise()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
raise self.value
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1328, in _update_ports_for_instance
updated_port = self._update_port(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 586, in _update_port
_ensure_no_port_binding_failure(port)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 295, in _ensure_no_port_binding_failure
raise exception.PortBindingFailed(port_id=port['id'])
nova.exception.PortBindingFailed: Binding failed for port 59ab1ad8-4352-4d58-88b4-f8fb3d741f0d, please check neutron logs for more information.
</code>
Traceback (most recent call last):
File "/var/lib/kolla/venv/lib/python3.9/site-packages/eventlet/hubs/poll.py", line 111, in wait
listener.cb(fileno)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/eventlet/greenthread.py", line 221, in main
result = function(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/utils.py", line 656, in context_wrapper
return func(*args, **kwargs)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 1895, in _allocate_network_async
raise e
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/compute/manager.py", line 1873, in _allocate_network_async
nwinfo = self.network_api.allocate_for_instance(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1217, in allocate_for_instance
created_port_ids = self._update_ports_for_instance(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1359, in _update_ports_for_instance
vif.destroy()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__
self.force_reraise()
File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
raise self.value
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 1328, in _update_ports_for_instance
updated_port = self._update_port(
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 586, in _update_port
_ensure_no_port_binding_failure(port)
File "/var/lib/kolla/venv/lib/python3.9/site-packages/nova/network/neutron.py", line 295, in _ensure_no_port_binding_failure
raise exception.PortBindingFailed(port_id=port['id'])
nova.exception.PortBindingFailed: Binding failed for port 59ab1ad8-4352-4d58-88b4-f8fb3d741f0d, please check neutron logs for more information.
Current Status
- The error suggests a port binding failure during instance creation.
- Neutron logs do not show any errors at all.
- All the services and containers are running without issue
Troubleshooting Steps Taken
- Verified network and Kolla-Ansible configuration
- Checked Nova compute logs
- Reviewed OPNsense firewall rules
- Completely redployed OpenStack from 0
Any insights or suggestions on resolving this port binding issue would be greatly appreciated.