Frequently Asked Questions

Solution

Volume Snapshot Deletion Fail After Upgrade

Glance: Failed to Upload Image Data Due to HTTP Error

Instance Actions/Events Missing

Unable to Manage Libvirtd Process With Systemctl

Instance Booted via UEFI Unable to be Deleted

Keypair Not Recognized When Deploying Instances

Block Storage Metrics Not Displayed in Clarity UI

Instance in Stopped State Post-Creation

Changing Management of Volumes in a Shared Storage Backend

Unable to Deauthorize Hypervisor (Instances Still Exist)

Instance(s) Fail to Delete When Host is Down/Offline

Unable to Open VNC Console: "Malformed request URL (400)

Instance Cannot Contact Metadata Service (Ubuntu 16.04)

Snapshot Image Shows as Missing

Host Being Scheduled Erroneously

Image Uploaded with ".filepart" Extension

Nova API Calls Limited to 5000 Results

Unable to Authenticate With OpenStack CLI

Murano Environment Stuck in "Deleting" Status

Libvirt Service Fails to Start With Error "Cannot Read CA Certificate

VMware Gateway Appliance(VGA) in Failed State as pf9-monasca-vcenter-exporter Service Fails to Start

Unable to Deauthorize Host - Package(s) Fail to be Erased (Apt)

pf9-ostackhost Service Fails to Connect to Libvirt

Hostagent Fails to Install Packages During Host Upgrade

Instance Missing on Hypervisor

Live Migration Fails With Error: "Unacceptable CPU Info: CPU Doesn't Have Compatibility.

Healthy Instance With OS-EXT-STS:fault Populated

Remote Error: IpAddressGenerationFailure No More IP Addresses Available on Network

Unable to Attach Floating IP to Instance: "External Network Not Reachable from Subnet

Consul Service Cannot Start: "bind_addr cannot be empty

Boot From Volume Instance Fails to Spawn: "Block Device Mapping is Invalid

OVSDB Error: Writing Transaction Failed: /etc/openvswitch/conf.db: Cannot Truncate: Permission Denied

No Valid Host From Host Aggregates Resulted in Instance Spawning Failure

Unable to Assign Fixed IP While Creating Port

Instances Lose External Connectivity After Detaching Floating IP

Unable to Start pf9-ostackhost Service

Unable to Extend a Volume

Host(s) Unable to Connect to Management Plane With "Error: getaddrinfo ENOTFOUND

Instance in ERROR State, Write Lock on Disk File

Image File Copied to Glance Host, Image Not Discovered

Instance Creation Fails With Error 'Unexpected Build failure Not Rescheduling Build'

Libvirt Randomly Crashes on Ubuntu 16.04, "Error in `/usr/sbin/libvirtd': malloc(): memory corruption:"

pf9-ostackhost Service Failing With Error: "Connection to libvirt failed"

Instance Creation Failing: "Could not open backing file"

No Connectivity to Docker Containers Within Instance

Unable to Reach Floating IP: "Destination Host Unreachable"

Unable to Start Libvirtd Service

Instance Unable to be Deleted, Stuck in Spawning/Build State

Unable to Boot Instance: "Please enter passphrase for disk Linux filesystem

Libvirt Socket Binding Failed/Unable to Acquire PID File

Instance Unexpectedly Not Found

IP Address Not Allocated To Instance by DHCP

Neutron DHCP Agent Fails to Start dnsmasq: "dnsmasq: bad command line options

Live Migration Fails Due to RPC Timeout

Used Old Installer to Authorize Host "Error Authorizing Host. Please Contact Support

OpenStack Volume Deletion Fails

Live Migration Fails With Error: "Migration pre-check error: CPU doesn't have compatibility. internal error: Unknown CPU feature ssbd.

Live Migration Fails With Error: "Too many open files

VMHA Indicator Does Not Appear in UI For All AZs

Degraded Instance Connectivity: "nf_conntrack: table full, dropping packet

Host Unable to Converge With Management Plane

Unable to Communicate With Instance

Instances Fail to Create: "sudo: sorry, you are not allowed to set the following environment variables: LD_LIBRARY_PATH, PYTHONPATH

Can I Live Migrate an Instance Across Availability Zones?

Floating IP Associated With VLAN-Based Provider Network is Inaccessible

Unable to Start pf9-neutron-ovs-agent Service

Instance Fails to Live-Migrate: "No valid host was found

Ostackhost Fails to Resize, Create and Migrate Instance with Error "ComputeHostNotFound

Filesystem Doesn't Reflect Instance Resize (Ephemeral)

Host Evacuate Deleted disk Files and Rebuilt VMs

Nova-Compute (ostackhost) Fails to Create Resource Provider: "Conflicting resource provider name: <host> already exists."

Hidden File(s) or Directories Discovered by Image Library

Outbound Connectivity Failing for Instances on Tenant Network

Glance Image Create Fails With Error "Request Entity Too Large

Instance Reboot Failure as Libvirt Failed to Terminate qemu-kvm Zombie Process

OpenStack Commands Fail With "Expecting to Find Domain in User

Glance Selects Wrong Endpoint

Live-Migration of Instance With Config Drive Fails

Instance(s) Stuck in "MIGRATING" State After Abort Migration Action

Platform9 Neutron Repository not Found

Instance Fails to Reach or Resolve External Addresses

BFV Instance Fails to Migrate: "Driver initialize connection failed (error: PureHTTPError status code 400)

Cinder Services Down After Host Upgrade

Enabling Non-zero Value for "live_migration_progress_timeout" in Nova Results Live Migration Failure

Unable to Create Volume From Image

Failed to Setup Container for group 57: No available IOMMU Models

Live Migration Failed, Multipathd Service Not Running on Destination Host

Unable to Delete Volume From HPE 3PAR With Error "VolumeIsBusy: resource in use

Glance Image Not Discovered in OpenStack

Unable to Migrate Instance as Image Used to Create Instance is Deleted

Unable To Start pf9-ostackhost Service After python-gssapi Module Installation

All Volume Snapshots Not Listed in UI

Unable To Set Password For Registered Account Using "Set Password" Link Received on Email-ID

Unable to Edit Volume With Error "No volume was found with this ID

Instance Resize/Migration Failure due to low Disk Space

All Instances Created in Batch are Scheduled on Single Hypervisor

Host Intermittently Fails to Converge.

Error Creating Tenant Network: "Unable to create the network. No tenant network is available for allocation.

Unable to Attach a Volume With Error "libvirtError: XML error: invalid secret uuid

Unable To Assign Static IP Address To Instances Created Using Heat Templates

Volume is smaller than the minimum size specified in image metadata.

'br-int' Packet Loss Observed

How To Set Custom VM Lease Using CLI

Unable to start pf9-neutron-ovs-agent on the Node

Instance Stuck in Migrating State

Unable To Download Images, Glance Commands Return "Image [UUID ] Has No Data

Unable to Create Image from a Cinder Volume or a Volume Snapshot

Console Access Request For Instances Is Getting Redirected To Different Instance

Incorrect DNS IP Entry for Instance (Designate)

Slow or Failed Live Migrations for Large Volume Backed Instances

Starting PF9-Ostackhost Results in Error: "sudo: Password expired, contact your system administrator

OpenStack Console log is Empty

Windows Disks go Offline After Reboot

Unable to Force Delete Volume Snapshot

Live Migration Failure With Error "Unable to find security driver for model apparmor"

Wrong Gateway IP Specified for External Neutron Network

Live Migration Fails With Error "Failed to connect to remote libvirt URI

Instance Failing to Boot, Entering Emergency Mode: "Timed out waiting for device"

Adding Host Using Pf9-express Fails

Hosts With pf9-glance Role Failing To Converge With Error "inconsistent use of tabs and spaces in indentation

User ID Displayed Instead of User Name For SSO Users

Cinder Volume Stuck in Migrating State

Instances Enter a Paused State on the Hypervisor

Creating Instances from Newly Added Image Fail with Error ‘Corrupt Image Download’

Unable to Create Image From Instance

Instance Unreachable After Attaching Second Neutron Port

Resize or Migrate Operations Failing With HTTP 409 Error "Service is unavailable at this time"

Unable to Start Instance With Error "Cannot allocate memory"

Unable to Remove Fixed IP Address

Instance Fails to Start/Power On: "blockdev: cannot open /dev/XXX: No such device or address"

Neutron Open vSwitch Version Negotiation Failed

Outbound Network Connectivity Failing for Instances Connected to a Virtual Router

Block Storage Host Reports "Unable to locate Target IQN"

Volume Attachment and Detachment Fails With Error "Flushing test_lv--test_vg failed: oslo_concurrency.processutils.ProcessExecutionError: [Errno 2] No such file or directory: 'multipath'"

High Load on the Ceph Cluster Being Used for Cinder

Ubuntu Instance Console Stuck on "Booting from hard disk"

Migrations Failing After Host Reprovisioned

OpenStack Server List Command Takes a Long Time to Execute

Missing Static Routes on Router After Neutron L3 Agent Restart

Large OpenStack Volumes Taking too Long to Delete

Emulated Trusted Platform Module (vTPM) Device Missing from Instance

Unable to add Hypervisors to an Empty Aggregate

Instance Failed To Start When Multipath Volume is Attached

Failed To Create ISCSI Target For Cinder Volume

Instance Task State Stuck in Deleting

Host Upgrade Fails with Error "pf9-cindervolume-lvm:get_config failed: 'lvm-backend'"

Can't Create Stacks, 'Request Limit Exceeded'

Instance Failing to Initialize Networking (Unable to Receive DHCP Response)

Unable to Snapshot Instance: "Image <path>/disk is unacceptable: Unable to convert image to qcow2"

Unable to Snapshot Instance: "Image <path>/disk is unacceptable: Unable to convert image to qcow2"

Image Library Host is Failed: "Failed to start: pf9-glance-api"

Image Library Host is Failed: "Failed to start: pf9-glance-api"

VM Fails to Start with 'Volume device not found at' Error

How to Authenticate Ceph Using Libvirtd Secrets

Instance Unreachable on Separate Hypervisor – Stale Flow (OVS/VLAN)

Forcefully Delete Cinder Volume of Non-existing Cinder Hosts.

Accessing Instance Console Fails From Primary Region

Hostagent Fails to Communicate With the Management Plane due to Wrong Credentials

Stack Stuck in "Delete-In-Progress" State

Unable to Create VM Instance

RHEL 9.x VMs Are Stuck Booting With Kernel Panic

VM resize fails with error "Invalid volume: Volume <volume_id> status must be available or do wnloading to reserve, but the current status is attaching"

Image getting deleted when copied into the glance repository directory

VM went into paused state after trying to stop it

How to Download OpenStack image in PMO?

Unable To Add a Multi-Attach Volume To the Instance Using PMO UI

Instance Creation Failed due to erroneous volume

Volume Stuck in "Error-Deleting" State due to ISCSI Errors

Unable to Create Volume with Storage Availability Zones Configured for Cinder Backends

Host Aggregates Not Showing Availability Status in UI, Instead Displaying "Hosts are Loading"

How To

Internal Only

Templates

Instance Failed To Start When Multipath Volume is Attached

Problem

VM is failing to start when multipath volumes are attached to the VM and ostackhost shows below error logs:

ostackhost logs
    
 
ERROR oslo_messaging.rpc.server [req-ID] Exception during message handling: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.Command: multipath -f <multipath_ID>Exit code: 1Stdout: 'Apr 09 04:25:29 | <multipath_ID>-part7: map in use\nApr 09 04:25:29 | failed to remove multipath map <multipath_ID>\n'Stderr: ''TRACE oslo_messaging.rpc.server Traceback (most recent call last):TRACE oslo_messaging.rpc.server   File "/opt/pf9/venv/lib/python3.6/site-packages/oslo_messaging/rpc/server.py", line 166, in _process_incomingTRACE oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)TRACE oslo_messaging.rpc.server   File "/opt/pf9/venv/lib/python3.6/site-packages/oslo_messaging/rpc/dispatcher.py", line 265, in dispatchTRACE oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Copy

Environment

Platform9 Managed OpenStack - v5.1 and Higher
Multi-path Volumes

Cause

The hosts is failing to flush the multipath map and creating stale entries.

Resolution

Login to the host where the VM is running and list the paths to the LUN and volumes

YAML
    
xxxxxxxxxx
 
# multipath -ll   <multipath_ID># lsblk /dev/dm-<DM_ID>
Copy

Remove the volume entries

YAML
    
xxxxxxxxxx
 
# dmsetup remove <volume-entries>
Copy

Remove the named multipath device.

YAML
    
xxxxxxxxxx
 
# multipath -f /dev/disk/by-id/dm-uuid-mpath-<ID>
Copy

Now start the stop the server and start it again

YAML
    
xxxxxxxxxx
 
# openstack server stop <UUID># openstack server start <UUID>
Copy

Last updated on

Was this page helpful?

On This Page

Instance Failed To Start When Multipath Volume is Attached Problem Environment Cause Resolution