Platform9 Edge Cloud
Latest
Frequently Asked Questions
How To
Solution
Internal Only
Templates
Powered By
Title
Message
Create new category
What is the title of your new category?
Edit page index title
What is the title of the page index?
Edit category
What is the new title of your category?
Edit link
What is the new title and URL of your link?
VF's PCI Address is Exposed as an Env Variable and Can be Consumed by Userspace DPDK Applications Directly
Copy Markdown
Open in ChatGPT
Open in Claude
Problem
Multus interface is not getting created when using type "sriov".
Pod Network Output
xxxxxxxxxxk8s.v1.cni.cncf.io/networks: sriovwhereabout k8s.v1.cni.cncf.io/networks-status: [{ "name": "k8s-pod-network", "ips": [ "10.40.242.136" ], "default": true, "dns": {} },{ "name": "kube-system/sriovwhereabout", "interface": "net1", "ips": [ "172.21.14.50" ], "dns": {}, "device-info": { "type": "pci", "version": "1.0.0", "pci": { "pci-address": "0000:af:04.5"Pod Interface Output
xxxxxxxxxx1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever2: tunl0@NONE: <NOARP> mtu 1480 qdisc noop state DOWN group default qlen 1000 link/ipip 0.0.0.0 brd 0.0.0.04: eth0@if306: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default link/ether 66:2c:23:55:0b:31 brd ff:ff:ff:ff:ff:ff link-netnsid 0 inet 10.20.242.136/32 brd 10.20.242.136 scope global eth0 valid_lft forever preferred_lft foreverEnvironment
- Platform9 Edge Cloud - All Versions
- SRIOV
- DPDK
Answer
The vfio-pci DPDK driver used in this case bypasses the linux layer as the vfio interfaces are userspace interfaces and one cannot see them as kernel devices (ip link). The VF's pci address is exposed as an env variable and can be consumed by userspace dpdk applications directly.
SRIOV Pod Describe Output
xxxxxxxxxx$ cat pod-describe.txt Name: sriov-deployment-86c6b7bcbc-w9fh9Namespace: kube-systemPriority: 0Node: xyz-master0/10.69.44.199Start Time: Mon, 13 Jun 2022 13:34:20 +0000Labels: app=sriov-pod pod-template-hash=86c6b7bcbcAnnotations: cni.projectcalico.org/podIP: 10.40.242.136/32 cni.projectcalico.org/podIPs: 10.40.242.136/32 k8s.v1.cni.cncf.io/network-status: [{ "name": "k8s-pod-network", "ips": [ "10.40.242.136" ], "default": true, "dns": {} },{ "name": "kube-system/sriovwhereabout", "interface": "net1", "ips": [ "172.21.14.50" ], "dns": {}, "device-info": { "type": "pci", "version": "1.0.0", "pci": { "pci-address": "0000:af:04.5" } } }] k8s.v1.cni.cncf.io/networks: sriovwhereabout k8s.v1.cni.cncf.io/networks-status: [{ "name": "k8s-pod-network", "ips": [ "10.40.242.136" ], "default": true, "dns": {} },{ "name": "kube-system/sriovwhereabout", "interface": "net1", "ips": [ "172.21.14.50" ], "dns": {}, "device-info": { "type": "pci", "version": "1.0.0", "pci": { "pci-address": "0000:af:04.5" } } }]...SRIOV Pod Inspect Output
xxxxxxxxxx$ cat sriov-pod-docker-inspect.txt | grep -i -C 1 env "StdinOnce": false, "Env": [ "PCIDEVICE_INTEL_COM_INTEL_SRIOV3_ETH10=0000:af:04.5",Additional Information
You can refer to sriov-network-device-plugin/issues/401 for additional information.
VariableType to search · ESC to discard
GlossaryType to search · ESC to discard
InsertType to search · ESC to discard
No matches
Last updated on
Was this page helpful?
Discard Changes
Do you want to discard your current changes and overwrite with the template?
Archive Synced Block
Message
Create new Template
What is this template's title?
Delete Template
Message