-
Notifications
You must be signed in to change notification settings - Fork 174
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
use usespace vdpa can't find the pfName because the net path is wrong #507
Comments
I dont understand the issue, device plugin is configured using CNI is failing since it failed to find netdevice. |
PF name the the PF netdev name of the PCI device. saying in the topic the path is "wrong" sort of hints that device plugin behaves incorrectly, which is not the case. I still dont understand what it is that you are seeking. currently device plugin will indeed fail to get PF name, but would still expose the resources. if you want to make this virtio netdev available in workload pod then you need support in CNI not device plugin. can you join one of our community meetings and present your use-case ? this would help |
Fixed issue with virtio driver by adding a conditional check for the virtio path under the PCI address, preventing errors when the pf name cannot be found. This ensures successful acquisition of vf resources. Fixes k8snetworkplumbingwg#507 Signed-off-by: JasinlikeEatingOrange <jasin_smith@outlook.com>
Fixed issue with virtio driver by adding a conditional check for the virtio path under the PCI address, preventing errors when the pf name cannot be found. This ensures successful acquisition of vf resources. Fixes k8snetworkplumbingwg#507 Signed-off-by: JasinlikeEatingOrange <jasin_smith@outlook.com>
Fixed issue with virtio driver by adding a conditional check for the virtio path under the PCI address, preventing errors when the pf name cannot be found. This ensures successful acquisition of vf resources. Fixes k8snetworkplumbingwg#507 Signed-off-by: JasinlikeEatingOrange <jasin_smith@outlook.com>
Fixed issue with virtio driver by adding a conditional check for the virtio path under the PCI address, preventing errors when the pf name cannot be found. This ensures successful acquisition of vf resources. Fixes k8snetworkplumbingwg#507 Signed-off-by: JasinlikeEatingOrange <jasin_smith@outlook.com>
Fixed issue with virtio driver by adding a conditional check for the virtio path under the PCI address, preventing errors when the pf name cannot be found. This ensures successful acquisition of vf resources. Fixes k8snetworkplumbingwg#507 Signed-off-by: JasinlikeEatingOrange <jasin_smith@outlook.com>
Fixed issue with virtio driver by adding a conditional check for the virtio path under the PCI address, preventing errors when the pf name cannot be found. This ensures successful acquisition of vf resources. Fixes k8snetworkplumbingwg#507 Signed-off-by: JasinlikeEatingOrange <jasin_smith@outlook.com>
Fixed issue with virtio driver by adding a conditional check for the virtio path under the PCI address, preventing errors when the pf name cannot be found. This ensures successful acquisition of vf resources. Fixes k8snetworkplumbingwg#507 Signed-off-by: JasinlikeEatingOrange <jasin_smith@outlook.com>
Fixed issue with virtio driver by adding a conditional check for the virtio path under the PCI address, preventing errors when the pf name cannot be found. This ensures successful acquisition of vf resources. Fixes k8snetworkplumbingwg#507 Signed-off-by: JasinlikeEatingOrange <jasin_smith@outlook.com>
Hi, if not you will have an issue if you have a pod running using the device and you restart the device plugin he will not be able to find the device after the reboot. |
@JasinlikeEatingOrange can you change pfName selector to rootDevices selector and use PCI address of the physical device ? @SchSeba pciAddress selector will match on the exact device, i believe he needs rootDevices to get all VF devices of a given physical device. |
but they are not VFs if I didn't miss anything from the logs you can see
they are all |
these are the only selectors supported for devices that are not sriov PFs "pciAddresses" N Target device's pci address as string string list Default: null "pciAddresses": ["0000:03:02.0"] |
from previous comment #507 (comment) see section 2. the pci device has a physfn link in sysfs and the physical device has virtfn files in sysfs, so was assuming its sriov. |
I don't understand also. @JasinlikeEatingOrange can you please explain what is this device as it doesn't look like a real PF |
@SchSeba @adrianchiris |
does what DPU are we talking about ? company model etc ? |
@JasinlikeEatingOrange base on
Does this mean that the PF for your card is going to be a virtio device? |
I1208 12:24:37.632987 1 manager.go:51] Using Kubelet Plugin Registry Mode
I1208 12:24:37.647684 1 main.go:44] resource manager reading configs
I1208 12:24:37.647717 1 manager.go:79] raw ResourceList: {
"resourceList": [{
"resourceName": "sriov_dpu",
"resourcePrefix": "yusur.tech",
"selectors": {
"rootDevices": ["0000:01:00.0#1-6"]
}
}
]
}
I1208 12:24:37.647806 1 factory.go:166] net device selector for resource sriov_dpu is &{DeviceSelectors:{Vendors:[] Devices:[] Drivers:[] PciAddresses:[]} PfNames:[] RootDevices:[0000:01:00.0#1-6] LinkTypes:[] DDPProfiles:[] IsRdma:false NeedVhostNet:false}
I1208 12:24:37.647831 1 manager.go:99] unmarshalled ResourceList: [{ResourcePrefix:yusur.tech ResourceName:sriov_dpu DeviceType:netDevice Selectors:0xc00000cd38 SelectorObj:0xc0001c3110}]
I1208 12:24:37.647874 1 manager.go:200] validating resource name "yusur.tech/sriov_dpu"
I1208 12:24:37.647879 1 main.go:60] Discovering host devices
I1208 12:24:37.810009 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.0 02 unknown unknown
I1208 12:24:37.810358 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.1 02 unknown unknown
I1208 12:24:37.810450 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.2 02 unknown unknown
I1208 12:24:37.816184 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.3 02 unknown unknown
I1208 12:24:37.816267 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.4 02 unknown unknown
I1208 12:24:37.816325 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.5 02 unknown unknown
I1208 12:24:37.816377 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.6 02 unknown unknown
I1208 12:24:37.816440 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.7 02 unknown unknown
I1208 12:24:37.816500 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0b.0 02 unknown unknown
I1208 12:24:37.816576 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0c.0 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816594 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.0 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816615 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.1 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816625 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.2 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816636 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.3 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816647 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.4 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816657 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.5 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816667 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.6 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816679 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.7 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816689 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:02:00.0 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816717 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:10:00.0 02 Red Hat, Inc. Virtio network device
I1208 12:24:37.816740 1 main.go:66] Initializing resource servers
I1208 12:24:37.816748 1 manager.go:105] number of config: 1
I1208 12:24:37.816751 1 manager.go:109]
I1208 12:24:37.816753 1 manager.go:110] Creating new ResourcePool: sriov_dpu
I1208 12:24:37.816756 1 manager.go:111] DeviceType: netDevice
I1208 12:24:37.816968 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.1. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:24:37.817177 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.2. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:24:37.817377 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.3. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:24:37.817597 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.4. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:24:37.817839 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.5. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:24:37.818106 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.6. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:24:37.818391 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.7. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:24:37.818496 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0b.0. error getting devlink device attributes for net device 0000:00:0b.0 no such device
I1208 12:24:37.818586 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0c.0. error getting devlink device attributes for net device 0000:00:0c.0 no such device
W1208 12:24:37.818595 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:00:0c.0/net: no such file or directory"
I1208 12:24:37.818833 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.1. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:24:37.818844 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.1/net: no such file or directory"
I1208 12:24:37.818989 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.2. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:24:37.818997 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.2/net: no such file or directory"
I1208 12:24:37.819162 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.3. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:24:37.819171 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.3/net: no such file or directory"
I1208 12:24:37.819360 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.4. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:24:37.819370 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.4/net: no such file or directory"
I1208 12:24:37.819637 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.5. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:24:37.819646 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.5/net: no such file or directory"
I1208 12:24:37.819888 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.6. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:24:37.819897 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.6/net: no such file or directory"
I1208 12:24:37.820160 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.7. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:24:37.820169 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.7/net: no such file or directory"
I1208 12:24:37.820232 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:02:00.0. error getting devlink device attributes for net device 0000:02:00.0 no such device
W1208 12:24:37.820242 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:02:00.0/net: no such file or directory"
I1208 12:24:37.820306 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:10:00.0. error getting devlink device attributes for net device 0000:10:00.0 no such device
W1208 12:24:37.820314 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:10:00.0/net: no such file or directory"
I1208 12:24:37.820330 1 factory.go:106] device added: [pciAddr: 0000:01:00.2, vendor: 1af4, device: 1041, driver: virtio-pci]
I1208 12:24:37.820333 1 factory.go:106] device added: [pciAddr: 0000:01:00.3, vendor: 1af4, device: 1041, driver: virtio-pci]
I1208 12:24:37.820336 1 factory.go:106] device added: [pciAddr: 0000:01:00.4, vendor: 1af4, device: 1041, driver: virtio-pci]
I1208 12:24:37.820338 1 factory.go:106] device added: [pciAddr: 0000:01:00.5, vendor: 1af4, device: 1041, driver: virtio-pci]
I1208 12:24:37.820340 1 factory.go:106] device added: [pciAddr: 0000:01:00.6, vendor: 1af4, device: 1041, driver: virtio-pci]
I1208 12:24:37.820343 1 factory.go:106] device added: [pciAddr: 0000:01:00.7, vendor: 1af4, device: 1041, driver: virtio-pci]
I1208 12:24:37.820352 1 manager.go:139] New resource server is created for sriov_dpu ResourcePool
I1208 12:24:37.820356 1 main.go:72] Starting all servers...
I1208 12:24:37.820537 1 server.go:199] starting sriov_dpu device plugin endpoint at: yusur.tech_sriov_dpu.sock
I1208 12:24:37.829701 1 server.go:226] sriov_dpu device plugin endpoint started serving
I1208 12:24:37.829722 1 main.go:77] All servers started.
I1208 12:24:37.829726 1 main.go:78] Listening for term signals
I1208 12:24:38.293372 1 server.go:110] Plugin: yusur.tech_sriov_dpu.sock gets registered successfully at Kubelet
I1208 12:24:38.293426 1 server.go:134] ListAndWatch(sriov_dpu) invoked
I1208 12:24:38.293431 1 server.go:142] ListAndWatch(sriov_dpu): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:01:00.2,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.3,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.4,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.5,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.6,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.7,Health:Healthy,Topology:nil,},},} |
root@master:~# kubectl logs -f -n kube-system kube-sriov-device-plugin-amd64-8rg72
I1208 12:31:14.488334 1 manager.go:51] Using Kubelet Plugin Registry Mode
I1208 12:31:14.488497 1 main.go:44] resource manager reading configs
I1208 12:31:14.488519 1 manager.go:79] raw ResourceList: {
"resourceList": [{
"resourceName": "sriov_dpu",
"resourcePrefix": "yusur.tech",
"selectors": {
"pciAddresses": ["0000:01:00.0#1-6"]
}
}
]
}
I1208 12:31:14.488632 1 factory.go:166] net device selector for resource sriov_dpu is &{DeviceSelectors:{Vendors:[] Devices:[] Drivers:[] PciAddresses:[0000:01:00.0#1-6]} PfNames:[] RootDevices:[] LinkTypes:[] DDPProfiles:[] IsRdma:false NeedVhostNet:false}
I1208 12:31:14.488645 1 manager.go:99] unmarshalled ResourceList: [{ResourcePrefix:yusur.tech ResourceName:sriov_dpu DeviceType:netDevice Selectors:0xc00011ad20 SelectorObj:0xc0001dd2b0}]
I1208 12:31:14.488678 1 manager.go:200] validating resource name "yusur.tech/sriov_dpu"
I1208 12:31:14.488682 1 main.go:60] Discovering host devices
I1208 12:31:14.631963 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.0 02 unknown unknown
I1208 12:31:14.632309 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.1 02 unknown unknown
I1208 12:31:14.632412 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.2 02 unknown unknown
I1208 12:31:14.632484 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.3 02 unknown unknown
I1208 12:31:14.632558 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.4 02 unknown unknown
I1208 12:31:14.632621 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.5 02 unknown unknown
I1208 12:31:14.632692 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.6 02 unknown unknown
I1208 12:31:14.632764 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.7 02 unknown unknown
I1208 12:31:14.632827 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0b.0 02 unknown unknown
I1208 12:31:14.632906 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0c.0 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.689364 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.0 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.693363 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.1 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.693388 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.2 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.693399 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.3 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.693408 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.4 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.693652 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.5 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.693673 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.6 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.693687 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.7 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.693700 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:02:00.0 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.693928 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:10:00.0 02 Red Hat, Inc. Virtio network device
I1208 12:31:14.693966 1 main.go:66] Initializing resource servers
I1208 12:31:14.693974 1 manager.go:105] number of config: 1
I1208 12:31:14.693977 1 manager.go:109]
I1208 12:31:14.693980 1 manager.go:110] Creating new ResourcePool: sriov_dpu
I1208 12:31:14.693982 1 manager.go:111] DeviceType: netDevice
I1208 12:31:14.700548 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.1. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:31:14.700829 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.2. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:31:14.701085 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.3. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:31:14.701397 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.4. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:31:14.701727 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.5. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:31:14.702054 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.6. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:31:14.702368 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.7. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1208 12:31:14.705249 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0b.0. error getting devlink device attributes for net device 0000:00:0b.0 no such device
I1208 12:31:14.705367 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0c.0. error getting devlink device attributes for net device 0000:00:0c.0 no such device
W1208 12:31:14.705382 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:00:0c.0/net: no such file or directory"
I1208 12:31:14.705721 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.1. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:31:14.705737 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.1/net: no such file or directory"
I1208 12:31:14.705913 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.2. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:31:14.705928 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.2/net: no such file or directory"
I1208 12:31:14.706125 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.3. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:31:14.706141 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.3/net: no such file or directory"
I1208 12:31:14.706353 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.4. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:31:14.706370 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.4/net: no such file or directory"
I1208 12:31:14.706613 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.5. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:31:14.706627 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.5/net: no such file or directory"
I1208 12:31:14.706932 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.6. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:31:14.706946 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.6/net: no such file or directory"
I1208 12:31:14.707229 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.7. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1208 12:31:14.707242 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.7/net: no such file or directory"
I1208 12:31:14.707318 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:02:00.0. error getting devlink device attributes for net device 0000:02:00.0 no such device
W1208 12:31:14.707332 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:02:00.0/net: no such file or directory"
I1208 12:31:14.707410 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:10:00.0. error getting devlink device attributes for net device 0000:10:00.0 no such device
W1208 12:31:14.707423 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:10:00.0/net: no such file or directory"
I1208 12:31:14.707431 1 manager.go:125] no devices in device pool, skipping creating resource server for sriov_dpu
I1208 12:31:14.707435 1 main.go:72] Starting all servers...
I1208 12:31:14.707438 1 main.go:77] All servers started.
I1208 12:31:14.707443 1 main.go:78] Listening for term signals |
Yes, Your understanding is correct. |
yes, its a warning [1] as expected. it would still expose related VFs as resources. [1]
|
yes if i use this modify image it will work, use pfname and rootDevices works. not throw warning.
contributor can determine if it's necessary to modify it. root@master:~# kubectl logs -f -n kube-system kube-sriov-device-plugin-amd64-qgjzq
I1210 10:01:34.904510 1 manager.go:57] Using Kubelet Plugin Registry Mode
I1210 10:01:34.904700 1 main.go:46] resource manager reading configs
I1210 10:01:34.904730 1 manager.go:86] raw ResourceList: {
"resourceList": [{
"resourceName": "sriov_dpu",
"resourcePrefix": "yusur.tech",
"selectors": {
"rootDevices": ["0000:01:00.0#1-6"]
}
}
]
}
I1210 10:01:34.904827 1 factory.go:209] *types.NetDeviceSelectors for resource sriov_dpu is [0xc0001b8e00]
I1210 10:01:34.904839 1 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix:yusur.tech ResourceName:sriov_dpu DeviceType:netDevice ExcludeTopology:false Selectors:0xc000332870 AdditionalInfo:map[] SelectorObjs:[0xc0001b8e00]}]
I1210 10:01:34.904868 1 manager.go:217] validating resource name "yusur.tech/sriov_dpu"
I1210 10:01:34.904875 1 main.go:62] Discovering host devices
I1210 10:01:35.040963 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.0 02 unknown unknown
I1210 10:01:35.041013 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.1 02 unknown unknown
I1210 10:01:35.041017 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.2 02 unknown unknown
I1210 10:01:35.041020 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.3 02 unknown unknown
I1210 10:01:35.041022 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.4 02 unknown unknown
I1210 10:01:35.041025 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.5 02 unknown unknown
I1210 10:01:35.041028 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.6 02 unknown unknown
I1210 10:01:35.041030 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.7 02 unknown unknown
I1210 10:01:35.041032 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0b.0 02 unknown unknown
I1210 10:01:35.041035 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0c.0 02 Red Hat, Inc. Virtio network device
I1210 10:01:35.041038 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.041040 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.1 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.041042 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.2 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.041044 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.3 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.041047 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.4 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.041049 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.5 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.041052 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.6 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.041057 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.7 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.041060 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:02:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.041063 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:10:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.041068 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.0 02 unknown unknown
I1210 10:01:35.041529 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.1 02 unknown unknown
I1210 10:01:35.041653 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.2 02 unknown unknown
I1210 10:01:35.041787 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.3 02 unknown unknown
I1210 10:01:35.041891 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.4 02 unknown unknown
I1210 10:01:35.041956 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.5 02 unknown unknown
I1210 10:01:35.042016 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.6 02 unknown unknown
I1210 10:01:35.042088 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.7 02 unknown unknown
I1210 10:01:35.042144 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0b.0 02 unknown unknown
I1210 10:01:35.042223 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0c.0 02 Red Hat, Inc. Virtio network device
I1210 10:01:35.042247 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.042271 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.1 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.042290 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.2 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.042300 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.3 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.042310 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.4 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.042322 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.5 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.042334 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.6 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.042346 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.7 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.042356 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:02:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.042379 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:10:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:01:35.042408 1 main.go:68] Initializing resource servers
I1210 10:01:35.042412 1 manager.go:117] number of config: 1
I1210 10:01:35.042416 1 manager.go:121] Creating new ResourcePool: sriov_dpu
I1210 10:01:35.042419 1 manager.go:122] DeviceType: netDevice
I1210 10:01:35.042498 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.1. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:01:35.042719 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.2. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:01:35.042938 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.3. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:01:35.043168 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.4. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:01:35.043421 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.5. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:01:35.043721 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.6. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:01:35.044029 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.7. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:01:35.044448 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.1. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:01:35.044640 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.2. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:01:35.044848 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.3. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:01:35.045078 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.4. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:01:35.045330 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.5. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:01:35.053897 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.6. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:01:35.054290 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.7. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:01:35.054732 1 manager.go:138] initServers(): selector index 0 will register 6 devices
I1210 10:01:35.054741 1 factory.go:122] device added: [identifier: 0000:01:00.2, vendor: 1af4, device: 1041, driver: virtio-pci]
I1210 10:01:35.054745 1 factory.go:122] device added: [identifier: 0000:01:00.3, vendor: 1af4, device: 1041, driver: virtio-pci]
I1210 10:01:35.054747 1 factory.go:122] device added: [identifier: 0000:01:00.4, vendor: 1af4, device: 1041, driver: virtio-pci]
I1210 10:01:35.054750 1 factory.go:122] device added: [identifier: 0000:01:00.5, vendor: 1af4, device: 1041, driver: virtio-pci]
I1210 10:01:35.054752 1 factory.go:122] device added: [identifier: 0000:01:00.6, vendor: 1af4, device: 1041, driver: virtio-pci]
I1210 10:01:35.054757 1 factory.go:122] device added: [identifier: 0000:01:00.7, vendor: 1af4, device: 1041, driver: virtio-pci]
I1210 10:01:35.054796 1 manager.go:156] New resource server is created for sriov_dpu ResourcePool
I1210 10:01:35.054803 1 main.go:74] Starting all servers...
I1210 10:01:35.055023 1 server.go:254] starting sriov_dpu device plugin endpoint at: yusur.tech_sriov_dpu.sock
I1210 10:01:35.057946 1 server.go:282] sriov_dpu device plugin endpoint started serving
I1210 10:01:35.057975 1 main.go:79] All servers started.
I1210 10:01:35.057981 1 main.go:80] Listening for term signals
I1210 10:01:35.714697 1 server.go:116] Plugin: yusur.tech_sriov_dpu.sock gets registered successfully at Kubelet
I1210 10:01:35.714778 1 server.go:157] ListAndWatch(sriov_dpu) invoked
I1210 10:01:35.714798 1 server.go:170] ListAndWatch(sriov_dpu): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:01:00.2,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.3,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.4,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.5,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.6,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.7,Health:Healthy,Topology:nil,},},} But use pciAddresses can't find resources. root@master:~# kubectl logs -f -n kube-system kube-sriov-device-plugin-amd64-6w57p
I1210 10:10:19.221745 1 manager.go:57] Using Kubelet Plugin Registry Mode
I1210 10:10:19.237750 1 main.go:46] resource manager reading configs
I1210 10:10:19.237915 1 manager.go:86] raw ResourceList: {
"resourceList": [{
"resourceName": "sriov_dpu",
"resourcePrefix": "yusur.tech",
"selectors": {
"pciAddresses": ["0000:01:00.0#1-6"]
}
}
]
}
I1210 10:10:19.238234 1 factory.go:209] *types.NetDeviceSelectors for resource sriov_dpu is [0xc0002a0e00]
I1210 10:10:19.238247 1 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix:yusur.tech ResourceName:sriov_dpu DeviceType:netDevice ExcludeTopology:false Selectors:0xc00041c840 AdditionalInfo:map[] SelectorObjs:[0xc0002a0e00]}]
I1210 10:10:19.238384 1 manager.go:217] validating resource name "yusur.tech/sriov_dpu"
I1210 10:10:19.238392 1 main.go:62] Discovering host devices
I1210 10:10:19.333593 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.0 02 unknown unknown
I1210 10:10:19.334017 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.1 02 unknown unknown
I1210 10:10:19.335102 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.2 02 unknown unknown
I1210 10:10:19.335192 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.3 02 unknown unknown
I1210 10:10:19.335254 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.4 02 unknown unknown
I1210 10:10:19.335316 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.5 02 unknown unknown
I1210 10:10:19.335373 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.6 02 unknown unknown
I1210 10:10:19.335435 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0a.7 02 unknown unknown
I1210 10:10:19.335492 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0b.0 02 unknown unknown
I1210 10:10:19.335594 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:00:0c.0 02 Red Hat, Inc. Virtio network device
I1210 10:10:19.335626 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335656 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.1 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335668 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.2 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335680 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.3 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335692 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.4 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335704 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.5 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335717 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.6 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335731 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:01:00.7 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335742 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:02:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335770 1 netDeviceProvider.go:67] netdevice AddTargetDevices(): device found: 0000:10:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335796 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.0 02 unknown unknown
I1210 10:10:19.335811 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.1 02 unknown unknown
I1210 10:10:19.335818 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.2 02 unknown unknown
I1210 10:10:19.335822 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.3 02 unknown unknown
I1210 10:10:19.335827 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.4 02 unknown unknown
I1210 10:10:19.335832 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.5 02 unknown unknown
I1210 10:10:19.335837 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.6 02 unknown unknown
I1210 10:10:19.335841 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0a.7 02 unknown unknown
I1210 10:10:19.335844 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0b.0 02 unknown unknown
I1210 10:10:19.335847 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:00:0c.0 02 Red Hat, Inc. Virtio network device
I1210 10:10:19.335850 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335855 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.1 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335858 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.2 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335861 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.3 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335865 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.4 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335869 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.5 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335873 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.6 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335876 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:01:00.7 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335879 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:02:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335886 1 auxNetDeviceProvider.go:84] auxnetdevice AddTargetDevices(): device found: 0000:10:00.0 02 Red Hat, Inc. Virtio 1.0 network device
I1210 10:10:19.335892 1 main.go:68] Initializing resource servers
I1210 10:10:19.335896 1 manager.go:117] number of config: 1
I1210 10:10:19.335900 1 manager.go:121] Creating new ResourcePool: sriov_dpu
I1210 10:10:19.335903 1 manager.go:122] DeviceType: netDevice
I1210 10:10:19.336001 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.1. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:10:19.336256 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.2. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:10:19.336504 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.3. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:10:19.336782 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.4. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:10:19.337072 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.5. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:10:19.337408 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.6. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:10:19.337750 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:00:0a.7. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1210 10:10:19.338911 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.1. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:10:19.339158 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.2. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:10:19.339575 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.3. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:10:19.345010 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.4. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:10:19.349783 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.5. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:10:19.355430 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.6. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:10:19.355765 1 utils.go:81] Devlink query for eswitch mode is not supported for device 0000:01:00.7. error getting devlink device attributes for net device 0000:01:00.0 no such device
I1210 10:10:19.362164 1 manager.go:138] initServers(): selector index 0 will register 0 devices
I1210 10:10:19.362186 1 manager.go:142] no devices in device pool, skipping creating resource server for sriov_dpu
I1210 10:10:19.362191 1 main.go:74] Starting all servers...
I1210 10:10:19.362196 1 main.go:79] All servers started.
I1210 10:10:19.362199 1 main.go:80] Listening for term signals
|
ok so I think we are good to just use the rootDevices right? |
closing this one |
What happened?
There is no net path in Virtio-net is the net layer of virtio, and the standard kernel driver places this layer separately into the virtio1 path
![e74c25da4e1dc57466fd8e40174e5812](https://private-user-images.githubusercontent.com/35122784/281435347-72d40f1a-90ed-461f-a3d5-7e9f8b02afea.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ2MTk5NDUsIm5iZiI6MTcyNDYxOTY0NSwicGF0aCI6Ii8zNTEyMjc4NC8yODE0MzUzNDctNzJkNDBmMWEtOTBlZC00NjFmLWEzZDUtN2U5ZjhiMDJhZmVhLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODI1VDIxMDA0NVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWEyYjAwM2NlZGQxMDM5MjUyNjIzYjAzZGNlMTdiOWFkMDViZDEyYjRhZmMyYWFiZjQyODJkMmM2MGRlMDIyMTcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.SjtKqjpJvlbe3V7Cgi7ERa9x_ivadjZx1isU-ztLoQY)
What did you expect to happen?
If the net folder is not found in the /sys/bus/pci/devices/pciAddr/physfn/net path, I hope you can find the folder starting with virtio again
What are the minimal steps needed to reproduce the bug?
No**/sys/bus/pci/devices/pciAddr/physfn/net**
Only the /sys/bus/pci/devices/pciAddr virtioxx/physfn/net
Anything else we need to know?
Component Versions
Please fill in the below table with the version numbers of components used.
Config Files
Config file locations may be config dependent.
Device pool config file location (Try '/etc/pcidp/config.json')
Multus config (Try '/etc/cni/multus/net.d')
CNI config (Try '/etc/cni/net.d/')
Kubernetes deployment type ( Bare Metal, Kubeadm etc.)
Kubeconfig file
SR-IOV Network Custom Resource Definition
Logs
SR-IOV Network Device Plugin Logs (use
kubectl logs $PODNAME
)root@master:~/temp/kubevirt# kubectl logs -f -n kube-system kube-sriov-device-plugin-amd64-d6vsq
I1108 14:43:33.442520 1 manager.go:51] Using Kubelet Plugin Registry Mode
I1108 14:43:33.442648 1 main.go:44] resource manager reading configs
I1108 14:43:33.442685 1 manager.go:79] raw ResourceList: {
"resourceList": [{
"resourceName": "sriov_dpu",
"resourcePrefix": "yusur.tech",
"selectors": {
"rootDevices": ["0000:01:00.0#1-6"]
}
}
]
}
I1108 14:43:33.442759 1 factory.go:166] net device selector for resource sriov_dpu is &{DeviceSelectors:{Vendors:[] Devices:[] Drivers:[] PciAddresses:[]} PfNames:[] RootDevices:[0000:01:00.0#1-6] LinkTypes:[] DDPProfiles:[] IsRdma:false NeedVhostNet:false}
I1108 14:43:33.442781 1 manager.go:99] unmarshalled ResourceList: [{ResourcePrefix:yusur.tech ResourceName:sriov_dpu DeviceType:netDevice Selectors:0xc00000cd38 SelectorObj:0xc0001b32b0}]
I1108 14:43:33.442815 1 manager.go:200] validating resource name "yusur.tech/sriov_dpu"
I1108 14:43:33.442818 1 main.go:60] Discovering host devices
I1108 14:43:33.469296 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.0 02 unknown unknown
I1108 14:43:33.469535 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.1 02 unknown unknown
I1108 14:43:33.469605 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.2 02 unknown unknown
I1108 14:43:33.469659 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.3 02 unknown unknown
I1108 14:43:33.469719 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.4 02 unknown unknown
I1108 14:43:33.469767 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.5 02 unknown unknown
I1108 14:43:33.469814 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.6 02 unknown unknown
I1108 14:43:33.469875 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0a.7 02 unknown unknown
I1108 14:43:33.469931 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0b.0 02 unknown unknown
I1108 14:43:33.469990 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:00:0c.0 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470009 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.0 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470035 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.1 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470045 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.2 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470054 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.3 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470064 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.4 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470075 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.5 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470086 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.6 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470097 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:01:00.7 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470106 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:02:00.0 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470127 1 netDeviceProvider.go:84] netdevice AddTargetDevices(): device found: 0000:10:00.0 02 Red Hat, Inc. Virtio network device
I1108 14:43:33.470151 1 main.go:66] Initializing resource servers
I1108 14:43:33.470157 1 manager.go:105] number of config: 1
I1108 14:43:33.470160 1 manager.go:109]
I1108 14:43:33.470162 1 manager.go:110] Creating new ResourcePool: sriov_dpu
I1108 14:43:33.470166 1 manager.go:111] DeviceType: netDevice
I1108 14:43:33.470339 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.1. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1108 14:43:33.470511 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.2. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1108 14:43:33.470694 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.3. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1108 14:43:33.471309 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.4. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1108 14:43:33.471644 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.5. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1108 14:43:33.471959 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.6. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1108 14:43:33.472276 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0a.7. error getting devlink device attributes for net device 0000:00:0a.0 no such device
I1108 14:43:33.472473 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0b.0. error getting devlink device attributes for net device 0000:00:0b.0 no such device
I1108 14:43:33.472583 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:00:0c.0. error getting devlink device attributes for net device 0000:00:0c.0 no such device
W1108 14:43:33.472592 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:00:0c.0/net: no such file or directory"
I1108 14:43:33.472827 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.1. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1108 14:43:33.472837 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.1/net: no such file or directory"
I1108 14:43:33.472977 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.2. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1108 14:43:33.472984 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.2/net: no such file or directory"
I1108 14:43:33.473145 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.3. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1108 14:43:33.473154 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.3/net: no such file or directory"
I1108 14:43:33.473338 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.4. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1108 14:43:33.473347 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.4/net: no such file or directory"
I1108 14:43:33.473572 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.5. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1108 14:43:33.473580 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.5/net: no such file or directory"
I1108 14:43:33.473825 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.6. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1108 14:43:33.473834 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.6/net: no such file or directory"
I1108 14:43:33.474096 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:01:00.7. error getting devlink device attributes for net device 0000:01:00.0 no such device
W1108 14:43:33.474104 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:01:00.7/net: no such file or directory"
I1108 14:43:33.474171 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:02:00.0. error getting devlink device attributes for net device 0000:02:00.0 no such device
W1108 14:43:33.474178 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:02:00.0/net: no such file or directory"
I1108 14:43:33.474239 1 utils.go:71] Devlink query for eswitch mode is not supported for device 0000:10:00.0. error getting devlink device attributes for net device 0000:10:00.0 no such device
W1108 14:43:33.474246 1 pciNetDevice.go:81] unable to get PF name "open /sys/bus/pci/devices/0000:10:00.0/net: no such file or directory"
I1108 14:43:33.474261 1 factory.go:106] device added: [pciAddr: 0000:01:00.2, vendor: 1af4, device: 1041, driver: virtio-pci]
I1108 14:43:33.474263 1 factory.go:106] device added: [pciAddr: 0000:01:00.3, vendor: 1af4, device: 1041, driver: virtio-pci]
I1108 14:43:33.474265 1 factory.go:106] device added: [pciAddr: 0000:01:00.4, vendor: 1af4, device: 1041, driver: virtio-pci]
I1108 14:43:33.474267 1 factory.go:106] device added: [pciAddr: 0000:01:00.5, vendor: 1af4, device: 1041, driver: virtio-pci]
I1108 14:43:33.474271 1 factory.go:106] device added: [pciAddr: 0000:01:00.6, vendor: 1af4, device: 1041, driver: virtio-pci]
I1108 14:43:33.474273 1 factory.go:106] device added: [pciAddr: 0000:01:00.7, vendor: 1af4, device: 1041, driver: virtio-pci]
I1108 14:43:33.474281 1 manager.go:139] New resource server is created for sriov_dpu ResourcePool
I1108 14:43:33.474285 1 main.go:72] Starting all servers...
I1108 14:43:33.474446 1 server.go:199] starting sriov_dpu device plugin endpoint at: yusur.tech_sriov_dpu.sock
I1108 14:43:33.474818 1 server.go:226] sriov_dpu device plugin endpoint started serving
I1108 14:43:33.474842 1 main.go:77] All servers started.
I1108 14:43:33.474848 1 main.go:78] Listening for term signals
I1108 14:43:33.964954 1 server.go:110] Plugin: yusur.tech_sriov_dpu.sock gets registered successfully at Kubelet
I1108 14:43:33.964962 1 server.go:134] ListAndWatch(sriov_dpu) invoked
I1108 14:43:33.964969 1 server.go:142] ListAndWatch(sriov_dpu): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:01:00.6,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.7,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.2,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.3,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.4,Health:Healthy,Topology:nil,},&Device{ID:0000:01:00.5,Health:Healthy,Topology:nil,},},}
Multus logs (If enabled. Try '/var/log/multus.log' )
Kubelet logs (journalctl -u kubelet)
The text was updated successfully, but these errors were encountered: