usrp-users@lists.ettus.com

Discussion and technical support related to USRP, UHD, RFNoC

View all threads

E810 and DPDK

TM
TAKATZ, MARK J CTR USSF SSC SMC/SZR
Fri, Aug 16, 2024 3:57 PM

Has anyone gotten DPDK to work with the X410 and an E810 NIC?

My current setup: Ubuntu 2204, Ettux X410 (UC_200 FPGA), E810CDAQ2, default ice driver. Using dpdk-devbind.py to bind the NIC to the vfio-pci driver (which Ettus says is required for the 520/710 NICs) completely removes the port from the list under ifconfig/ip addr. DPDK documentation indicates that I should be able to use the ice driver itself, but the 810 does not show up as an available option when running any application and documentation for making it available is... sparse. Oddly, when I had the Mellanox driver loaded, it found the on-board NIC that I'm not using (it's only 25 GB), then failed.

Thanks,

Mark

Has anyone gotten DPDK to work with the X410 and an E810 NIC? My current setup: Ubuntu 2204, Ettux X410 (UC_200 FPGA), E810CDAQ2, default ice driver. Using dpdk-devbind.py to bind the NIC to the vfio-pci driver (which Ettus says is required for the 520/710 NICs) completely removes the port from the list under ifconfig/ip addr. DPDK documentation indicates that I should be able to use the ice driver itself, but the 810 does not show up as an available option when running any application and documentation for making it available is... sparse. Oddly, when I had the Mellanox driver loaded, it found the on-board NIC that I'm not using (it's only 25 GB), then failed. Thanks, Mark
S
sunniegoldie@gmail.com
Tue, Nov 12, 2024 9:47 AM

Hi Mark,

I’ve seen similar issues in environments involving digital transformation and ERP implementation, where network performance and customization are crucial for system success. The DPDK setup with the X410 and E810 NIC, particularly on Ubuntu 22.04, can indeed be challenging with the ICE driver and vfio-pci binding.

To address this, one approach is to first confirm compatibility and dependencies between the DPDK and ICE driver versions you’re using, as mismatches often lead to the NIC not appearing. It might also be worth exploring any updated DPDK patches or community-recommended configurations specific to the E810, as Intel occasionally releases updates addressing such driver compatibility.

For the port disappearing after dpdk-devbind.py, this is expected because binding to vfio-pci essentially detaches it from the kernel. In some cases, configuring the NIC with custom dpdk-devargs during binding helps to make the device discoverable by DPDK applications. Additionally, you may consider rechecking the ice driver documentation on configuration specifics for E810, as Intel’s guidance sometimes requires special steps for high-performance applications in FPGA environments like yours.

Hopefully, these adjustments will help stabilize your setup! Let us know how it goes.

Hi Mark, I’ve seen similar issues in environments involving [digital transformation](https://www.impactfirst.co/id/c/digital-transformation ) and [ERP implementation](https://www.impactfirst.co/id/c/erp-implementation), where network performance and customization are crucial for system success. The DPDK setup with the X410 and E810 NIC, particularly on Ubuntu 22.04, can indeed be challenging with the ICE driver and vfio-pci binding. To address this, one approach is to first confirm compatibility and dependencies between the DPDK and ICE driver versions you’re using, as mismatches often lead to the NIC not appearing. It might also be worth exploring any updated DPDK patches or community-recommended configurations specific to the E810, as Intel occasionally releases updates addressing such driver compatibility. For the port disappearing after `dpdk-devbind.py`, this is expected because binding to `vfio-pci` essentially detaches it from the kernel. In some cases, configuring the NIC with custom `dpdk-devargs` during binding helps to make the device discoverable by DPDK applications. Additionally, you may consider rechecking the `ice` driver documentation on configuration specifics for E810, as Intel’s guidance sometimes requires special steps for high-performance applications in FPGA environments like yours. Hopefully, these adjustments will help stabilize your setup! Let us know how it goes.
C
c1337rogers@gmail.com
Wed, Dec 4, 2024 7:39 PM

I just recently got DPDK working with an E810-CQDA2 and an X440 on Ubuntu 22.04. I didnt really do anything special, just installed dpdk and dpdk-dev with apt and followed the “getting started with DPDK and UHD 4.0” guide. A while back I did run into issues when I had an OFED driver alongside the ICE driver… I’d try maybe uninstalling all of the OFED stuff and see if that helps

I just recently got DPDK working with an E810-CQDA2 and an X440 on Ubuntu 22.04. I didnt really do anything special, just installed dpdk and dpdk-dev with apt and followed the “getting started with DPDK and UHD 4.0” guide. A while back I did run into issues when I had an OFED driver alongside the ICE driver… I’d try maybe uninstalling all of the OFED stuff and see if that helps