usrp-users@lists.ettus.com

Discussion and technical support related to USRP, UHD, RFNoC

View all threads

Issues getting UHD and DPDK working with Mellanox ConnectX-5

JA
Jorge Arroyo Giganto
Thu, Jan 28, 2021 12:47 PM

Hi,

I am trying to get DPDK and UHD working with a Mellanox ConnectX-5 NIC.

I am using UHD-3.15.LTS (the installation was done with PyBOMBS in order to
have RFNoC support, I did it following the RFNoC Getting Started guide),
with an X310 and running Ubuntu 16.04 on the Host.

I have followed the guides Getting Started with DPDK and UHD
https://kb.ettus.com/Getting_Started_with_DPDK_and_UHD and UHD's manual
DPDK page
https://files.ettus.com/manual_archive/v3.15.0.0/html/page_dpdk.html with
no luck.

For DPDK, as I am using Ubuntu 16.04, I downloaded from DPDK's download page
https://core.dpdk.org/download/ the recommended DPDK 17.11.10 (LTS)
version.

About the ConnectX-5, I installed its drivers (the LTS version of MLNX_OFED
https://www.mellanox.com/products/infiniband-drivers/linux/mlnx_ofed)
with "./mlnxofedinstall --upstream-libs --dpdk". The drivers seem to work
fine as I am able to run UHD applications using the X310 at 10Gb/s, however
when setting "use_dpdk=1" I always get the "[WARNING] [DPDK] Detected
use_dpdk argument, but DPDK support not built in." message.

My uhd.conf file looks like this:

[use_dpdk=1]
dpdk-mtu=9000
dpdk-driver=~/dpdk-stable-17.11.10/build/build/drivers  ; (not sure about
this line as I don't have the /usr/lib/x86_64-linux-gnu/dpdk-17.11-drivers/
directory, maybe this is a clue?)
dpdk-corelist=0,1
dpdk-num-mbufs=4095
dpdk-mbufs-cache-size=315

[dpdk-mac=04:3f:72:c3:70:fd]
dpdk-io-cpu=1
dpdk-ipv4=192.168.40.1/24

[dpdk-mac=04:3f:72:c3:70:fc]
dpdk-io-cpu=1
dpdk-ipv4=192.168.10.1/24

If anyone with this setup has gotten DPDK to work I would appreciate the
help very much.

Best regards,

Jorge

Hi, I am trying to get DPDK and UHD working with a Mellanox ConnectX-5 NIC. I am using UHD-3.15.LTS (the installation was done with PyBOMBS in order to have RFNoC support, I did it following the RFNoC Getting Started guide), with an X310 and running Ubuntu 16.04 on the Host. I have followed the guides Getting Started with DPDK and UHD <https://kb.ettus.com/Getting_Started_with_DPDK_and_UHD> and UHD's manual DPDK page <https://files.ettus.com/manual_archive/v3.15.0.0/html/page_dpdk.html> with no luck. For DPDK, as I am using Ubuntu 16.04, I downloaded from DPDK's download page <https://core.dpdk.org/download/> the recommended DPDK 17.11.10 (LTS) version. About the ConnectX-5, I installed its drivers (the LTS version of MLNX_OFED <https://www.mellanox.com/products/infiniband-drivers/linux/mlnx_ofed>) with "./mlnxofedinstall --upstream-libs --dpdk". The drivers seem to work fine as I am able to run UHD applications using the X310 at 10Gb/s, however when setting "use_dpdk=1" I always get the "[WARNING] [DPDK] Detected use_dpdk argument, but DPDK support not built in." message. My uhd.conf file looks like this: [use_dpdk=1] dpdk-mtu=9000 dpdk-driver=~/dpdk-stable-17.11.10/build/build/drivers ; (not sure about this line as I don't have the /usr/lib/x86_64-linux-gnu/dpdk-17.11-drivers/ directory, maybe this is a clue?) dpdk-corelist=0,1 dpdk-num-mbufs=4095 dpdk-mbufs-cache-size=315 [dpdk-mac=04:3f:72:c3:70:fd] dpdk-io-cpu=1 dpdk-ipv4=192.168.40.1/24 [dpdk-mac=04:3f:72:c3:70:fc] dpdk-io-cpu=1 dpdk-ipv4=192.168.10.1/24 If anyone with this setup has gotten DPDK to work I would appreciate the help very much. Best regards, Jorge
AR
Aaron Rossetto
Mon, Feb 1, 2021 6:55 PM

Hi Jorge,

The '[WARNING] [DPDK] Detected use_dpdk argument, but DPDK support not
built in' message means that the version of UHD you are using (in this
case, the 3.15.LTS version you installed via PyBOMBS) was not compiled
with DPDK support. For DPDK to be available and usable, the UHD driver
has to be built against the appropriate version of the DPDK libraries
for UHD. If you build the UHD 3.15.LTS branch from source and have the
appropriate DPDK libraries installed, the cmake step prior to
compilation will indicate support for DPDK in the output:

-- Found DPDK: /usr/local/include/dpdk (found version "18.11")  (note:
this is the output for building UHD-4.0, hence the more recent
version)
:
:
-- ######################################################
-- # UHD enabled components
-- ######################################################
:
--  * DPDK
:

Then you should be able to proceed.

Best regards,
Aaron

On Thu, Jan 28, 2021 at 6:48 AM Jorge Arroyo Giganto via USRP-users
usrp-users@lists.ettus.com wrote:

Hi,

I am trying to get DPDK and UHD working with a Mellanox ConnectX-5 NIC.

I am using UHD-3.15.LTS (the installation was done with PyBOMBS in order to have RFNoC support, I did it following the RFNoC Getting Started guide), with an X310 and running Ubuntu 16.04 on the Host.

I have followed the guides Getting Started with DPDK and UHD and UHD's manual DPDK page with no luck.

For DPDK, as I am using Ubuntu 16.04, I downloaded from DPDK's download page the recommended DPDK 17.11.10 (LTS) version.

About the ConnectX-5, I installed its drivers (the LTS version of MLNX_OFED) with "./mlnxofedinstall --upstream-libs --dpdk". The drivers seem to work fine as I am able to run UHD applications using the X310 at 10Gb/s, however when setting "use_dpdk=1" I always get the "[WARNING] [DPDK] Detected use_dpdk argument, but DPDK support not built in." message.

My uhd.conf file looks like this:

[use_dpdk=1]
dpdk-mtu=9000
dpdk-driver=~/dpdk-stable-17.11.10/build/build/drivers  ; (not sure about this line as I don't have the /usr/lib/x86_64-linux-gnu/dpdk-17.11-drivers/ directory, maybe this is a clue?)
dpdk-corelist=0,1
dpdk-num-mbufs=4095
dpdk-mbufs-cache-size=315

[dpdk-mac=04:3f:72:c3:70:fd]
dpdk-io-cpu=1
dpdk-ipv4=192.168.40.1/24

[dpdk-mac=04:3f:72:c3:70:fc]
dpdk-io-cpu=1
dpdk-ipv4=192.168.10.1/24

If anyone with this setup has gotten DPDK to work I would appreciate the help very much.

Best regards,

Jorge


USRP-users mailing list
USRP-users@lists.ettus.com
http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com

Hi Jorge, The '[WARNING] [DPDK] Detected use_dpdk argument, but DPDK support not built in' message means that the version of UHD you are using (in this case, the 3.15.LTS version you installed via PyBOMBS) was not compiled with DPDK support. For DPDK to be available and usable, the UHD driver has to be built against the appropriate version of the DPDK libraries for UHD. If you build the UHD 3.15.LTS branch from source and have the appropriate DPDK libraries installed, the cmake step prior to compilation will indicate support for DPDK in the output: -- Found DPDK: /usr/local/include/dpdk (found version "18.11") (note: this is the output for building UHD-4.0, hence the more recent version) : : -- ###################################################### -- # UHD enabled components -- ###################################################### : -- * DPDK : Then you should be able to proceed. Best regards, Aaron On Thu, Jan 28, 2021 at 6:48 AM Jorge Arroyo Giganto via USRP-users <usrp-users@lists.ettus.com> wrote: > > Hi, > > I am trying to get DPDK and UHD working with a Mellanox ConnectX-5 NIC. > > I am using UHD-3.15.LTS (the installation was done with PyBOMBS in order to have RFNoC support, I did it following the RFNoC Getting Started guide), with an X310 and running Ubuntu 16.04 on the Host. > > I have followed the guides Getting Started with DPDK and UHD and UHD's manual DPDK page with no luck. > > For DPDK, as I am using Ubuntu 16.04, I downloaded from DPDK's download page the recommended DPDK 17.11.10 (LTS) version. > > About the ConnectX-5, I installed its drivers (the LTS version of MLNX_OFED) with "./mlnxofedinstall --upstream-libs --dpdk". The drivers seem to work fine as I am able to run UHD applications using the X310 at 10Gb/s, however when setting "use_dpdk=1" I always get the "[WARNING] [DPDK] Detected use_dpdk argument, but DPDK support not built in." message. > > My uhd.conf file looks like this: > > [use_dpdk=1] > dpdk-mtu=9000 > dpdk-driver=~/dpdk-stable-17.11.10/build/build/drivers ; (not sure about this line as I don't have the /usr/lib/x86_64-linux-gnu/dpdk-17.11-drivers/ directory, maybe this is a clue?) > dpdk-corelist=0,1 > dpdk-num-mbufs=4095 > dpdk-mbufs-cache-size=315 > > [dpdk-mac=04:3f:72:c3:70:fd] > dpdk-io-cpu=1 > dpdk-ipv4=192.168.40.1/24 > > [dpdk-mac=04:3f:72:c3:70:fc] > dpdk-io-cpu=1 > dpdk-ipv4=192.168.10.1/24 > > > If anyone with this setup has gotten DPDK to work I would appreciate the help very much. > > Best regards, > > Jorge > _______________________________________________ > USRP-users mailing list > USRP-users@lists.ettus.com > http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com