usrp-users@lists.ettus.com
Discussion and technical support related to USRP, UHD, RFNoC
View all threads[ERROR] [DPDK] Could not find route to destination address 192.168.10.2
Hi usrp-users,
I'm trying to set up DPDK for x410 USRP, but when I run the
"benchmark_rate", DPDK "could not find route to destination address".
(Please find my screen dump and uhd.conf below.)
Could you please provide any insights on what might go wrong? I
appreciate it!
Screen Dump:
./benchmark_rate --rx_rate 125e6 --rx_subdev "A:0 B:0" --rx_channels 0,1
--tx_rate 125e6 --tx_subdev "A:0 B:0" --tx_channels 0,1 --args
"addr=192.168.10.2,mgmt_addr=128.178.116.7,master_clock_rate=250e6,use_dpdk=1"
[INFO] [UHD] linux; GNU C++ version 11.4.0; Boost_107400; DPDK_21.11;
UHD_4.4.0.HEAD-0-g5fac246b
[WARNING] [PREFS] Loaded config from /root/.uhd. This location is
considered deprecated, consider moving your config file to /root/.config
instead.
EAL: Detected CPU lcores: 12
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: No available 1048576 kB hugepages reported
EAL: VFIO support initialized
EAL: Probe PCI driver: mlx5_pci (15b3:1017) device: 0000:a2:00.0 (socket 0)
EAL: Probe PCI driver: mlx5_pci (15b3:1017) device: 0000:a2:00.1 (socket 0)
TELEMETRY: No legacy callbacks, legacy socket not created
[ERROR] [DPDK] Could not find route to destination address 192.168.10.2
[ERROR] [X300] X300 Network discovery error RuntimeError: DPDK: Could not
find route to destination address 192.168.10.2
[00:00:00.000212] Creating the usrp device with:
addr=192.168.10.2,mgmt_addr=128.178.116.7,master_clock_rate=250e6,use_dpdk=1...
[ERROR] [DPDK] Could not find route to destination address 192.168.10.2
[ERROR] [X300] X300 Network discovery error RuntimeError: DPDK: Could not
find route to destination address 192.168.10.2
[INFO] [MPMD] Initializing 1 device(s) in parallel with args:
mgmt_addr=128.178.116.7,type=x4xx,product=x410,serial=327C1F2,name=ni-x4xx-327C1F2,fpga=X4_200,claimed=False,addr=192.168.10.2,master_clock_rate=250e6,use_dpdk=1
[INFO] [MPM.PeriphManager] init() called with device args
`fpga=X4_200,master_clock_rate=250e6,mgmt_addr=128.178.116.7,name=ni-x4xx-327C1F2,product=x410,use_dpdk=1,clock_source=internal,time_source=internal'.
[ERROR] [DPDK] Could not find route to destination address 192.168.10.2
[WARNING] [MPMD::XPORT::UDP] Error during MTU discovery on address
192.168.10.2: RuntimeError: DPDK: Could not find route to destination
address 192.168.10.2
[ERROR] [MPMD::MB_IFACE] No CHDR connection available!
Error: RuntimeError: No CHDR connection available!
uhd.conf:
[use_dpdk=1]
dpdk_mtu=9000
dpdk_driver=/usr/local/lib/x86_64-linux-gnu/dpdk/pmds-22.0/
dpdk_corelist=3,4
dpdk_num_mbufs=4096
dpdk_mbuf_cache_size=315
[dpdk_mac=08:C0:EB:F6:81:72]
dpdk_lcore = 3
dpdk_ipv4 = 192.168.10.1/24
dpdk_num_desc=4096
[dpdk_mac=08:C0:EB:F6:81:73]
dpdk_lcore = 4
dpdk_ipv4 = 192.168.20.1/24
Best regards,
Jayden
Hello
I am getting similar issue:
ad@bm-super11-intel:~$ sudo /usr/local/lib/uhd/examples/benchmark_rate --rx_rate 125e6 --rx_subdev "A:0 B:0" --rx_channels 0,1 --tx_rate 125e6 --tx_subdev "A:0 B:0" --tx_channels 0,1 --args "addr=10.10.1.100,second_addr=10.10.2.100,mgmt_addr=10.10.0.100,master_clock_rate=125e6,use_dpdk=1"
[INFO] [UHD] linux; GNU C++ version 11.4.0; Boost_107400; DPDK_21.11; UHD_4.7.0.0-0-unknown
EAL: Detected CPU lcores: 64
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: No available 2048 kB hugepages reported
EAL: VFIO support initialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Ignore mapping IO port bar(1)
EAL: Ignore mapping IO port bar(4)
EAL: Probe PCI driver: net_i40e (8086:1572) device: 0000:43:00.1 (socket 0)
EAL: Ignore mapping IO port bar(1)
EAL: Ignore mapping IO port bar(4)
EAL: Probe PCI driver: net_i40e (8086:1572) device: 0000:43:00.2 (socket 0)
TELEMETRY: No legacy callbacks, legacy socket not created
[ERROR] [DPDK] Could not find route to destination address 10.10.1.100
[ERROR] [X300] X300 Network discovery error RuntimeError: DPDK: Could not find route to destination address 10.10.1.100
[00:00:00.000397] Creating the usrp device with: addr=10.10.1.100,second_addr=10.10.2.100,mgmt_addr=10.10.0.100,master_clock_rate=125e6,use_dpdk=1...
[ERROR] [DPDK] Could not find route to destination address 10.10.1.100
[ERROR] [X300] X300 Network discovery error RuntimeError: DPDK: Could not find route to destination address 10.10.1.100
[INFO] [MPMD] Initializing 1 device(s) in parallel with args: mgmt_addr=10.10.0.100,type=n3xx,product=n310,serial=32000F1,name=ni-n3xx-32000F1,fpga=XG,claimed=False,addr=10.10.1.100,second_addr=10.10.2.100,master_clock_rate=125e6,use_dpdk=1
[INFO] [MPM.PeriphManager] init() called with device args `fpga=XG,master_clock_rate=125e6,mgmt_addr=10.10.0.100,name=ni-n3xx-32000F1,product=n310,second_addr=10.10.2.100,use_dpdk=1,clock_source=internal,time_source=internal'.
[ERROR] [DPDK] Could not find route to destination address 10.10.1.100
[WARNING] [MPMD::XPORT::UDP] Error during MTU discovery on address 10.10.1.100: RuntimeError: DPDK: Could not find route to destination address 10.10.1.100
[ERROR] [DPDK] Could not find route to destination address 10.10.2.100
[WARNING] [MPMD::XPORT::UDP] Error during MTU discovery on address 10.10.2.100: RuntimeError: DPDK: Could not find route to destination address 10.10.2.100
[ERROR] [MPMD::MB_IFACE] No CHDR connection available!
Error: RuntimeError: No CHDR connection available!
ad@bm-super11-intel:~$
And two interfaces are bind to DPDK:
ad@bm-super11-intel:~$ sudo dpdk-devbind.py --status
Network devices using DPDK-compatible driver
---===========
0000:43:00.1 'Ethernet Controller X710 for 10GbE SFP+ 1572' drv=vfio-pci unused=i40e
0000:43:00.2 'Ethernet Controller X710 for 10GbE SFP+ 1572' drv=vfio-pci unused=i40e
Any suggestion please?
Here are my UHD and DPD versions:
ad@bm-super11-intel:~$ /usr/local/bin/uhd_config_info --version
UHD 4.7.0.0-0-unknown
ad@bm-super11-intel:~$ sudo dpdk-testpmd -v
EAL: Detected CPU lcores: 64
EAL: Detected NUMA nodes: 1
EAL: RTE Version: 'DPDK 21.11.6'
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: No available 2048 kB hugepages reported
EAL: VFIO support initialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Ignore mapping IO port bar(1)
EAL: Ignore mapping IO port bar(4)
EAL: Probe PCI driver: net_i40e (8086:1572) device: 0000:43:00.1 (socket 0)
EAL: Ignore mapping IO port bar(1)
EAL: Ignore mapping IO port bar(4)
EAL: Probe PCI driver: net_i40e (8086:1572) device: 0000:43:00.2 (socket 0)
testpmd: create a new mbuf pool <mb_pool_0>: n=635456, size=2176, socket=0
testpmd: preferred mempool ops selected: ring_mp_mc
Configuring Port 0 (socket 0)
Port 0: 3C:EC:EF:AF:7B:8D
Configuring Port 1 (socket 0)
Port 1: 3C:EC:EF:AF:7B:8E
Checking link statuses...
Done
No commandline core given, start packet forwarding
io packet forwarding - ports=2 - cores=1 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 2 (socket 0) forwards packets on 2 streams:
RX P=0/Q=0 (socket 0) -> TX P=1/Q=0 (socket 0) peer=02:00:00:00:00:01
RX P=1/Q=0 (socket 0) -> TX P=0/Q=0 (socket 0) peer=02:00:00:00:00:00
io packet forwarding packets/burst=32
nb forwarding cores=1 - nb forwarding ports=2
port 0: RX queue number: 1 Tx queue number: 1
Rx offloads=0x0 Tx offloads=0x10000
RX queue: 0
RX desc=256 - RX free threshold=32
RX threshold registers: pthresh=0 hthresh=0 wthresh=0
RX Offloads=0x0
TX queue: 0
TX desc=256 - TX free threshold=32
TX threshold registers: pthresh=32 hthresh=0 wthresh=0
TX offloads=0x10000 - TX RS bit threshold=32
port 1: RX queue number: 1 Tx queue number: 1
Rx offloads=0x0 Tx offloads=0x10000
RX queue: 0
RX desc=256 - RX free threshold=32
RX threshold registers: pthresh=0 hthresh=0 wthresh=0
RX Offloads=0x0
TX queue: 0
TX desc=256 - TX free threshold=32
TX threshold registers: pthresh=32 hthresh=0 wthresh=0
TX offloads=0x10000 - TX RS bit threshold=32
Press enter to exit
Telling cores to stop...
Waiting for lcores to finish...
Thanks
I tried with sudo su as well (not working):
root@bm-super11-intel:/home/ad# cat /root/.config/uhd.conf
[use_dpdk=1]
dpdk_mtu=9000
dpdk_driver=/usr/lib/x86_64-linux-gnu/dpdk/pmds-22.0/
dpdk_corelist=2,3,4
dpdk_num_mbufs=4095
dpdk_mbuf_cache_size=315
[dpdk_mac=3c:ec:ef:af:7b:8d]
dpdk_lcore = 3
dpdk_ipv4 = 10.10.1.1/24
dpdk_num_desc = 4096
[dpdk_mac=3c:ec:ef:af:7b:8e]
dpdk_lcore = 4
dpdk_ipv4 = 10.10.2.1/24
dpdk_num_desc = 4096
root@bm-super11-intel:/home/ad# /usr/local/lib/uhd/examples/benchmark_rate --rx_rate 125e6 --rx_subdev "A:0 B:0" --rx_channels 0,1 --tx_rate 125e6 --tx_subdev "A:0 B:0" --tx_channels 0,1 --args "addr=10.10.1.100,second_addr=10.10.2.100,mgmt_addr=10.10.0.100,master_clock_rate=125e6,use_dpdk=1"
[INFO] [UHD] linux; GNU C++ version 11.4.0; Boost_107400; DPDK_21.11; UHD_4.7.0.0-0-unknown
EAL: Detected CPU lcores: 64
EAL: Detected NUMA nodes: 1
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: No available 1048576 kB hugepages reported
EAL: VFIO support initialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Ignore mapping IO port bar(1)
EAL: Ignore mapping IO port bar(4)
EAL: Probe PCI driver: net_i40e (8086:1572) device: 0000:43:00.1 (socket 0)
EAL: Ignore mapping IO port bar(1)
EAL: Ignore mapping IO port bar(4)
EAL: Probe PCI driver: net_i40e (8086:1572) device: 0000:43:00.2 (socket 0)
TELEMETRY: No legacy callbacks, legacy socket not created
i40e_alloc_rx_queue_mbufs(): Failed to allocate mbuf for RX
i40e_dev_rx_queue_start(): Failed to allocate RX queue mbuf
[ERROR] [DPDK] Port 1: Could not start device
EAL: FATAL: already called initialization.
EAL: already called initialization.
[00:00:00.000208] Creating the usrp device with: addr=10.10.1.100,second_addr=10.10.2.100,mgmt_addr=10.10.0.100,master_clock_rate=125e6,use_dpdk=1...
EAL: FATAL: already called initialization.
EAL: already called initialization.
[ERROR] [X300] X300 Network discovery error RuntimeError: DPDK: Failure to start device
[ERROR] [DPDK] Error with EAL initialization
[ERROR] [UHD] Device discovery error: RuntimeError: Error with EAL initialization
[ERROR] [DPDK] Error with EAL initialization
[ERROR] [UHD] Device discovery error: RuntimeError: Error with EAL initialization
EAL: FATAL: already called initialization.
EAL: already called initialization.
Error: LookupError: KeyError: No devices found for ----->
Device Address:
addr: 10.10.1.100
second_addr: 10.10.2.100
mgmt_addr: 10.10.0.100
master_clock_rate: 125e6
use_dpdk: 1
[ERROR] [DPDK] Error with EAL initialization
[ERROR] [X300] X300 Network discovery error RuntimeError: Error with EAL initialization
root@bm-super11-intel:/home/ad#
On 04/12/2024 06:11, houshang.azizi@accelleran.com wrote:
I tried with |sudo su| as well (not working):
|root@bm-super11-intel:/home/ad# cat /root/.config/uhd.conf|
|[use_dpdk=1]|
|dpdk_mtu=9000|
|dpdk_driver=/usr/lib/x86_64-linux-gnu/dpdk/pmds-22.0/|
|dpdk_corelist=2,3,4|
|dpdk_num_mbufs=4095|
|dpdk_mbuf_cache_size=315|
|[dpdk_mac=3c:ec:ef:af:7b:8d]|
|dpdk_lcore = 3|
|dpdk_ipv4 = 10.10.1.1/24|
|dpdk_num_desc = 4096|
|[dpdk_mac=3c:ec:ef:af:7b:8e]|
|dpdk_lcore = 4|
|dpdk_ipv4 = 10.10.2.1/24|
|dpdk_num_desc = 4096|
|root@bm-super11-intel:/home/ad#
/usr/local/lib/uhd/examples/benchmark_rate --rx_rate 125e6 --rx_subdev
"A:0 B:0" --rx_channels 0,1 --tx_rate 125e6 --tx_subdev "A:0 B:0"
--tx_channels 0,1 --args
"addr=10.10.1.100,second_addr=10.10.2.100,mgmt_addr=10.10.0.100,master_clock_rate=125e6,use_dpdk=1"|
|[INFO] [UHD] linux; GNU C++ version 11.4.0; Boost_107400; DPDK_21.11;
UHD_4.7.0.0-0-unknown|
|EAL: Detected CPU lcores: 64|
|EAL: Detected NUMA nodes: 1|
|EAL: Detected shared linkage of DPDK|
|EAL: Multi-process socket /var/run/dpdk/rte/mp_socket|
|EAL: Selected IOVA mode 'VA'|
|EAL: No available 1048576 kB hugepages reported|
|EAL: VFIO support initialized|
|EAL: Using IOMMU type 1 (Type 1)|
|EAL: Ignore mapping IO port bar(1)|
|EAL: Ignore mapping IO port bar(4)|
|EAL: Probe PCI driver: net_i40e (8086:1572) device: 0000:43:00.1
(socket 0)|
|EAL: Ignore mapping IO port bar(1)|
|EAL: Ignore mapping IO port bar(4)|
|EAL: Probe PCI driver: net_i40e (8086:1572) device: 0000:43:00.2
(socket 0)|
|TELEMETRY: No legacy callbacks, legacy socket not created|
|i40e_alloc_rx_queue_mbufs(): Failed to allocate mbuf for RX|
|i40e_dev_rx_queue_start(): Failed to allocate RX queue mbuf|
|[ERROR] [DPDK] Port 1: Could not start device|
|EAL: FATAL: already called initialization.|
|EAL: already called initialization.|
|[00:00:00.000208] Creating the usrp device with:
addr=10.10.1.100,second_addr=10.10.2.100,mgmt_addr=10.10.0.100,master_clock_rate=125e6,use_dpdk=1...|
|EAL: FATAL: already called initialization.|
|EAL: already called initialization.|
|[ERROR] [X300] X300 Network discovery error RuntimeError: DPDK:
Failure to start device|
|[ERROR] [DPDK] Error with EAL initialization|
|[ERROR] [UHD] Device discovery error: RuntimeError: Error with EAL
initialization|
|[ERROR] [DPDK] Error with EAL initialization|
|[ERROR] [UHD] Device discovery error: RuntimeError: Error with EAL
initialization|
|EAL: FATAL: already called initialization.|
|EAL: already called initialization.|
|Error: LookupError: KeyError: No devices found for ----->|
|Device Address:|
|addr: 10.10.1.100|
|second_addr: 10.10.2.100|
|mgmt_addr: 10.10.0.100|
|master_clock_rate: 125e6|
|use_dpdk: 1|
|[ERROR] [DPDK] Error with EAL initialization|
|[ERROR] [X300] X300 Network discovery error RuntimeError: Error with
EAL initialization|
root@bm-super11-intel:/home/ad#
USRP-users mailing list --usrp-users@lists.ettus.com
To unsubscribe send an email tousrp-users-leave@lists.ettus.com
IF you do all of that, but at a lower rate, and NOT using DPDK, what
happens?
Have you confirmed the actual IP addresses of your network interfaces?
Have you confirmed that you haven't swapped
cables?
Can you ping the individual IPs of the USRP?