Empathy List Archives

H

h57jafari@gmail.com

Tue, Apr 4, 2023 4:48 AM

Hello,

I am trying to integrate USRP-X410 with XL710 intel PCIe NIC card through QSFP ports.

LED on both sides is off and I cannot ping USRP (192.168.10.2 and 192.168.20.2) through XL710. PCI card ports can be ping successfully, as IP addresses configured in the same subnetwork. Therefore, it seems link cannot establish between USRP-X410 and XL710 NIC. I think, it may because of rate mismatch between USRP-X410 and XL710 NIC card. (While USRP X410 with QSFP28 supports 10GE and 100GE, XL710 with QSFP+ only supports 40GE). Is there any way of auto-negotiating for speed in USRP, or other solution to help overcome this issue. Thank you.

Here is my hardware setup.

- Ubuntu 22.04

- USRP X410

- UHD v4.4.0.0

- GNU radio v3.10.5.1

- Dual Port 40G QSFP+ NIC - Intel XL710

- 40G QSFP+ DAC Cable - 40GBASE-CR4 Passive Direct Attach Copper Twinax QSFP Cable (from 10Gtek)

BTW, I tried both X4_200 (10GE) and CG_400 (100GE) FPGA flavors, but still same problem.

Hello, I am trying to integrate USRP-X410 with XL710 intel PCIe NIC card through QSFP ports. LED on both sides is off and I cannot ping USRP (192.168.10.2 and 192.168.20.2) through XL710. PCI card ports can be ping successfully, as IP addresses configured in the same subnetwork. Therefore, it seems link cannot establish between USRP-X410 and XL710 NIC. I think, it may because of rate mismatch between USRP-X410 and XL710 NIC card. (While USRP X410 with QSFP28 supports 10GE and 100GE, XL710 with QSFP+ only supports 40GE). Is there any way of auto-negotiating for speed in USRP, or other solution to help overcome this issue. Thank you. Here is my hardware setup. \- Ubuntu 22.04 \- USRP X410 \- UHD v4.4.0.0 \- GNU radio v3.10.5.1 \- Dual Port 40G QSFP+ NIC - Intel XL710 \- 40G QSFP+ DAC Cable - 40GBASE-CR4 Passive Direct Attach Copper Twinax QSFP Cable (from 10Gtek) BTW, I tried both X4_200 (10GE) and CG_400 (100GE) FPGA flavors, but still same problem.

RK

Rob Kossler

Tue, Apr 4, 2023 6:15 PM

There is a persistent setting on the XL710 such that it can be either
40GBASE or 4x10GBASE. Intel has a utility that you can use to program this
setting. Perhaps this is the issue for you?
Rob

On Tue, Apr 4, 2023 at 1:43 PM h57jafari@gmail.com wrote:

Hello,

I am trying to integrate USRP-X410 with XL710 intel PCIe NIC card through
QSFP ports.

LED on both sides is off and I cannot ping USRP (192.168.10.2 and
192.168.20.2) through XL710. PCI card ports can be ping successfully, as IP
addresses configured in the same subnetwork. Therefore, it seems link
cannot establish between USRP-X410 and XL710 NIC. I think, it may because
of rate mismatch between USRP-X410 and XL710 NIC card. (While USRP X410
with QSFP28 supports 10GE and 100GE, XL710 with QSFP+ only supports 40GE).
Is there any way of auto-negotiating for speed in USRP, or other solution
to help overcome this issue. Thank you.

Here is my hardware setup.

```
     Ubuntu 22.04
```
```
     USRP X410
```
```
     UHD v4.4.0.0
```
```
     GNU radio v3.10.5.1
```

     Dual Port 40G QSFP+ NIC - Intel XL710

     40G QSFP+ DAC Cable - 40GBASE-CR4 Passive Direct Attach Copper

Twinax QSFP Cable (from 10Gtek)

BTW, I tried both X4_200 (10GE) and CG_400 (100GE) FPGA flavors, but still
same problem.

USRP-users mailing list -- usrp-users@lists.ettus.com
To unsubscribe send an email to usrp-users-leave@lists.ettus.com

There is a persistent setting on the XL710 such that it can be either 40GBASE or 4x10GBASE. Intel has a utility that you can use to program this setting. Perhaps this is the issue for you? Rob On Tue, Apr 4, 2023 at 1:43 PM <h57jafari@gmail.com> wrote: > Hello, > > I am trying to integrate USRP-X410 with XL710 intel PCIe NIC card through > QSFP ports. > > LED on both sides is off and I cannot ping USRP (192.168.10.2 and > 192.168.20.2) through XL710. PCI card ports can be ping successfully, as IP > addresses configured in the same subnetwork. Therefore, it seems link > cannot establish between USRP-X410 and XL710 NIC. I think, it may because > of rate mismatch between USRP-X410 and XL710 NIC card. (While USRP X410 > with QSFP28 supports 10GE and 100GE, XL710 with QSFP+ only supports 40GE). > Is there any way of auto-negotiating for speed in USRP, or other solution > to help overcome this issue. Thank you. > > Here is my hardware setup. > > - Ubuntu 22.04 > > - USRP X410 > > - UHD v4.4.0.0 > > - GNU radio v3.10.5.1 > > - Dual Port 40G QSFP+ NIC - Intel XL710 > > - 40G QSFP+ DAC Cable - 40GBASE-CR4 Passive Direct Attach Copper > Twinax QSFP Cable (from 10Gtek) > > BTW, I tried both X4_200 (10GE) and CG_400 (100GE) FPGA flavors, but still > same problem. > _______________________________________________ > USRP-users mailing list -- usrp-users@lists.ettus.com > To unsubscribe send an email to usrp-users-leave@lists.ettus.com >

H

h57jafari@gmail.com

Tue, Apr 4, 2023 6:38 PM

Thank you Rob,

In USRP-X410 I can load X4_200 FPGA image to set QSFP28 port 0 interface to 4*10G, and as you said I need to set XL710-NIC similarly with some utility tools. Does that mean I do not need any extra adaptor between them for rate/protocol match.

please correct me for the following step:

1- then for connection between USRP-X410 and XL710-NIC in such 4*10G configuration, does this cable works:

40G QSFP+ DAC Cable - 40GBASE-CR4 Passive Direct Attach Copper Twinax QSFP Cable (from 10Gtek)

2- Do I need other settings in USRP-X410 or XL710-NIC sides to establish communication links.

3- I assume I may need also install DPDK later.

Thank you for support.

Thank you Rob, In USRP-X410 I can load X4_200 FPGA image to set QSFP28 port 0 interface to 4\*10G, and as you said I need to set XL710-NIC similarly with some utility tools. Does that mean I do not need any extra adaptor between them for rate/protocol match. please correct me for the following step: 1- then for connection between USRP-X410 and XL710-NIC in such 4\*10G configuration, does this cable works: 40G QSFP+ DAC Cable - 40GBASE-CR4 Passive Direct Attach Copper Twinax QSFP Cable (from 10Gtek) 2- Do I need other settings in USRP-X410 or XL710-NIC sides to establish communication links. 3- I assume I may need also install DPDK later. Thank you for support.

RK

Rob Kossler

Tue, Apr 4, 2023 6:57 PM

Unfortunately, I don't really know. I do not have an X410. However, I do
have an N321 which has both a QSFP+ port and two SFP+ ports. I use the SFP+
ports with a 4x10Gb breakout cable (either fiber or copper) and the XL710
NIC. But, it is my understanding that the N321 QSFP+ port is configured to
operate as 4x10Gbe (but use only 2 of the 4 lanes available on the
interface). I don't really know if your cable will work but it seems to me
like it should....
Rob

On Tue, Apr 4, 2023 at 2:39 PM h57jafari@gmail.com wrote:

Thank you Rob,

In USRP-X410 I can load X4_200 FPGA image to set QSFP28 port 0 interface
to 4*10G, and as you said I need to set XL710-NIC similarly with some
utility tools. Does that mean I do not need any extra adaptor between them
for rate/protocol match.

please correct me for the following step:

1- then for connection between USRP-X410 and XL710-NIC in such 4*10G
configuration, does this cable works:

40G QSFP+ DAC Cable - 40GBASE-CR4 Passive Direct Attach Copper Twinax
QSFP Cable (from 10Gtek)

2- Do I need other settings in USRP-X410 or XL710-NIC sides to establish
communication links.

3- I assume I may need also install DPDK later.

Thank you for support.

USRP-users mailing list -- usrp-users@lists.ettus.com
To unsubscribe send an email to usrp-users-leave@lists.ettus.com

Unfortunately, I don't really know. I do not have an X410. However, I do have an N321 which has both a QSFP+ port and two SFP+ ports. I use the SFP+ ports with a 4x10Gb breakout cable (either fiber or copper) and the XL710 NIC. But, it is my understanding that the N321 QSFP+ port is configured to operate as 4x10Gbe (but use only 2 of the 4 lanes available on the interface). I don't really know if your cable will work but it seems to me like it should.... Rob On Tue, Apr 4, 2023 at 2:39 PM <h57jafari@gmail.com> wrote: > Thank you Rob, > > In USRP-X410 I can load X4_200 FPGA image to set QSFP28 port 0 interface > to 4*10G, and as you said I need to set XL710-NIC similarly with some > utility tools. Does that mean I do not need any extra adaptor between them > for rate/protocol match. > > please correct me for the following step: > > 1- then for connection between USRP-X410 and XL710-NIC in such 4*10G > configuration, does this cable works: > > 40G QSFP+ DAC Cable - 40GBASE-CR4 Passive Direct Attach Copper Twinax > QSFP Cable (from 10Gtek) > > 2- Do I need other settings in USRP-X410 or XL710-NIC sides to establish > communication links. > > 3- I assume I may need also install DPDK later. > > Thank you for support. > _______________________________________________ > USRP-users mailing list -- usrp-users@lists.ettus.com > To unsubscribe send an email to usrp-users-leave@lists.ettus.com >

H

h57jafari@gmail.com

Tue, Apr 4, 2023 7:50 PM

Hi Rob, thank you for the comments.

I checked with StarTech support team (the manufacturer of XL710 NIC, B07983NGQH). But they are saying that it does not have the functionality to set as 4*10G.

I was wondering what model of XL710 NIC do you have that worked or what is the utility tool you mentioned. Thank you.

Hi Rob, thank you for the comments. I checked with StarTech support team (the manufacturer of XL710 NIC, B07983NGQH). But they are saying that it does not have the functionality to set as 4\*10G. I was wondering what model of XL710 NIC do you have that worked or what is the utility tool you mentioned. Thank you.

RK

Rob Kossler

Tue, Apr 4, 2023 8:12 PM

I have only used the Intel cards such as Intel XL710-QDA1 or Intel
XL710-QDA2 and I think that the utility is the following:

https://www.intel.com/content/www/us/en/download/18190/non-volatile-memory-nvm-update-utility-for-intel-ethernet-network-adapter-700-series.html

On Tue, Apr 4, 2023 at 3:52 PM h57jafari@gmail.com wrote:

Hi Rob, thank you for the comments.

I checked with StarTech support team (the manufacturer of XL710 NIC,
B07983NGQH). But they are saying that it does not have the functionality to
set as 4*10G.

I was wondering what model of XL710 NIC do you have that worked or what is
the utility tool you mentioned. Thank you.

USRP-users mailing list -- usrp-users@lists.ettus.com
To unsubscribe send an email to usrp-users-leave@lists.ettus.com

I have only used the Intel cards such as Intel XL710-QDA1 or Intel XL710-QDA2 and I think that the utility is the following: https://www.intel.com/content/www/us/en/download/18190/non-volatile-memory-nvm-update-utility-for-intel-ethernet-network-adapter-700-series.html On Tue, Apr 4, 2023 at 3:52 PM <h57jafari@gmail.com> wrote: > Hi Rob, thank you for the comments. > > I checked with StarTech support team (the manufacturer of XL710 NIC, > B07983NGQH). But they are saying that it does not have the functionality to > set as 4*10G. > > I was wondering what model of XL710 NIC do you have that worked or what is > the utility tool you mentioned. Thank you. > _______________________________________________ > USRP-users mailing list -- usrp-users@lists.ettus.com > To unsubscribe send an email to usrp-users-leave@lists.ettus.com >

H

h57jafari@gmail.com

Tue, Apr 4, 2023 8:18 PM

Thank you so much Rob!

P

perper@o2.pl

Fri, Apr 7, 2023 4:48 PM

Hello,

If you succeed to run X410 together with Intel QSFP+ or QSFP28 card please let everyone know.
I couldn’t find information if anybody did that.

Wade Fife pointed out that someone tried with QSFP28 network adapter from Intel but had problems:
https://lists.ettus.com/empathy/thread/IA2YCIJTQOEPNJOPF3AJUXC3I6ONRCJR

Best Regards,
Piotr Krysik

Hello, If you succeed to run X410 together with Intel QSFP+ or QSFP28 card please let everyone know.\ I couldn’t find information if anybody did that. Wade Fife pointed out that someone tried with QSFP28 network adapter from Intel but had problems:\ https://lists.ettus.com/empathy/thread/IA2YCIJTQOEPNJOPF3AJUXC3I6ONRCJR Best Regards,\ Piotr Krysik

H

h57jafari@gmail.com

Fri, Apr 7, 2023 5:04 PM

Hi Piotr,

I tried to using “Intel® QSFP+ Configuration Utility” to configure XL710 NIC card from current 40GbE to 4*10GbE. But as I mentioned earlier, because my card is not from intel directly, it is actually from one of OEM. So it does not support this functionality, here is the error:

“QSFP+ Configuration modification is not supported by this adapter.”

I am going to return the NIC card and buy different one. Thank you.

Hi Piotr, I tried to using “Intel® QSFP+ Configuration Utility” to configure XL710 NIC card from current 40GbE to 4\*10GbE. But as I mentioned earlier, because my card is not from intel directly, it is actually from one of OEM. So it does not support this functionality, here is the error: “QSFP+ Configuration modification is not supported by this adapter.” I am going to return the NIC card and buy different one. Thank you.

usrp-users@lists.ettus.com

Integrate USRP-X410 with XL710 intel PCIe NIC card through QSFP ports