10G Network

[Poppapete 104]

My latest PC build having a 10G nic, I bought a 10G card for my server and a 10G switch and set them up as per diagram. Both the PC and the server connections to the 10G switch show the 10G LED color but I cannot get 10G speeds.

 

Any thoughts!? I see I have the NICs wrongly labeled.  I do have the 10G NICs connected to the 10G switch.

 

10G server card is ASUS XG-C100C - Aquantia to match the aquantia in the PC.

Switch is a netgear XS505M

All 10G cables are Cat6A

Edited February 22, 2018 by Poppapete

[itGeeks 181]

I have never messed around with 10G. Qwestions-

 

1) Is that a typo on your diagram? It looks like you have the 1G NICs going to the 10G switch and the 10G NICs going to the 1G switch. Never mind this question, I see it's a typo.

2) How are you testing the speed? If you could get a 4K file and do a file copy you should be seeing roughly 610MB/s is the best your going to get with that Asus card according to my resirch. The Intel the (gold standard) will get you around 825MB/s

 

3) What is the speed your seeing?

4) could your hard drives be the bottleneck? Check the read & write speeds of the drives in both systems, Your not going to go faster then that..

 

5) Are the drives SSD's or spinners?

Edited February 23, 2018 by itGeeks

[Poppapete 104]

2) I started with simple ping from the CMD.  I get no ping via the 10G

3) ditto

4-5) ditto - I only have 960 pros in the desktop and enterprise spinning drives in the file server

[mattb75 15]

What happens if you disconnect the server and the pc from the 24port 1G Switch - just leaving the 10G connections in place?

[schoondoggy 783]

Why do you have two network connections for each device? As stated above, I would drop the 1Gb connections.

If I remember correctly I got around 1100MB/s testing point to point. You need to setup ramdisk to test.

 

[JackoUK 40]

Another non-networking-expert offering tentative suggestions.

 

1. One problem at a time. I'd remove the 1G NIC's and try to copy a large video file from the SSD on the PC to the SSD on the server.

2. "Multiple NIC's in a Windows PC" would seem to me to qualify for a project under the boss' Looking for Creators idea. I suspect there are many forum members who would like information on this topic.

3. Researching - and documenting the results of your research - starting at (say) https://support.microsoft.com/en-us/help/175767/how-multiple-adapters-on-the-same-network-are-expected-to-behave would seem to be essential.

4. Wild guess. use 2 subnet masks directing external traffic to the lesser NIC and high bandwidth local traffic to the greater NIC.

[itGeeks 181]

Correct and good points, I have seen where someone had two NICs plugged in on the same subnet and that caused problems. Great suggestions here and an interesting topic.

 

For a nice review comparing the Asus to the Intel X540T with benchmarks, Check it out

[JackoUK 40]

First trawl ...

 

https://blogs.technet.microsoft.com/josebda/2010/09/03/using-the-multiple-nics-of-your-file-server-running-windows-server-2008-and-2008-r2/

https://blogs.technet.microsoft.com/josebda/2012/06/28/the-basics-of-smb-multichannel-a-feature-of-windows-server-2012-and-smb-3-0/

https://blogs.technet.microsoft.com/bobh/2012/10/08/technet-radio-smb-multi-channel-basics-for-windows-server-2012-and-smb-3-0/

https://www.howtogeek.com/howto/27994/how-to-change-the-priority-of-wiredwireless-network-cards-in-windows/

http://www.cinevate.com/blog/confessions-of-a-10-gbe-network-newbie-part-1-basics/

https://www.petri.com/managing-smb-multichannel

https://blog.chaospixel.com/linux/2016/09/samba-enable-smb-multichannel-support-on-linux.html

 

Cinevate stuff looks promising.

[schoondoggy 783]

First trawl ...

 

https://blogs.technet.microsoft.com/josebda/2010/09/03/using-the-multiple-nics-of-your-file-server-running-windows-server-2008-and-2008-r2/

https://blogs.technet.microsoft.com/josebda/2012/06/28/the-basics-of-smb-multichannel-a-feature-of-windows-server-2012-and-smb-3-0/

https://blogs.technet.microsoft.com/bobh/2012/10/08/technet-radio-smb-multi-channel-basics-for-windows-server-2012-and-smb-3-0/

https://www.howtogeek.com/howto/27994/how-to-change-the-priority-of-wiredwireless-network-cards-in-windows/

http://www.cinevate.com/blog/confessions-of-a-10-gbe-network-newbie-part-1-basics/

https://www.petri.com/managing-smb-multichannel

https://blog.chaospixel.com/linux/2016/09/samba-enable-smb-multichannel-support-on-linux.html

 

Cinevate stuff looks promising.

The cinevate blog posts are very good. Part 2 is about testing: http://www.cinevate.com/blog/confessions-of-a-10-gbe-network-newbie-part-2-test-toolkit/

 

[Poppapete 104]

16 hours ago, mattb75 said:

What happens if you disconnect the server and the pc from the 24port 1G Switch - just leaving the 10G connections in place?

If I remove the 1G nics from the setup I cannot ping the server over the 10G nics and I loose access to the world.