10GBase-T Peer to Peer Configuration | Solvedish

[N3rdDadTV]

Hello, I'm hoping that you mad lads might be able to offer me some assistance. Long story short LMG inspired me to my own production company a few years ago and now I finally can afford to have employees. In order to maximize efficiency I'm setting up a peer to peer 10G network configuration but I'm not having any luck with getting the connection to have the throughput when functioning or even functioning at all. 

 

I need to keep them connected to the outbound internet through their onboard nics and have the file sharing through windows go through the 10Gig adapters. 

I've set static ip's on the 10G nics with a different subnet than my outbound network and even directed the gateways at each other still with no luck. 

After following a guide I made changes to the host files and setup jper to test the throughput without filesharing and now I can't even ping the other adapter. 

 

I installed XG-C100C 10G Cards from Asus in both workstations and have tried several different cables. I even checked to make sure there wasn't any issues with PCIE bandwith and both cards show a Pcie 2.0 link of 8GT/s so I'm good there. What is it about windows networking that when I tell it to use a specific adapter for a specific purpose it just stops doing anything? 

 

[AbydosOne]

6 minutes ago, N3rdDadTV said:

and even directed the gateways

Leave gateways blank.

 

7 minutes ago, N3rdDadTV said:

but I'm not having any luck with getting the connection to have the throughput when functioning or even functioning at all. 

Does ping work at all? What are you using to test?

[N3rdDadTV]

Left Gateways blank to start with, no ping using powershell or cmd for ping test and jperf for throughput. Couldn't get jper to see client/server. 

[mariushm]

If you still have no luck after all the advice here, make a proper crossover network cable, just in case the card's autodetection fails and they don't agree on how to exchange data

 

The crossover formats are on the right side of the picture, pick one of them. 

 

[N3rdDadTV]

2 minutes ago, mariushm said:

If you still have no luck after all the advice here, make a proper crossover network cable, just in case the card's autodetection fails and they don't agree on how to exchange data

 

The crossover formats are on the right side of the picture, pick one of them. 

 

Thanks I'll give this a try next, I only have Cat5e connectors but that shouldn't be a bottleneck I wouldn't think. 

[mr fobs]

2 minutes ago, N3rdDadTV said:

 I only have Cat5e connectors but that shouldn't be a bottleneck I wouldn't think. 

Well.. CAT5e is limited to 1000 Mpbs.

 

You would need CAT 6a for true 10G

[N3rdDadTV]

Is that just for crossover, I understood Cat5e to support 10Gig upto 45 meters

[mariushm]

For short lengths, the connectors themselves being cat5e is not an issue.

The cable itself can be Cat6 for less than 55 meters (I would say less than 30-40 meters), for anything longer up to 100 meters you need Cat6a cable.

 

For very short lengths like 3 meters, you'd probably do 10gbps through cat5e cable, with none or very few transfer errors (auto corrected if using tcp/ip)

 

Doesn't matter if it's straight or crossover, it's a thing about quality of the wires, how precise each two wires are twisted along the length of the cable, how the pairs are insulated/shielded from the other pairs so that "noise" from one pair doesn't affect the signals from other pairs. 

 

The standards are designed to go up to 100 meters, so the network cards have to be smart enough and transmit the signals with enough power that the signal at the other end of 100 meters of cable will still have enough strength ... and cards have to accept some signal degradation... hence why a Cat6 rated cable can be used up to 55 meters according to standard (but like I said, I personally don't recommend more than 30-40 meters).

 

But with very short lengths of cables there won't be much signal degradation and that's why I say that most likely for very short lengths of cable even cat5e cable should work reasonably well.  Cat6 and Cat6a cable is quite cheap though, no reason not to go and buy a few meters of cable.

[N3rdDadTV]

Just tried the crossover cable and after a reboot the nic in the secondary workstation shows to have the latest drivers and just doesn't work. 

 

[Alex Atkin UK]

1 hour ago, N3rdDadTV said:

Just tried the crossover cable and after a reboot the nic in the secondary workstation shows to have the latest drivers and just doesn't work. 

 

Do the network adapters show the link is connected?  What IP ranges are you using?  It can often be a really simple mistake but unless we know EXACTLY what you've done rather than a vague "I set it to a different subnet", we haven't a clue.

 

If the network appears to be otherwise up but no connectivity then check the network is set to private in Windows on both clients.  The firewall will block them talking to each other if its defaulted to public.

[N3rdDadTV]

Just switched back to Cat6 Patch cable and both show link, I changed the local security profiles to change unidentified networks as private networks and can get a ping between both machines!!!!! When I run jperf the client doesn't connect to the server. 

[N3rdDadTV]

This is Config A the 10G adapter is on the left

 

[N3rdDadTV]

This is my config for setup B

[AbydosOne]

Just now, N3rdDadTV said:

This is Config A the 10G adapter is on the left

Someone who's better at subnet masks can correct me, but wouldn't 255.255.252.0 include both 192.168.1.x and 192.168.2.x?

 

You should probably be using 255.255.255.0 unless you really know what's going on here.

[N3rdDadTV]

In both instances File and Print Sharing is turned off on the 2.5G adapters and on the 10G adapters. 

[N3rdDadTV]

Just changed it back to 255, tried 252 when shared 2.5G Apaters connection with 10G and still no luck. 

[mariushm]

You have multiple private classes you can use, you don't have to stick to 192.168.x.x

 

you can use

 

10.0.0.0 – 10.255.255.255

172.16.0.0 – 172.31.255.255

192.168.0.0 – 192.168.255.255

 

So for example, you could go with  172.16.0.1  and 172.16.0.2   and subnet mask 255.255.255.0 on both

 

 

[N3rdDadTV]

Same characteristics when I use these addresses where I can ping the other pc but no network traffic through jperf or visibility on file explorer. 

3 hours ago, mariushm said:

You have multiple private classes you can use, you don't have to stick to 192.168.x.x

 

you can use

 

10.0.0.0 – 10.255.255.255

172.16.0.0 – 172.31.255.255

192.168.0.0 – 192.168.255.255

 

So for example, you could go with  172.16.0.1  and 172.16.0.2   and subnet mask 255.255.255.0 on both

 

 

 

[Alex Atkin UK]

4 hours ago, N3rdDadTV said:

Same characteristics when I use these addresses where I can ping the other pc but no network traffic through jperf or visibility on file explorer. 

 

Does it ask you to turn file sharing on?

 

Don't know about jperf, I always use iperf3 from the console.

[N3rdDadTV]

40 minutes ago, Alex Atkin UK said:

Does it ask you to turn file sharing on?

 

Don't know about jperf, I always use iperf3 from the console.

No I enabled file sharing on private networks and changed the local security services to change unidentified networks to private networks

[Alex Atkin UK]

1 hour ago, N3rdDadTV said:

No I enabled file sharing on private networks and changed the local security services to change unidentified networks to private networks

Ignoring jperf for now, you have shared some drives/folders right?  Then try putting the IP address of the shared folders PC into explorer on the other PC like \\192.168.2.2\ to see if it shows them?

If both PCs can see each other on the main network you generally have to go via IP to make sure its using the right NIC, though that doesn't explain jperf but that's less important if we can determine if file sharing is working.

[N3rdDadTV]

I tried that still no luck, the next step I was trying was to edit the host file to redirect traffic to the right adapter although my understanding of this concept is basic at best. 

 

[mariushm]

Can you try setting up a FTP server on one of the computers?

For example, try installing Filezilla FTP server on one computer.

 

By default it will listen on all interfaces but you can configure it to listen only on the 10g interface from the options > General Settings > IP bindings section.

 

Don't forget to add the filezilla server executable (or whatever ftp server) in the firewall and allow private (and optionally) public networks access.

 

Once you're done, try connecting to it using the private IP (and port) from the other computer and see if you get some data exchanged between the computers.

[N3rdDadTV]

Client times out when trying ftp through local IP only. 

[N3rdDadTV]

I'm starting to think I may have a hardware issue, my most recent attempts have had me creating static routes using netstat through powershell with still no luck. I can get the cards to ping each other but not much more than that.