Link Aggregation Issues

[Guest]

Hi all,

 

So this problem has quite a few network engineers puzzled and none of us can work it out.

 

HP ML server with added Broadcomm enterprise dual 1gig NIC with LACP/address hash, Server 2012 R2 DC.

 

Ubiquiti EdgeSwitch, 2 ports into a port channel running load balanced based off rule #5. 

 

(UBNT EdgeSwitch) (Config)#port-channel load-balance ?

1                        Src MAC, VLAN, EType, incoming port
2                        Dest MAC, VLAN, EType, incoming port
3                        Src/Dest MAC, VLAN, EType, incoming port
4                        Src IP and Src TCP/UDP Port fields
5                        Dest IP and Dest TCP/UDP Port fields
6                        Src/Dest IP and TCP/UDP Port fields
7                        Enhanced hashing mode

 

If I run 2 different file transfers to 2 different clients, I'll get about 110MB/s for each of them for the first 30-40 seconds then the speed will drop to about 55MB/s per client, totalling gigabit speeds. 

 

MTU's are all set at 9014 which is the only option the Broadcomm NIC's give that high. I have a feeling it might be a firmware issue with the switch but besides that, any ideas?

 

Also - I've got a QNAP runnuning 802.3ad with the same switch and same switch group rules without issue. 

[leadeater]

Does this happen in both directions? File copy from server to client and file copy from client to server?

 

Have you tried these Server 2012 R2 team settings?

Teaming mode: LACP

Load balancing mode: Dynamic

 

Dynamic is the default and is recommended to always be used. 

 

Quote

Dynamic:  Uses the source and destination TCP ports and the IP addresses to create a hash for outbound traffic.  Moves outbound streams from team member to team member as needed to balance team member utilization

 

Also check with perfmon for the physical NIC counters to verify if it is actually using only 1 NIC.

Edited May 31, 2016 by leadeater

[Guest]

7 hours ago, leadeater said:

Does this happen in both directions? File copy from server to client and file copy from client to server?

 

Have you tried these Server 2012 R2 team settings?

Teaming mode: LACP

Load balancing mode: Dynamic

 

Dynamic is the default and is recommended to always be used. 

 

 

Also check with perfmon for the physical NIC counters to verify if it is actually using only 1 NIC.

Already tried with dynamic, doesn't work, only address hash showed me any sort of speed increase