LACP teaming

[jameyscott]

So, I've currently got my three computers connected via a TP-Link SG2008.  It's a great switch, especially for the price I paid, but at this point I was thinking of upgrading to add addition gigabit connections between all systems.  Now, I know that it technically won't give me 6Gbps if I have 6 gigabit Ethernet cables going from all devices, but how much could I feasibly get assuming that I am not bottlenecked by drive speed?  This is just a lower cost alternative to going to 10Gb, which is just not "consumer" ready yet.  I would definitely prefer it, but 3 NICs + a switch would take a pretty penny that I don't want/have to spend. 

 

I understand the true design of LACP was to increase throughput for multiple devices, which is the main reason I am upgrading.  (Multiple Plex streams, plus back ups from my two main desktops to the NAS (third computer), and all of my media is located on the NAS.) However, I would like to see increased speeds as well since I will be adding a 8TB Raid 0 array to it as well.  Which feasibly could put me at over 300MBps, but I was just wondering if that's something that is something that is feasibly attainable via 4Gb/6GB interconnection.

 

If I need to explain further what I'm trying to do, please let me know.

[KTFO|SGTmoody]

So, I've currently got my three computers connected via a TP-Link SG2008.  It's a great switch, especially for the price I paid, but at this point I was thinking of upgrading to add addition gigabit connections between all systems.  Now, I know that it technically won't give me 6Gbps if I have 6 gigabit Ethernet cables going from all devices, but how much could I feasibly get assuming that I am not bottlenecked by drive speed?  This is just a lower cost alternative to going to 10Gb, which is just not "consumer" ready yet.  I would definitely prefer it, but 3 NICs + a switch would take a pretty penny that I don't want/have to spend. 

 

I understand the true design of LACP was to increase throughput for multiple devices, which is the main reason I am upgrading.  (Multiple Plex streams, plus back ups from my two main desktops to the NAS (third computer), and all of my media is located on the NAS.) However, I would like to see increased speeds as well since I will be adding a 8TB Raid 0 array to it as well.  Which feasibly could put me at over 300MBps, but I was just wondering if that's something that is something that is feasibly attainable via 4Gb/6GB interconnection.

 

If I need to explain further what I'm trying to do, please let me know.

 

Hello!

 

Are you just doing this on the switch above ?  it only has 8 ports....  (ok i think you answared this in your second paragraph )

 

Can you just confirm what the network layout is?  how many switches ext.  

If you want to have 6Gbs on each connection per PC,   From what your syaing your thinking of having multiple NICs  using link aggregation.  This I dont think you can do because they are multiple NIC cards and especialy in windows you cant Aggregate two or more network cards togeather. 

 

If you put multiple network cards in a machine and connect them all up to the switch you would not get 4, 6 or what ever Gbps because each would get their own IP address.  Thus giving you multiple 1GBs links that trafic can go down.

 

You need to be looking at getting a network card that has 4, 1GBs ports on it that supports Link Aggregation.

And a switch with enough ports to be able to deal with these multiple Aggregated links.  Some only support say 4 Aggregate connections.  For exapmple the switch you mentioned supports 6 Aggregate groups and up to 4 ports each in each Aggregate.

 

So there will be some reaseach involved!

 

What your trying to do will work.  You just need the right kit to do it.

 

 

 

I Think this covers what your asking?

[jameyscott]

Yes, that does help me.  The switch below is the one I am looking at getting. 

 

http://www.tp-link.com/en/products/details/?model=TL-SG1024DE#spec 

 

This is the quad Ethernet card that I will be getting as well. Intel PRO/1000PT Quad Port Gigabit Ethernet Network Adapter EXPI9404PTBLK 

 

I currently have the two port version in my NAS and using the dual intel NICs on my X79 Dark for connectivity. 

 

I have tried teaming my two port version with the onboard intel NIC in my NAS and it works just fine, but the onboard didn't support Receive Side Scaling, so I left it at the current connection, so it is possible to team two different, but similar cards.  If not, 4Gb should work well enough. 

 

 

For my new network, it would be that quad ethernet NIC in all three of my systems connected to that switch I linked above. If I am able to run the dual NIC card I currently have teamed with the quad NIC I plan on getting, that's great, if not.  Oh well. 

 

I have been doing some research, but network connectivity is a bit above my head. I'm trying to keep my solution as simple as possible, but there is a bit of a learning curve as far as this goes.

[flexin1981]

Hey Jameyscott

 

This wont give you anywhere near the bandwidth that you are expecting, the issue here is that this technology was invented for larger organisations.

 

As such the algorithm that load balances over the physical links uses a hashing of anything from just the source IP of the packet right through to the source IP, destination IP and the ports to choose the link. worst case is if it is just the source IP then you will only ever use one link as the hash will always come out the same. Best case it uses the ports and it can be a bit more random. 

 

This was always designed for switch to switch communication as there is many IP's/ports flowing over the bundled link and then the law of averages will even things out.

[jameyscott]

No, I completely understand that.  As I stated in my OP, "I understand the true design of LACP was to increase throughput for multiple devices, which is the main reason I am upgrading. "

 

I have many things going on in my home office, and I'm not expecting 6Gbps transfer rated between all of my systems.  I know that just isn't going to happen unless I go with 10Gb NICs and a switch.

[flexin1981]

so what is the goal here,

 

if this is to increase the bandwidth you may just be burning cash if the device only supports source IP hashing on the LACP then you would only ever use a single link from the bundle anyway and therefore only get the gig that you had anyway (minus the LACP overhead of course).

 

maybe I have missed something here 

[jameyscott]

Correct me if I'm wrong, but as long as the device(s) support Level 4 Load Balancing, I'll be able to achieve what I want, which is as follows.

 

With as many devices as I have connected to my NAS, I want to increase the overall throughput it can put out.  I have multiple Plex streams going at the same time, and I have all of my game library on my NAS as well.  I want to be able to access all of that without a hitch.  Yes, I do want to increase overall transfer rates (better loading times in games), but I'm not expecting to be able to get a full 6Gb out of LACP.

[flexin1981]

LACP is not load balancing,

 

it is link aggregation, for it to do the best job it would need to negotiate at both the device end and the switch end. You can windows team at the device end only if you wish but this would only be aggregation outbound.

 

If you are expecting the inbound connections to be aggregated to the NAS then it is vital that the switch is LACP compatible or again you would be limited to only one inbound link for all the connections.

 

Lets assume that you you have the most optimal conditions and that you have 2 workstations connecting to the one NAS and the NAS had a 4 port LAG and the LACP algorithm chooses a different port for each machine you are still going to be limited by that port for that connection. It is not true load balancing it does not send one frame down one link then the next frame down another link, that connection is still limited by that link speed, and the chances are that all connections from that machine to the NAS will go down that same link.

 

In reality unless you are connecting two switches together then LACP really isn't going to do much for you.  

[jameyscott]

The switch I currently have is capable of Link Aggregation and so is the one I plan on switching to.

 

I think we are having a bad time communicating due to my lack of knowledge when it comes to networking.  I've been trying to learn as much as I can, though.

 

 

I've emailed TP-Link about the SG1024DE to see if it can do what I want, if not I also asked for what switch they would recommend for what I need.

 

As far as the card I'm going to use, I figured I would just go with the one I linked above since I have actually seen above the 125ish MB write speed that I would be bound to if I was running a single gigabit connection, although I can't truly test it unless I threw in an SSD to see if my current configuration is doing what I think it is. I'll try that and see if my current gear is actually capable of what I think it is.

 

 

Do you have suggestions on switches/NICs that I should use?  I'm really open in both learning about what I need and actually getting what I need, because I need/want this set up. If you need more details about what I currently have, or what I"m trying to do, please let me know.  I really just want to get this done right.

[KTFO|SGTmoody]

The only other option that would trump what your trying to do is Fibre Channel.  This is purely designed for storage networks.  You can easly get 4 - 8 gig cards and switches fearly cheaply now if they are used.  

 

For example you would need:

 

FC switch : http://www.ebay.co.uk/itm/GH640-McData-Sphereon-ES-4700-4Gbps-1U-Fiber-Channel-Switch-/141541829942?pt=LH_DefaultDomain_0&hash=item20f48ced36

 

SFP modules : http://www.ebay.co.uk/itm/Brocade-4GB-SW-Fibre-Channel-FC-SFP-Module-Transceiver-57-1000013-01-300-/301486122519?pt=UK_Computing_Network_Switches&hash=item4631f92617

 

Fibre channel PCIe card:  http://www.ebay.co.uk/itm/NEW-Dell-KD414-4Gb-Single-Chanel-PCi-e-x4-Fibre-Chanel-Host-Bus-Adapter-New-/281519750765?pt=UK_Computing_ComputerComponents_InterfaceCards&hash=item418be27e6d

 

And some Multimode OM3 LC- LC Fibre 

 

You would have to configure the switch but the Brocade ones come with a web management panel any way so its not that hard.    Its up to you  the fibre chanel is just a suggestion. its up to you.

[jameyscott]

Wow... That would be perfect...

Ill look into that more. Thank you so much for the suggestion.

[jameyscott]

I've been reading up a bit, and it seems that certain sfp modules are not compatible with just any switch.  Will those SFP modules that you linked work with the switch you linked?  I can't seem to find a compatibility matrix for the switch.

[KTFO|SGTmoody]

I've been reading up a bit, and it seems that certain sfp modules are not compatible with just any switch.  Will those SFP modules that you linked work with the switch you linked?  I can't seem to find a compatibility matrix for the switch.

Honestly I dont know. i didnt look in to compatibilty.  The links where more for examples rather than this is definatly what you should get..

Normaly I buy the Finsar branded ones they seem to work.  But you are right, some SFP modules are not compatible with what they get pluged in to.

 

If i was to buy a fibre chanel switch i would go with  EMC branded one.  the Finsar SFP's work in those. 

[jameyscott]

With that in mind, I assume this would be a functional set up.. This switch with these SFP transceivers and which NICs?  I'm sorry for all the questions.  When it comes to server grade stuff, there doesn't seem to be that much information for a consumer.  I just want to make sure I get this right.

 

EDIT:  Looking at that switch again, the one I linked is actually 2Gb and not 4Gb.

 

Finding information on these units is proving to be fairly difficult. 

[jameyscott]

I ended up going with this switch because it was a great price and included all 16 transceivers.  I also bought two of these.  I hope they work together.... If not, then I'll have to hunt down what will work with the unit.  Still haven't purchased the fiber cables, because I'm not sure which transceivers are in that unit, so I emailed the seller. Once I know that, I can find the cables I need.