Jump to content

I broke things..

bcredeur97

This is more of a funny little story than anything:

So it was like 11pm last night and I had a sudden urge to link aggregate two ports on my PFsense router to get an effective 2gb uplink through the router to the rest of the LAN at home... more because "why not" and because I wanted to than anything.

So I get on the web interface and then realize that my plan isn't going to work with only 3 interfaces total on my router. 1 needs to be the WAN, and I can't unassign the LAN port to aggregate it with previously my unused OPT port because in the process I will effectively remove my only way to access the config interface.

Then... genius idea! use a USB ethernet dongle temporarily to maintain access!

With that I was able to create the aggregation.. I enabled it with the LACP protocol and everything was looking good (this is where I messed up -- my dumb 16port unmanaged switch will never work with this protocol). I then realized I had one shot at this... either everything was going to break when  I enabled it once I switched the newly created interface over to it's "LAN" assignment and I'd have to reinstall the OS and reload from my backup. Or it would work and i'd be happy.

Switched it over... adjusted cabling as needed... and of course as these things go... it didn't work.

So oh well.. just plug in a screen and reinstall the OS and restore that from a backup right? Wrong. Dug through my usual bag of cables to dig out a VGA cable (the little optiplex I use for pfsense only has VGA/DP and I don't have a DP compatible monitor). I found no cable. I then realized I left it at my dad's office last time I was over there.. which is a good 10 miles away.

So there I am realizing I could not fix this that night. I managed to break the entire home network permanently until effectively after work the next day. Luckily the family is pretty forgiving and no one is really home during the day... but man... I messed that up just a bit xD

All for some stupid Link aggregation I'd barely benefit from anyway (though I do move files around from device-device a lot with samba shares so that maybe would of helped)

 

tl;dr: Don't make big changes to your already overly-sophiscated-than-it-needs-to-be network @ 11pm during a weekday

"If a Lobster is a fish because it moves by jumping, then a kangaroo is a bird" - Admiral Paulo de Castro Moreira da Silva

"There is nothing more difficult than fixing something that isn't all the way broken yet." - Author Unknown

Spoiler

Intel Core i7-3960X @ 4.6 GHz - Asus P9X79WS/IPMI - 12GB DDR3-1600 quad-channel - EVGA GTX 1080ti SC - Fractal Design Define R5 - 500GB Crucial MX200 - NH-D15 - Logitech G710+ - Mionix Naos 7000 - Sennheiser PC350 w/Topping VX-1

Link to comment
Share on other sites

Link to post
Share on other sites

When moving files between devices on the same network the transfer goes up to the switch and it checks if the destination MAC matches anything in the table. If it does it'll send it strait to the destination device bypassing the router. Communications generally only go to the router when either:

 

A. Packets are destined for another network

B. A particular application or protocol requires a default gateway.

 

SAMBA is responsible for handling SMB on Linux so if this is a SMB transfer then attempting to Link Aggregate the connection between the router & the switch would have realistically only increased your bandwidth access for your clients to the internet (if it were over 1Gbit) or another private network.

Link to comment
Share on other sites

Link to post
Share on other sites

27 minutes ago, Windows7ge said:

When moving files between devices on the same network the transfer goes up to the switch and it checks if the destination MAC matches anything in the table. If it does it'll send it strait to the destination device bypassing the router. Communications generally only go to the router when either:

 

A. Packets are destined for another network

B. A particular application or protocol requires a default gateway.

 

SAMBA is responsible for handling SMB on Linux so if this is a SMB transfer then attempting to Link Aggregate the connection between the router & the switch would have realistically only increased your bandwidth access for your clients to the internet (if it were over 1Gbit) or another private network.

This is very true. 

 

*hides in a corner and cries silently*

"If a Lobster is a fish because it moves by jumping, then a kangaroo is a bird" - Admiral Paulo de Castro Moreira da Silva

"There is nothing more difficult than fixing something that isn't all the way broken yet." - Author Unknown

Spoiler

Intel Core i7-3960X @ 4.6 GHz - Asus P9X79WS/IPMI - 12GB DDR3-1600 quad-channel - EVGA GTX 1080ti SC - Fractal Design Define R5 - 500GB Crucial MX200 - NH-D15 - Logitech G710+ - Mionix Naos 7000 - Sennheiser PC350 w/Topping VX-1

Link to comment
Share on other sites

Link to post
Share on other sites

25 minutes ago, bcredeur97 said:

This is very true. 

 

*hides in a corner and cries silently*

*sigh*

*picks you up out of corner*

 

Experimenting is always a great way to learn more. Sometimes doing something spontaneous like this can produce something wonderful.

 

Besides I'm sure someone more intelligent than me will be along to tell me how wrong I am in every possible aspect.

 

*steals your corner and cries silently*

Link to comment
Share on other sites

Link to post
Share on other sites

Unfortunately LACP requires client network interface and switch support.  The majority of 'smart' switches support it so you can get some cheap 1G switches that have LACP functionality.   Smart switches should also give you VLAN tagging support and possibly even some QoS which you can put to use in testing :)

 

It's good stuff to learn, but I would refrain from doing remote 'live' changes while learning :P We have all done it, I have made a change incorrectly when I was a lot younger and had to drive 80 miles to the site to fix it because I was in a rush.  I knew I was fucked the instant I pushed the config and lost SSH access to the device, with no out of bounds available or anyone on site with access to the comms room it was a 160 mile round trip haha.  Full on face palm moment, then panic.

Please quote or tag me if you need a reply

Link to comment
Share on other sites

Link to post
Share on other sites

I would imagine the correct way to do this would have been to bridge the LACP interface and the USB one.  So even if the LACP interface didn't work, you could still plug back into the USB one.  Hindsight and all.

 

You should be able to undo the LACP settings without completely reinstalling, you can change or just completely replace the configuration file /conf/config.xml from the console with your backup.

 

Went through a similar thing when I first got a 4 port ethernet card and wanted to bridge the LAN.  Its all about thinking logically about what order you need to do thing in to retain connectivity while you are changing things.  So easy to make a mistake by being impulsive or the router UI changing things in an order you didn't expect (had that on OpenWRT as I recall).

Unfortunately without the VGA cable you are SOL at this point, unless the motherboard has a serial port and you have a client with one.  (although not sure if pfSense enables the serial login by default or not)

Router:  Intel N100 (pfSense) WiFi6: Zyxel NWA210AX (1.7Gbit peak at 160Mhz)
WiFi5: Ubiquiti NanoHD OpenWRT (~500Mbit at 80Mhz) Switches: Netgear MS510TXUP, MS510TXPP, GS110EMX
ISPs: Zen Full Fibre 900 (~930Mbit down, 115Mbit up) + Three 5G (~800Mbit down, 115Mbit up)
Upgrading Laptop/Desktop CNVIo WiFi 5 cards to PCIe WiFi6e/7

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×