Jump to content

Need advice on how to setup 10gb networking in my home.

BenKrapohl

Hey yall, I have a few questions that I thought the community might be able to help me with.

 

Little background info before I get into the advice, I do video production for a media company and often bring home some work with me. I currently have a gaming/editing PC that runs great, and about 6 months ago I built out of some old spare parts a storage NAS, also runs great and I have 0 issues with it at all. So the bottleneck I have comes down to networking speeds from the limited Cat 5a cables and the router/switch.

 

Ive included an astounding art piece I made in paint to give you an idea of how my current setup works. My current setup is my modem and router that are both just basic Rj-45 1Gb which of course limits my network speeds to just 1Gb. Might not be a major problem most of the time but if im working on a project or importing stuff to the server I run into bandwidth issues on my cables because they wont push past 1Gb connection at all. Great example is I will try to download something, then at the same time try to transfer a file from the server to my PC and I get limited to half a Gb on both. Not ideal. 

My goal is to keep my current modem, and router/switch combo because there are other things in my setup that dont require a faster connection that they both work fine on. (Xbox, TV ect.)

 

The way I believe it should work from what ive learned is as follows. (Second diagram included) 

1. Buy a switch similar to this https://www.amazon.com/MikroTik-Desktop-Gigabit-Ethernet-CRS305-1G-4S/dp/B07HYKQFWD/ref=as_li_ss_tl?ie=UTF8&qid=1549074876&sr=8-1&keywords=CRS305-1G-4S+IN&linkCode=sl1&tag=craftcomputin-20&linkId=ce8a158ef1ece6763cf13df7225081e6&language=en_US    and plug it into just a normal ethernet port on my primary router for internet access.

2. Buy SPF+ network cards for both the Server and the PC and plug in the PC and nas to the 10Gb switch. 

 

From what it sounds like that should be all it needs to work but I know im missing something somewhere or I just dont know it. Thats why im here asking. Would love advice/thoughts from the community because I frankly dont know alot about it and id rather ensure that I dont spend a few hundred dollars on some solution that might not even work. 

 

Thanks for any and all feedback and hope to chat with you all below. 

proposed setup.png

Current Setup Diagram.png

Link to comment
Share on other sites

Link to post
Share on other sites

21 minutes ago, BenKrapohl said:

Thanks for any and all feedback and hope to chat with you all below. 

If you don't intend to have any other 10G devices, I would recommend just directly connecting the NAS and the desktop with 10G instead of running it through a switch. You can set the hosts file in Windows to only route traffic to the NAS via the 10G interface IP. Use the existing Ethernet for larger network access.

 

(This is what I do between my NAS and desktop and it works great)

Main System (Byarlant): Ryzen 7 5800X | Asus B550-Creator ProArt | EK 240mm Basic AIO | 16GB G.Skill DDR4 3200MT/s CAS-14 | XFX Speedster SWFT 210 RX 6600 | Samsung 990 PRO 2TB / Samsung 960 PRO 512GB / 4× Crucial MX500 2TB (RAID-0) | Corsair RM750X | a 10G NIC (pending) | Inateck USB 3.0 Card | Hyte Y60 Case | Dell U3415W Monitor | Keychron K4 Brown (white backlight)

 

Laptop (Narrative): Lenovo Flex 5 81X20005US | Ryzen 5 4500U | 16GB RAM (soldered) | Vega 6 Graphics | SKHynix P31 1TB NVMe SSD | Intel AX200 Wifi (all-around awesome machine)

 

Proxmox Server (Veda): Ryzen 7 3800XT | AsRock Rack X470D4U | Corsair H80i v2 | 64GB Micron DDR4 ECC 3200MT/s | 4x 10TB WD Whites / 4x 14TB Seagate Exos / 2× Samsung PM963a 960GB SSD | Seasonic Prime Fanless 500W | Intel X540-T2 10G NIC | LSI 9207-8i HBA | Fractal Design Node 804 Case (side panels swapped to show off drives) | VMs: TrueNAS Scale; Ubuntu Server (PiHole/PiVPN/NGINX?); Windows 10 Pro; Ubuntu Server (Apache/MySQL)


Media Center/Video Capture (Jesta Cannon): Ryzen 5 1600X | ASRock B450M Pro4 R2.0 | Noctua NH-L12S | 16GB Crucial DDR4 3200MT/s CAS-22 | EVGA GTX750Ti SC | UMIS NVMe SSD 256GB / TEAMGROUP MS30 1TB | Corsair CX450M | Viewcast Osprey 260e Video Capture | Mellanox ConnectX-2 10G NIC | LG UH12NS30 BD-ROM | Silverstone Sugo SG-11 Case | Sony XR65A80K

 

Camera: Sony ɑ7II w/ Meike Grip | Sony SEL24240 | Samyang 35mm ƒ/2.8 | Sony SEL50F18F | Sony SEL2870 (kit lens) | PNY Elite Perfomance 512GB SDXC card

 

Network:

Spoiler
                           ┌─────────────── Office/Rack ────────────────────────────────────────────────────────────────────────────┐
Google Fiber Webpass ────── UniFi Security Gateway ─── UniFi Switch 8-60W ─┬─ UniFi Switch Flex XG ═╦═ Veda (Proxmox Virtual Switch)
(500Mbps↑/500Mbps↓)                             UniFi CloudKey Gen2 (PoE) ─┴─ Veda (IPMI)           ╠═ Veda-NAS (HW Passthrough NIC)
╔═══════════════════════════════════════════════════════════════════════════════════════════════════╩═ Narrative (Asus USB 2.5G NIC)
║ ┌────── Closet ──────┐   ┌─────────────── Bedroom ──────────────────────────────────────────────────────┐
╚═ UniFi Switch Flex XG ═╤═ UniFi Switch Flex XG ═╦═ Byarlant
   (PoE)                 │                        ╠═ Narrative (Cable Matters USB-PD 2.5G Ethernet Dongle)
                         │                        ╚═ Jesta Cannon*
                         │ ┌─────────────── Media Center ──────────────────────────────────┐
Notes:                   └─ UniFi Switch 8 ─────────┬─ UniFi Access Point nanoHD (PoE)
═══ is Multi-Gigabit                                ├─ Sony Playstation 4 
─── is Gigabit                                      ├─ Pioneer VSX-S520
* = cable passed to Bedroom from Media Center       ├─ Sony XR65A80K (Google TV)
** = cable passed from Media Center to Bedroom      └─ Work Laptop** (Startech USB-PD Dock)

Retired/Other:

Spoiler

Laptop (Rozen-Zulu): Sony VAIO VPCF13WFX | Core i7-740QM | 8GB Patriot DDR3 | GT 425M | Samsung 850EVO 250GB SSD | Blu-ray Drive | Intel 7260 Wifi (lived a good life, retired with honor)

Testbed/Old Desktop (Kshatriya): Xeon X5470 @ 4.0GHz | ZALMAN CNPS9500 | Gigabyte EP45-UD3L | 8GB Nanya DDR2 400MHz | XFX HD6870 DD | OCZ Vertex 3 Max-IOPS 120GB | Corsair CX430M | HooToo USB 3.0 PCIe Card | Osprey 230 Video Capture | NZXT H230 Case

TrueNAS Server (La Vie en Rose): Xeon E3-1241v3 | Supermicro X10SLL-F | Corsair H60 | 32GB Micron DDR3L ECC 1600MHz | 1x Kingston 16GB SSD / Crucial MX500 500GB

Link to comment
Share on other sites

Link to post
Share on other sites

3 minutes ago, AbydosOne said:

If you don't intend to have any other 10G devices, I would recommend just directly connecting the NAS and the desktop with 10G instead of running it through a switch. You can set the hosts file in Windows to only route traffic to the NAS via the 10G interface IP. Use the existing Ethernet for larger network access.

 

(This is what I do between my NAS and desktop and it works great)

I did actually consider doing something like that, But I would rather be future proofed incase I decide to add something to the system. 

Link to comment
Share on other sites

Link to post
Share on other sites

@BenKrapohl

 

Your proposed setup should work fine.

 

As for the cable link between the Mikrotik switch and the PC/NAS, look into SFP+ DAC cables if distance between devices is short.

 

Also, keep in mind that this Mikrotik switch is passively cooled. Once you start utilizing more ports, heat may become an issue so active cooling will be required for stability.

 

All the best!

Link to comment
Share on other sites

Link to post
Share on other sites

If you want to do this for less and you intend to *only* connect your workstation to your NAS, you can cheat it and just directly connect the PC and NAS.

 

1266654407_10gignetwork.png.580b25665bf28064c1fbb56e0541a638.png

 

This of course assumes you can fit two NICs in your NAS.  But this is what I'm doing in my home as copper 10gig switches are expensive and I really only needed the fast connection to my desktop.  I added an Aquantia 10gig NIC to both desktop and server, ran a CAT6A cable between them, and configured them both to 192.168.10.X where the 1gig network is 192.168.1.X.  I kept their last set of numbers identical so it was easy to mentally keep track of.  Both machines maintain their normal 1gig connection to the remainder of the network.  This means that once 10 gig copper switches cost under CAD$700, I can simply replace my 1gig and plug both server and NAS into that along with everything else.

 

 

Desktop: Ryzen 9 3950X, Asus TUF Gaming X570-Plus, 64GB DDR4, MSI RTX 3080 Gaming X Trio, Creative Sound Blaster AE-7

Gaming PC #2: Ryzen 7 5800X3D, Asus TUF Gaming B550M-Plus, 32GB DDR4, Gigabyte Windforce GTX 1080

Gaming PC #3: Intel i7 4790, Asus B85M-G, 16B DDR3, XFX Radeon R9 390X 8GB

WFH PC: Intel i7 4790, Asus B85M-F, 16GB DDR3, Gigabyte Radeon RX 6400 4GB

UnRAID #1: AMD Ryzen 9 3900X, Asus TUF Gaming B450M-Plus, 64GB DDR4, Radeon HD 5450

UnRAID #2: Intel E5-2603v2, Asus P9X79 LE, 24GB DDR3, Radeon HD 5450

MiniPC: BeeLink SER6 6600H w/ Ryzen 5 6600H, 16GB DDR5 
Windows XP Retro PC: Intel i3 3250, Asus P8B75-M LX, 8GB DDR3, Sapphire Radeon HD 6850, Creative Sound Blaster Audigy

Windows 9X Retro PC: Intel E5800, ASRock 775i65G r2.0, 1GB DDR1, AGP Sapphire Radeon X800 Pro, Creative Sound Blaster Live!

Steam Deck w/ 2TB SSD Upgrade

Link to comment
Share on other sites

Link to post
Share on other sites

I would also recommend the direct attach setup. In this case it literally only has benefits and no drawbacks. Much cheaper and you still get the same speed, without having to introduce another device to the network. 

I don't buy the whole "I want it for future proofing" argument either because if you need more connections in the future then you can buy a switch when you need it. Why buy something now because you might need it later? It's not like the direct attach method requires you to buy any hardware that would be wasted if you bought the switch. 

Link to comment
Share on other sites

Link to post
Share on other sites

7 hours ago, LAwLz said:

I would also recommend the direct attach setup. In this case it literally only has benefits and no drawbacks. Much cheaper and you still get the same speed, without having to introduce another device to the network. 

I don't buy the whole "I want it for future proofing" argument either because if you need more connections in the future then you can buy a switch when you need it. Why buy something now because you might need it later? It's not like the direct attach method requires you to buy any hardware that would be wasted if you bought the switch. 

Yup, in my situation even the long cable I bought would be part of a 10gig switched setup.  My desktop is on the desk where I also have pfsense and my main 1gig switch.  So any 10gig switch would be dropped in as a replacement there.  Every part I've bought already will continue on.  But the Netgear 10gig switch I've eyeballed is over CAD$700 and I can't justify it whe, only two devices have NICs faster than 1gig.  But one day those will be affordable and easier to justify.

 

Def hard to argue a 10 gigabit PCIE x4 3.0 NIC is not 'future proof'.

Desktop: Ryzen 9 3950X, Asus TUF Gaming X570-Plus, 64GB DDR4, MSI RTX 3080 Gaming X Trio, Creative Sound Blaster AE-7

Gaming PC #2: Ryzen 7 5800X3D, Asus TUF Gaming B550M-Plus, 32GB DDR4, Gigabyte Windforce GTX 1080

Gaming PC #3: Intel i7 4790, Asus B85M-G, 16B DDR3, XFX Radeon R9 390X 8GB

WFH PC: Intel i7 4790, Asus B85M-F, 16GB DDR3, Gigabyte Radeon RX 6400 4GB

UnRAID #1: AMD Ryzen 9 3900X, Asus TUF Gaming B450M-Plus, 64GB DDR4, Radeon HD 5450

UnRAID #2: Intel E5-2603v2, Asus P9X79 LE, 24GB DDR3, Radeon HD 5450

MiniPC: BeeLink SER6 6600H w/ Ryzen 5 6600H, 16GB DDR5 
Windows XP Retro PC: Intel i3 3250, Asus P8B75-M LX, 8GB DDR3, Sapphire Radeon HD 6850, Creative Sound Blaster Audigy

Windows 9X Retro PC: Intel E5800, ASRock 775i65G r2.0, 1GB DDR1, AGP Sapphire Radeon X800 Pro, Creative Sound Blaster Live!

Steam Deck w/ 2TB SSD Upgrade

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×