How to Network thjs?

[K1LLA_KING_KONG]

Can I please get some guidence to set this up.

Purpose:

Blue line is standard Gigabit LAN for internet access
Red Line is 10GB for internal access to Truenas core server (QLogic BCM57810 10 Gigabit Ethernet)
Server will still require internet access for remote SMB file access, I hope to use Tailscale

1. Is it viable?
2. Where do I begin?
 

[Eigenvektor]

58 minutes ago, K1LLA_KING_KONG said:

1. Is it viable?
2. Where do I begin?

Sure, but that means your server now needs three ethernet ports, one Gigabit, two 10G. Each client machine needs to NICs as well.

 

Those dedicated connections will need their own IPs and you'll need to use these IPs to connect from the clients.

 

It would probably be easier/cheaper to set up to use 10G for everything and only have a single connection for all machines m

[Wardus]

1 hour ago, K1LLA_KING_KONG said:

Can I please get some guidence to set this up.

Purpose:

Blue line is standard Gigabit LAN for internet access
Red Line is 10GB for internal access to Truenas core server (QLogic BCM57810 10 Gigabit Ethernet)
Server will still require internet access for remote SMB file access, I hope to use Tailscale

1. Is it viable?
2. Where do I begin?
 

I would just use a switch, like the picture I made. This way everything has access to the internet and has 10G networking. Do the ports on the PC's even have 10G capability?  The switch will make it so all the clients can communicate, and the router will give it all internet access. You might have to use the 1 port on the switch. I have this same setup at home.

 

[K1LLA_KING_KONG]

55 minutes ago, Eigenvektor said:

Sure, but that means your server now needs three ethernet ports, one Gigabit, two 10G. Each client machine needs to NICs as well.

 

Those dedicated connections will need their own IPs and you'll need to use these IPs to connect from the clients.

 

It would probably be easier/cheaper to set up to use 10G for everything and only have a single connection for all machines m

Yes already have all the hardware and IP's set up

But where I need help is directing the SMB file sharing through the 10GB rather then the 1GB

[LapsedMemory]

1 hour ago, K1LLA_KING_KONG said:

Can I please get some guidence to set this up.

Purpose:

Blue line is standard Gigabit LAN for internet access
Red Line is 10GB for internal access to Truenas core server (QLogic BCM57810 10 Gigabit Ethernet)
Server will still require internet access for remote SMB file access, I hope to use Tailscale

1. Is it viable?
2. Where do I begin?
 

This is one of those engineering scenarios where you shouldn't ask yourself "can it be done" but "should it be done".  What applications are you running that can utilize 10G to such an extent that another 1G makes a measurable difference?

[K1LLA_KING_KONG]

20 minutes ago, LapsedMemory said:

This is one of those engineering scenarios where you shouldn't ask yourself "can it be done" but "should it be done".  What applications are you running that can utilize 10G to such an extent that another 1G makes a measurable difference?

The 1 GB is simply for internet access, the 10gb is for internal access to server

[LapsedMemory]

3 minutes ago, K1LLA_KING_KONG said:

The 1 GB is simply for internet access, the 10gb is for internal access to server

Ah.  Then put the 1G ethernet connection between the trueNAS and the router on it's own subnet or VLAN (depending on your preference and router capability).  If set properly, that should block traffic from the PCs from being able to see the TrueNAS thru the 1G network.  

[K1LLA_KING_KONG]

15 minutes ago, LapsedMemory said:

Ah.  Then put the 1G ethernet connection between the trueNAS and the router on it's own subnet or VLAN (depending on your preference and router capability).  If set properly, that should block traffic from the PCs from being able to see the TrueNAS thru the 1G network.  

Yeah, or as others have mentied, just use a switch. Then there will be no 1GB connection to the PC's so all traffic will go via 10Gb anyway. I think that's easiest, for me anyway

[Alex Atkin UK]

55 minutes ago, K1LLA_KING_KONG said:

Yes already have all the hardware and IP's set up

But where I need help is directing the SMB file sharing through the 10GB rather then the 1GB

Easiest way is to use the IP address of the servers 10Gbit NIC that PC is connected to, rather than the servers SMB name.

 

More sensible way as others have mentioned is to just convert all three machines to use 10Gbit by default through a 10Gbit switch.  As it looks like you are using fibre then a MikroTik CRS305-1G-4S+IN is the cheapest option for that.

[K1LLA_KING_KONG]

11 minutes ago, Alex Atkin UK said:

Easiest way is to use the IP address of the servers 10Gbit NIC that PC is connected to, rather than the servers SMB name.

 

More sensible way as others have mentioned is to just convert all three machines to use 10Gbit by default through a 10Gbit switch.  As it looks like you are using fibre then a MikroTik CRS305-1G-4S+IN is the cheapest option for that.

Yes Iv just worked that out too


Yes thats exactly the one iv found, Ill be buying that tomorrow

[LapsedMemory]

26 minutes ago, K1LLA_KING_KONG said:

Yes Iv just worked that out too


Yes thats exactly the one iv found, Ill be buying that tomorrow

Just keep in mind the ethernet port on this is not for connecting to a WAN thru your router.  It's just a management port.  All 4 connections will need to utilize the SFP ports.  

[LIGISTX]

3 hours ago, K1LLA_KING_KONG said:

Yes already have all the hardware and IP's set up

But where I need help is directing the SMB file sharing through the 10GB rather then the 1GB

Each NIC has to be put on its own subnet. Each PC which has a 10 gig NIC needs to be put on the same subnet.

 

Then you mount the SMB shares via that 10gbe subnet. 
 

For example, normal gigabit may be 192.168.1.1. All devices get DHCP IP’s via the router on this subnet. 
 

In truenas, you need to manually set an IP for one of the 10gig NIC’s to, say, 10.10.1.10 and set the corresponding PC to 10.10.1.11. Then the other 10gig set to 10.10.2.10 and it’s corresponding PC to 10.10.2.11. Then on each PC, mount the SMB shares accordingly.

 

I have a direct fiber 10gig link between truenas and PC like this, it works fine, it’s a very standard idea. Plenty of info on google as well…

[K1LLA_KING_KONG]

13 hours ago, LapsedMemory said:

Just keep in mind the ethernet port on this is not for connecting to a WAN thru your router.  It's just a management port.  All 4 connections will need to utilize the SFP ports.  

Yeah I noticed that, although this switch was recommended for this particular purpose. How else would you get internet into this switch? Only SFP? 
Obviously that's not possible. SFP is only for the PC's and Server

EDIT:

From the manual:
https://help.mikrotik.com/docs/pages/viewpage.action?pageId=17498183

 

Extension Slots and Ports

• Four SFP+ cages, which accept both 1.25 Gb SFP and 10 Gb SFP+ modules.
• One Gigabit Ethernet port, suggested to be used for management (Supports Auto MDI/X so you can use either straight or cross-over cables for connecting to other network devices). The Ethernet port (ETH/BOOT) can also be used for network booting and recovery with Netinstall.

 

[K1LLA_KING_KONG]

Updated Plan:

[LIGISTX]

7 hours ago, K1LLA_KING_KONG said:

Updated Plan:

If you already own the hardware minus the switch, you can just do your original plan as I suggested a few posts up. It’s not quite as “clean” from a wiring perspective since each editing PC gets normal Ethernet LAN + 10GB and the NAS gets three connections (LAN + 2x 10GB), it’s also not that abnormal and it will work fine.