Jump to content

PROXMOX with truenas and wireguard

Hello! I’m building a home server to run proxmox whilst also being able to virtualixe truenas and wireguard. What do people thing about this current configuration I have? Any setup changes that I should make? https://pcpartpicker.com/list/FmLB9c

 

Link to comment
Share on other sites

Link to post
Share on other sites

Looks okay.
Kinda surprised that you're building a NAS with only two hard drives though, and not sure why you have two mismatched SSDs

5950X/3080Ti primary rig  |  1920X/1070Ti Unraid for dockers  |  200TB TrueNAS w/ 1:1 backup

Link to comment
Share on other sites

Link to post
Share on other sites

32 minutes ago, OddOod said:

Looks okay.
Kinda surprised that you're building a NAS with only two hard drives though, and not sure why you have two mismatched SSDs

Hey! Two hard drives so I can Raid 1 it and call it a day. The nvme is for boot drive to store proxmox, and the ssd is for other virtualization projects like OS's.

Link to comment
Share on other sites

Link to post
Share on other sites

I would go for a smaller nvme for proxmox and maybe RAID1 the SSDs for virtualization.
But keep in mind my proxmox is 8 years old and running just openvpn on debian and windows xp so take my advice with a grain of salt

Link to comment
Share on other sites

Link to post
Share on other sites

1 hour ago, Ntdi said:

Hey! Two hard drives so I can Raid 1 it and call it a day. The nvme is for boot drive to store proxmox, and the ssd is for other virtualization projects like OS's.

You can run your virtualized OS’s off the proxmox host drive directly. No need to have a second drive. 
 

Also, that machine is massive overkill, so assuming you are ok with knowing that, that’s fine. But 32GB is way more than enough, and I agree it probably makes more sense to run more than just 2 drives. ZFS is “expensive” to add storage down the line since you’d need to add entirely new vdevs if you need more space, so make sure you start with enough space for the foreseeable future, it’ll cost more to slowly add space since each vdev you make needs its own redundancy…

 

Also to properly virtualize truenas, you need to pass an HBA through to it. So you’d need an eBay LSI HBA. Dell h310 is a great option. Just needs to be flashed to IT mode, this one already is and comes with the SAS>SATA cables as well. 
 

https://www.ebay.com/itm/133485835643?mkcid=16&mkevt=1&mkrid=711-127632-2357-0&ssspo=OwHu05S9RzG&sssrc=4429486&ssuid=B1xTkXm_Qfe&var=&widget_ver=artemis&media=COPY

 

Around the 18 minute mark this video shows you how to store everything on the proxmox boot drive. Myself and friends have done this for years, works totally fine. 
https://youtu.be/_u8qTN3cCnQ?si=AH5XIU3V4Wyv8ElB

Rig: i7 13700k - - Asus Z790-P Wifi - - RTX 4080 - - 4x16GB 6000MHz - - Samsung 990 Pro 2TB NVMe Boot + Main Programs - - Assorted SATA SSD's for Photo Work - - Corsair RM850x - - Sound BlasterX EA-5 - - Corsair XC8 JTC Edition - - Corsair GPU Full Cover GPU Block - - XT45 X-Flow 420 + UT60 280 rads - - EK XRES RGB PWM - - Fractal Define S2 - - Acer Predator X34 -- Logitech G502 - - Logitech G710+ - - Logitech Z5500 - - LTT Deskpad

 

Headphones/amp/dac: Schiit Lyr 3 - - Fostex TR-X00 - - Sennheiser HD 6xx

 

Homelab/ Media Server: Proxmox VE host - - 512 NVMe Samsung 980 RAID Z1 for VM's/Proxmox boot - - Xeon e5 2660 V4- - Supermicro X10SRF-i - - 128 GB ECC 2133 - - 10x4 TB WD Red RAID Z2 - - Corsair 750D - - Corsair RM650i - - Dell H310 6Gbps SAS HBA - - Intel RES2SC240 SAS Expander - - TreuNAS + many other VM’s

 

iPhone 14 Pro - 2018 MacBook Air

Link to comment
Share on other sites

Link to post
Share on other sites

20 minutes ago, LIGISTX said:

Also to properly virtualize truenas, you need to pass an HBA through to it. So you’d need an eBay LSI HBA. Dell h310 is a great option. Just needs to be flashed to IT mode, this one already is and comes with the SAS>SATA cables as well. 
 

https://www.ebay.com/itm/133485835643?mkcid=16&mkevt=1&mkrid=711-127632-2357-0&ssspo=OwHu05S9RzG&sssrc=4429486&ssuid=B1xTkXm_Qfe&var=&widget_ver=artemis&media=COPY

Be wary, these are very commonly cloned (same with Intel NICs). I'd avoid listings like that with a bunch, look for one that says in the description that it was pulled from a server, and preferably one with an authenticity sticker you can double-check to confirm it's a real unit. That's what I did for mine, flashed it to IT-Mode myself, it works fine. Clones can be shoddy quality so you can run into issues with them. 

Intel HEDT and Server platform enthusiasts: Intel HEDT Xeon/i7 Megathread 

 

Main PC 

CPU: i9 7980XE @4.5GHz/1.22v/-2 AVX offset 

Cooler: EKWB Supremacy Block - custom loop w/360mm +280mm rads 

Motherboard: EVGA X299 Dark 

RAM:4x8GB HyperX Predator DDR4 @3200Mhz CL16 

GPU: Nvidia FE 2060 Super/Corsair HydroX 2070 FE block 

Storage:  1TB MP34 + 1TB 970 Evo + 500GB Atom30 + 250GB 960 Evo 

Optical Drives: LG WH14NS40 

PSU: EVGA 1600W T2 

Case & Fans: Corsair 750D Airflow - 3x Noctua iPPC NF-F12 + 4x Noctua iPPC NF-A14 PWM 

OS: Windows 11

 

Display: LG 27UK650-W (4K 60Hz IPS panel)

Mouse: EVGA X17

Keyboard: Corsair K55 RGB

 

Mobile/Work Devices: 2020 M1 MacBook Air (work computer) - iPhone 13 Pro Max - Apple Watch S3

 

Other Misc Devices: iPod Video (Gen 5.5E, 128GB SD card swap, running Rockbox), Nintendo Switch

Link to comment
Share on other sites

Link to post
Share on other sites

12 minutes ago, Zando_ said:

Be wary, these are very commonly cloned (same with Intel NICs). I'd avoid listings like that with a bunch, look for one that says in the description that it was pulled from a server, and preferably one with an authenticity sticker you can double-check to confirm it's a real unit. That's what I did for mine, flashed it to IT-Mode myself, it works fine. Clones can be shoddy quality so you can run into issues with them. 

Really? I have never once heard of an LSI clone…. These used HBA’s are extremely common with the TrueNAS world and I have never once heard of this. I have heard of clone Intel NIC’s, but not HBA’s. 
 

I didn’t actually investigate that seller,‘I just randomly linked one I saw on eBay. But plenty of reputable enough sellers sell them which is what I typically look for when buying mine. 

Rig: i7 13700k - - Asus Z790-P Wifi - - RTX 4080 - - 4x16GB 6000MHz - - Samsung 990 Pro 2TB NVMe Boot + Main Programs - - Assorted SATA SSD's for Photo Work - - Corsair RM850x - - Sound BlasterX EA-5 - - Corsair XC8 JTC Edition - - Corsair GPU Full Cover GPU Block - - XT45 X-Flow 420 + UT60 280 rads - - EK XRES RGB PWM - - Fractal Define S2 - - Acer Predator X34 -- Logitech G502 - - Logitech G710+ - - Logitech Z5500 - - LTT Deskpad

 

Headphones/amp/dac: Schiit Lyr 3 - - Fostex TR-X00 - - Sennheiser HD 6xx

 

Homelab/ Media Server: Proxmox VE host - - 512 NVMe Samsung 980 RAID Z1 for VM's/Proxmox boot - - Xeon e5 2660 V4- - Supermicro X10SRF-i - - 128 GB ECC 2133 - - 10x4 TB WD Red RAID Z2 - - Corsair 750D - - Corsair RM650i - - Dell H310 6Gbps SAS HBA - - Intel RES2SC240 SAS Expander - - TreuNAS + many other VM’s

 

iPhone 14 Pro - 2018 MacBook Air

Link to comment
Share on other sites

Link to post
Share on other sites

2 minutes ago, LIGISTX said:

Really? I have never once heard of an LSI clone…. These used HBA’s are extremely common with the TrueNAS world and I have never once heard of this. I have heard of clone Intel NIC’s, but not HBA’s. 
 

I didn’t actually investigate that seller,‘I just randomly linked one I saw on eBay. But plenty of reputable enough sellers sell them which is what I typically look for when buying mine. 

https://www.truenas.com/community/resources/fake-server-cards.198/

Art of Server has at least one other vid on counterfeits as well. I learned about em when I was looking at what HBA to get for TrueNAS, that's why I picked a single listing card with an authenticity sticker visible on it in the photos, that I could cross-check to confirm it was legit. 

Intel HEDT and Server platform enthusiasts: Intel HEDT Xeon/i7 Megathread 

 

Main PC 

CPU: i9 7980XE @4.5GHz/1.22v/-2 AVX offset 

Cooler: EKWB Supremacy Block - custom loop w/360mm +280mm rads 

Motherboard: EVGA X299 Dark 

RAM:4x8GB HyperX Predator DDR4 @3200Mhz CL16 

GPU: Nvidia FE 2060 Super/Corsair HydroX 2070 FE block 

Storage:  1TB MP34 + 1TB 970 Evo + 500GB Atom30 + 250GB 960 Evo 

Optical Drives: LG WH14NS40 

PSU: EVGA 1600W T2 

Case & Fans: Corsair 750D Airflow - 3x Noctua iPPC NF-F12 + 4x Noctua iPPC NF-A14 PWM 

OS: Windows 11

 

Display: LG 27UK650-W (4K 60Hz IPS panel)

Mouse: EVGA X17

Keyboard: Corsair K55 RGB

 

Mobile/Work Devices: 2020 M1 MacBook Air (work computer) - iPhone 13 Pro Max - Apple Watch S3

 

Other Misc Devices: iPod Video (Gen 5.5E, 128GB SD card swap, running Rockbox), Nintendo Switch

Link to comment
Share on other sites

Link to post
Share on other sites

2 hours ago, LIGISTX said:

Really? I have never once heard of an LSI clone…. These used HBA’s are extremely common with the TrueNAS world and I have never once heard of this. I have heard of clone Intel NIC’s, but not HBA’s. 
 

I didn’t actually investigate that seller,‘I just randomly linked one I saw on eBay. But plenty of reputable enough sellers sell them which is what I typically look for when buying mine. 

 

Theyre quite commonly sold on eBay etc...as refurbished cards. Theyre actually real LSI 2008 etc...chipsets, but with a third party board typically based off the 9211-8i design. Theres nothing wrong with them tbh, but its good to be aware of. 

 

 

My question for the OP is why are we running Proxmox? TrueNAS Scale should be able to fulfill all the needs discussed so far?

Particularly since its a single host and not a cluster. 

Spoiler

Desktop: Ryzen9 5950X | ASUS ROG Crosshair VIII Hero (Wifi) | EVGA RTX 3080Ti FTW3 | 32GB (2x16GB) Corsair Dominator Platinum RGB Pro 3600Mhz | EKWB EK-AIO 360D-RGB | EKWB EK-Vardar RGB Fans | 1TB Samsung 980 Pro, 4TB Samsung 980 Pro | Corsair 5000D Airflow | Corsair HX850 Platinum PSU | Asus ROG 42" OLED PG42UQ + LG 32" 32GK850G Monitor | Roccat Vulcan TKL Pro Keyboard | Logitech G Pro X Superlight  | MicroLab Solo 7C Speakers | Audio-Technica ATH-M50xBT2 LE Headphones | TC-Helicon GoXLR | Audio-Technica AT2035 | LTT Desk Mat | XBOX-X Controller | Windows 11 Pro

 

Spoiler

Server: Fractal Design Define R6 | Ryzen 3950x | ASRock X570 Taichi | EVGA GTX1070 FTW | 64GB (4x16GB) Corsair Vengeance LPX 3000Mhz | Corsair RM850v2 PSU | Fractal S36 Triple AIO | 12 x 8TB HGST Ultrastar He10 (WD Whitelabel) | 500GB Aorus Gen4 NVMe | 2 x 2TB Samsung 970 Evo Plus NVMe | LSI 9211-8i HBA

 

Link to comment
Share on other sites

Link to post
Share on other sites

19 hours ago, Jarsky said:

 

My question for the OP is why are we running Proxmox? TrueNAS Scale should be able to fulfill all the needs discussed so far?

Particularly since its a single host and not a cluster. 

I Want to use proxmox as I want to learn it and also containerize my system.

 

21 hours ago, LIGISTX said:

You can run your virtualized OS’s off the proxmox host drive directly. No need to have a second drive. 
 

Also, that machine is massive overkill, so assuming you are ok with knowing that, that’s fine. But 32GB is way more than enough, and

Im aware this is overkill - I like overkill. I plan on using this for more vms that I want to host and such, it'll be perfect for expanding in the future.

Edited by Ntdi
More information
Link to comment
Share on other sites

Link to post
Share on other sites

23 minutes ago, Ntdi said:

I Want to use proxmox as I want to learn it and also containerize my system.

 

Im aware this is overkill - I like overkill. I plan on using this for more vms that I want to host and such, it'll be perfect for expanding in the future.

Just make sure you have an HBA for your TrueNAS drives to plug into. Besides that, ya it’ll be great. I run TrueNAS under proxmox and it’s been a great solution. 

Rig: i7 13700k - - Asus Z790-P Wifi - - RTX 4080 - - 4x16GB 6000MHz - - Samsung 990 Pro 2TB NVMe Boot + Main Programs - - Assorted SATA SSD's for Photo Work - - Corsair RM850x - - Sound BlasterX EA-5 - - Corsair XC8 JTC Edition - - Corsair GPU Full Cover GPU Block - - XT45 X-Flow 420 + UT60 280 rads - - EK XRES RGB PWM - - Fractal Define S2 - - Acer Predator X34 -- Logitech G502 - - Logitech G710+ - - Logitech Z5500 - - LTT Deskpad

 

Headphones/amp/dac: Schiit Lyr 3 - - Fostex TR-X00 - - Sennheiser HD 6xx

 

Homelab/ Media Server: Proxmox VE host - - 512 NVMe Samsung 980 RAID Z1 for VM's/Proxmox boot - - Xeon e5 2660 V4- - Supermicro X10SRF-i - - 128 GB ECC 2133 - - 10x4 TB WD Red RAID Z2 - - Corsair 750D - - Corsair RM650i - - Dell H310 6Gbps SAS HBA - - Intel RES2SC240 SAS Expander - - TreuNAS + many other VM’s

 

iPhone 14 Pro - 2018 MacBook Air

Link to comment
Share on other sites

Link to post
Share on other sites

11 minutes ago, LIGISTX said:

Just make sure you have an HBA for your TrueNAS drives to plug into. Besides that, ya it’ll be great. I run TrueNAS under proxmox and it’s been a great solution. 

Much love ❤️

Link to comment
Share on other sites

Link to post
Share on other sites

4 hours ago, Ntdi said:

I Want to use proxmox as I want to learn it and also containerize my system.

 

TrueNAS Scale has K8s (Kubernetes) and a virtualization platform built on QEMU/KVM as well. Proxmox has containers in the form of LXCs. An advantage to Kubernetes is that you can manage Docker containers and many other containerised applications in Kubernetes with less *technical knowledge* and Docker is the largest library of containerised applications, and extremely easy to containerise your own.

 

Proxmox is fantastic for a Open Source VMware alternative where you need HA / Clustering, but for a single node for managing storage, containers and a nice VM manager imo TrueNAS Scale is king.I run Proxmox virtualised in my test lab. 

 

Id recommend spinning up a virtual instance of each (even if you do that on your desktop with something like Virtualbox, and give each a test drive before you commit to one. 

Spoiler

Desktop: Ryzen9 5950X | ASUS ROG Crosshair VIII Hero (Wifi) | EVGA RTX 3080Ti FTW3 | 32GB (2x16GB) Corsair Dominator Platinum RGB Pro 3600Mhz | EKWB EK-AIO 360D-RGB | EKWB EK-Vardar RGB Fans | 1TB Samsung 980 Pro, 4TB Samsung 980 Pro | Corsair 5000D Airflow | Corsair HX850 Platinum PSU | Asus ROG 42" OLED PG42UQ + LG 32" 32GK850G Monitor | Roccat Vulcan TKL Pro Keyboard | Logitech G Pro X Superlight  | MicroLab Solo 7C Speakers | Audio-Technica ATH-M50xBT2 LE Headphones | TC-Helicon GoXLR | Audio-Technica AT2035 | LTT Desk Mat | XBOX-X Controller | Windows 11 Pro

 

Spoiler

Server: Fractal Design Define R6 | Ryzen 3950x | ASRock X570 Taichi | EVGA GTX1070 FTW | 64GB (4x16GB) Corsair Vengeance LPX 3000Mhz | Corsair RM850v2 PSU | Fractal S36 Triple AIO | 12 x 8TB HGST Ultrastar He10 (WD Whitelabel) | 500GB Aorus Gen4 NVMe | 2 x 2TB Samsung 970 Evo Plus NVMe | LSI 9211-8i HBA

 

Link to comment
Share on other sites

Link to post
Share on other sites

On 2/7/2024 at 9:00 AM, Zando_ said:

Be wary, these are very commonly cloned (same with Intel NICs). I'd avoid listings like that with a bunch, look for one that says in the description that it was pulled from a server, and preferably one with an authenticity sticker you can double-check to confirm it's a real unit. That's what I did for mine, flashed it to IT-Mode myself, it works fine. Clones can be shoddy quality so you can run into issues with them. 

I second this. I also quite like LSI megaraid cards but I needed something to support sas 3 and the dell perc cards get pricey for newer ones.

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×