I just wanted to post back so anyone who is or was interested could hear our solution.
We ended up with these specs for our RD server:
Windows Server 2016 w/ RD services
Super Micro X11DPG-QT board: https://www.supermicro.com/products/motherboard/Xeon/C620/X11DPG-QT.cfm
2 x Intel Gold 6128 https://ark.intel.com/products/120482/Intel-Xeon-Gold-6128-Processor-19_25M-Cache-3_40-GHz
96GB Ram
4 x 500GB Kingston SSD on RAID 5 (1 spare)
8 port AOC-S3108L-H8iR Raid Controller http://www.supermicro.com/products/accessories/addon/AOC-S3108L-H8iR.cfm
Titan X
We have 4-6 remote users on this computer at all times using a mix of CAD, GIS, ORBIT and now Drone to Map for 3D Point cloud rendering and image mashing.
When choosing the processors we had to consider the core count to speed ratio while trying to stay under 16 cores between 2 processors so that we wouldn't go over licensing restrictions as well a need to maintain scalability. (we can change boards and add 2 more of those processors if we ever had the need.)
No complaints so far other than, "why does IT have to install all of my software?"
This has been working great!
Total cost with licensing and warranty - $13,000.00