I currently have a DL580 4x E7-4870 & 128GB RAM sitting doing nothing.
Currently, I am using a Lenovo P330 Tiny i7-8700T 32gb RAM w/ Quadro P620
I have a BlueIris server running AI (from this guide https://www.youtube.com/watch?v=fwoonl5JKgo) running 13 cameras (See my network and camera setup here https://community.ui.com/stories/Home-Ubiquiti-Setup-Security-networking-and-more/4f0a698f-4d02-481c-9d48-17d9c72a2327) which works well, however the AI program uses the CPU as it is installed on Windows, and cannot use the GPU on Windows. In order to use the GPU for AI, it must be installed on a Linux system. This has reduced the processing time 10x for other users. Currently the CPU takes about 500ms to process 1 image, which is quick, but it does cause the CPU to max at 100% when processing images and recording. My initial tests show that the AI program is utilizing most of the CPU when it is maxed.
Here is my question: Should I install Proxmox on the P330 Tiny with a windows and linux VM and passthru the GPU to the Linux VM for the AI program and see if that helps reduce the CPU load when it's processing images? I wouldn't use this box for anything else.
The other option I wanted to get opinions on, was to buy an HP branded GPU and install that into the DL580 and pass that thru to a Linux VM and have the AI run from there and just remove the processing entirely from the BlueIris box.
The reason I would not run BlueIris on the DL580 is that I don't like the idea of the cameras not recording for 5-10 minutes while the server reboots, when the P330 takes 15 seconds.
All comments and criticisms are welcomed.