Jump to content

Folding using only half of dual Xeon Gold 5120's?

Hello,

 

I have what might be a silly question, but I recently installed Folding at home on a machine I have with 2x Xeon Gold 5120's just because it was sitting around, the event is coming up, and I wanted to see if having that much CPU compute would be at all competitive to a GPU points-wise, but what I am seeing is that Folding even with "folding power" set to "full" or me adding multiple CPU slots, it will never use more than about 60% of the CPU, even when manually set to use 55 threads per slot!

 

I was wondering if anyone might have some insight or wisdom into what might be going on, or if there was some other way to increase my folding "density" on this machine to use the wasted CPU time. Maybe the client is NUMA aware? That's about all I can think of...

 

Thank you in advance, and I appreciate it.

 

Some additional info in case it is relevant:

  • ProLiant BL460c Gen10
  • Server Power Management is set to "Static High Performance Mode"
  • Thermals seem normal-ish, CPU is around 55C

 

image.thumb.png.1ad62ae2dd9de76f4f08f095d5457c54.png

Link to comment
Share on other sites

Link to post
Share on other sites

1. You are limited to a max of 32-threads per slot I believe.

2. You can run multiple CPU slots on a Processor

3. Don't let the slots span NUMA boundaries (i.e. chips or chiplets) or performance will suffer. Process Lasso can be useful for this.

4. There is a weird bug where slots can not use certain thread counts (something to do with prime numbers) but will drop down to the next lower safe multiple so expect weirdness.

 

@leadeater will likely be able to give good advice on the best settings.

FaH BOINC HfM

Bifrost - 6 GPU Folding Rig  Linux Folding HOWTO Folding Remote Access Folding GPU Profiling ToU Scheduling UPS

Systems:

desktop: Lian-Li O11 Air Mini; Asus ProArt x670 WiFi; Ryzen 9 7950x; EVGA 240 CLC; 4 x 32GB DDR5-5600; 2 x Samsung 980 Pro 500GB PCIe3 NVMe; 2 x 8TB NAS; AMD FirePro W4100; MSI 4070 Ti Super Ventus 2; Corsair SF750

nas1: Fractal Node 804; SuperMicro X10sl7-f; Xeon e3-1231v3; 4 x 8GB DDR3-1666 ECC; 2 x 250GB Samsung EVO Pro SSD; 7 x 4TB Seagate NAS; Corsair HX650i

nas2: Synology DS-123j; 2 x 6TB WD Red Plus NAS

nas3: Synology DS-224+; 2 x 12TB Seagate NAS

dcn01: Fractal Meshify S2; Gigabyte Aorus ax570 Master; Ryzen 9 5900x; Noctua NH-D15; 4 x 16GB DDR4-3200; 512GB NVMe; 2 x Zotac AMP 4070ti; Corsair RM750Mx

dcn02: Fractal Meshify S2; Gigabyte ax570 Pro WiFi; Ryzen 9 3950x; Noctua NH-D15; 2 x 16GB DDR4-3200; 128GB NVMe; 2 x Zotac AMP 4070ti; Corsair RM750x

dcn03: Fractal Meshify C; Gigabyte Aorus z370 Gaming 5; i9-9900k; BeQuiet! PureRock 2 Black; 2 x 8GB DDR4-2400; 128GB SATA m.2; MSI 4070 Ti Super Gaming X; MSI 4070 Ti Super Ventus 2; Corsair TX650m

dcn05: Fractal Define S; Gigabyte Aorus b450m; Ryzen 7 2700; AMD Wraith; 2 x 8GB DDR 4-3200; 128GB SATA NVMe; Gigabyte Gaming RTX 4080 Super; Corsair TX750m

dcn06: Fractal Focus G Mini; Gigabyte Aorus b450m; Ryzen 7 2700; AMD Wraith; 2 x 8GB DDR 4-3200; 128GB SSD; Gigabyte Gaming RTX 4080 Super; Corsair CX650m

Link to comment
Share on other sites

Link to post
Share on other sites

Aughh been a while since I had to deal with this issue, about a year (last event haha).

 

The long and short of it is you need to create multiple CPU slots of around 16 each. For you either 2 slots of 14 or 4 slots of 14, which ever actually gives the best overall PPD.

 

I think I have a server with Windows already installed that I can put F@H on and get the settings if you can't resolve it.

 

The easier method is actually ESXi and the F@H OVA appliance or enable Hyper-V role and create a few VMs.

 

12 hours ago, arcangel13579 said:

it will never use more than about 60% of the CPU, even when manually set to use 55 threads per slot!

As @Gorgon mentioned F@H client and projects have a hard limit of 32 threads, there isn't a way to make it use more. The above create multiple slots is the solution.

 

~60% of 56 is 32.

Link to comment
Share on other sites

Link to post
Share on other sites

1 hour ago, leadeater said:

Aughh been a while since I had to deal with this issue, about a year (last event haha).

 

The long and short of it is you need to create multiple CPU slots of around 16 each. For you either 2 slots of 14 or 4 slots of 14, which ever actually gives the best overall PPD.

 

I think I have a server with Windows already installed that I can put F@H on and get the settings if you can't resolve it.

 

The easier method is actually ESXi and the F@H OVA appliance or enable Hyper-V role and create a few VMs.

 

As @Gorgon mentioned F@H client and projects have a hard limit of 32 threads, there isn't a way to make it use more. The above create multiple slots is the solution.

 

~60% of 56 is 32.

And now is the time to get the tinkering done before the event starts!

FaH BOINC HfM

Bifrost - 6 GPU Folding Rig  Linux Folding HOWTO Folding Remote Access Folding GPU Profiling ToU Scheduling UPS

Systems:

desktop: Lian-Li O11 Air Mini; Asus ProArt x670 WiFi; Ryzen 9 7950x; EVGA 240 CLC; 4 x 32GB DDR5-5600; 2 x Samsung 980 Pro 500GB PCIe3 NVMe; 2 x 8TB NAS; AMD FirePro W4100; MSI 4070 Ti Super Ventus 2; Corsair SF750

nas1: Fractal Node 804; SuperMicro X10sl7-f; Xeon e3-1231v3; 4 x 8GB DDR3-1666 ECC; 2 x 250GB Samsung EVO Pro SSD; 7 x 4TB Seagate NAS; Corsair HX650i

nas2: Synology DS-123j; 2 x 6TB WD Red Plus NAS

nas3: Synology DS-224+; 2 x 12TB Seagate NAS

dcn01: Fractal Meshify S2; Gigabyte Aorus ax570 Master; Ryzen 9 5900x; Noctua NH-D15; 4 x 16GB DDR4-3200; 512GB NVMe; 2 x Zotac AMP 4070ti; Corsair RM750Mx

dcn02: Fractal Meshify S2; Gigabyte ax570 Pro WiFi; Ryzen 9 3950x; Noctua NH-D15; 2 x 16GB DDR4-3200; 128GB NVMe; 2 x Zotac AMP 4070ti; Corsair RM750x

dcn03: Fractal Meshify C; Gigabyte Aorus z370 Gaming 5; i9-9900k; BeQuiet! PureRock 2 Black; 2 x 8GB DDR4-2400; 128GB SATA m.2; MSI 4070 Ti Super Gaming X; MSI 4070 Ti Super Ventus 2; Corsair TX650m

dcn05: Fractal Define S; Gigabyte Aorus b450m; Ryzen 7 2700; AMD Wraith; 2 x 8GB DDR 4-3200; 128GB SATA NVMe; Gigabyte Gaming RTX 4080 Super; Corsair TX750m

dcn06: Fractal Focus G Mini; Gigabyte Aorus b450m; Ryzen 7 2700; AMD Wraith; 2 x 8GB DDR 4-3200; 128GB SSD; Gigabyte Gaming RTX 4080 Super; Corsair CX650m

Link to comment
Share on other sites

Link to post
Share on other sites

Excellent! Thanks for all the advice! Some adjustments to the slots as mentioned does help 😁

 

I could certainly load ESXi and run the appliance as well... if I have time I'll explore that as well.

Link to comment
Share on other sites

Link to post
Share on other sites

1 hour ago, arcangel13579 said:

I could certainly load ESXi and run the appliance as well... if I have time I'll explore that as well.

Multiple slots under Windows I believe would be slightly better performance. I haven't actually benchmarked between the two but the difference should be very minimal. If you can get it using 100% under Windows then I would say leave it as that.

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×