Jump to content

This Server Deployment was HORRIBLE

nicklmg
By nicklmg
in LTT Releases
 Share
Posted

Guys,

 

Those hard resets could point to power deficiency.

 

What is the instantaneous current for 24 NVME's being hit with data.  WD Black nvme for example quotes peaks of 2.8 Amps for 10us.  That 806 watts!  Your cpu is what approaching 300w.  1200wat psu is not enough. 

 

Is there a way to divide the 24 drives accross 4 or six psu's to eliminate poor power design?

 

Dan

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

edit:  Found it!.

 

For anyone else wondering the video Linus refers to at the start is this one :

 

 

 

PC - NZXT H510 Elite, Ryzen 5600, 16GB DDR3200 2x8GB, EVGA 3070 FTW3 Ultra, Asus VG278HQ 165hz,

 

Mac - 1.4ghz i5, 4GB DDR3 1600mhz, Intel HD 5000.  x2

 

Endlessly wishing for a BBQ in space.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted
On 2/22/2020 at 1:43 PM, hdtvme said:

Guys,

 

Those hard resets could point to power deficiency.

 

What is the instantaneous current for 24 NVME's being hit with data.  WD Black nvme for example quotes peaks of 2.8 Amps for 10us.  That 806 watts!  Your cpu is what approaching 300w.  1200wat psu is not enough. 

 

Is there a way to divide the 24 drives accross 4 or six psu's to eliminate poor power design?

it already has 2 PSU, I don't know if they set up to work together or as failover. They could slide in 1400W or 2000W units in there if they felt power was an issue

Good luck, Have fun, Build PC, and have a last gen console for use once a year. I should answer most of the time between 9 to 3 PST

NightHawk 3.0: R7 5700x @, B550A vision D, H105, 2x32gb Oloy 3600, Sapphire RX 6700XT  Nitro+, Corsair RM750X, 500 gb 850 evo, 2tb rocket and 5tb Toshiba x300, 2x 6TB WD Black W10 all in a 750D airflow.
GF PC: (nighthawk 2.0): R7 2700x, B450m vision D, 4x8gb Geli 2933, Strix GTX970, CX650M RGB, Obsidian 350D

Skunkworks: R5 3500U, 16gb, 500gb Adata XPG 6000 lite, Vega 8. HP probook G455R G6 Ubuntu 20. LTS

Condor (MC server): 6600K, z170m plus, 16gb corsair vengeance LPX, samsung 750 evo, EVGA BR 450.

Spirt  (NAS) ASUS Z9PR-D12, 2x E5 2620V2, 8x4gb, 24 3tb HDD. F80 800gb cache, trueNAS, 2x12disk raid Z3 stripped

PSU Tier List      Motherboard Tier List     SSD Tier List     How to get PC parts cheap    HP probook 445R G6 review

 

"Stupidity is like trying to find a limit of a constant. You are never truly smart in something, just less stupid."

Camera Gear: X-S10, 16-80 F4, 60D, 24-105 F4, 50mm F1.4, Helios44-m, 2 Cos-11D lavs

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Nice to see SOMEONE is reading the forum.

 

There are 2 PSUs but one is standby when other fails.  

 

Hello Linus!!!!!!!!!!!!!!

 

Prove to me its not a power issue.  I think it is.

 

You are attempting something never done B4.  

 

1200 wattts is enough, but not if you don't have proper size decoupling capacitors at each load.

 

How may rails are feeding that bank of 24 ssds? ONE???  LOL!!!

 

Back to basics.  Prove SOMETHING!!

 

HELLO!?!?!?!??!!?

 

Dan

Link to comment
Share on other sites
Link to post
Share on other sites
Posted
2 hours ago, hdtvme said:

Nice to see SOMEONE is reading the forum.

 

There are 2 PSUs but one is standby when other fails.  

 

Hello Linus!!!!!!!!!!!!!!

 

Prove to me its not a power issue.  I think it is.

 

You are attempting something never done B4.  

 

1200 wattts is enough, but not if you don't have proper size decoupling capacitors at each load.

 

How may rails are feeding that bank of 24 ssds? ONE???  LOL!!!

 

Back to basics.  Prove SOMETHING!!

 

HELLO!?!?!?!??!!?

 

Dan

These SSDs are like 20W max. That's like 500W for SSDs, another 200 for CPU and maybe 100 for RAM. Still VERY comfortable lol.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted
4 hours ago, hdtvme said:

-snip

per intels site sssd.JPG.e6da28c4f8ebbb2766b3123551d591b1.JPG

 

It isn't and wasn't going to be a power issues.

you think gigabyte would sell a server that the know if you load up with drives won't have enough power?

Good luck, Have fun, Build PC, and have a last gen console for use once a year. I should answer most of the time between 9 to 3 PST

NightHawk 3.0: R7 5700x @, B550A vision D, H105, 2x32gb Oloy 3600, Sapphire RX 6700XT  Nitro+, Corsair RM750X, 500 gb 850 evo, 2tb rocket and 5tb Toshiba x300, 2x 6TB WD Black W10 all in a 750D airflow.
GF PC: (nighthawk 2.0): R7 2700x, B450m vision D, 4x8gb Geli 2933, Strix GTX970, CX650M RGB, Obsidian 350D

Skunkworks: R5 3500U, 16gb, 500gb Adata XPG 6000 lite, Vega 8. HP probook G455R G6 Ubuntu 20. LTS

Condor (MC server): 6600K, z170m plus, 16gb corsair vengeance LPX, samsung 750 evo, EVGA BR 450.

Spirt  (NAS) ASUS Z9PR-D12, 2x E5 2620V2, 8x4gb, 24 3tb HDD. F80 800gb cache, trueNAS, 2x12disk raid Z3 stripped

PSU Tier List      Motherboard Tier List     SSD Tier List     How to get PC parts cheap    HP probook 445R G6 review

 

"Stupidity is like trying to find a limit of a constant. You are never truly smart in something, just less stupid."

Camera Gear: X-S10, 16-80 F4, 60D, 24-105 F4, 50mm F1.4, Helios44-m, 2 Cos-11D lavs

Link to comment
Share on other sites
Link to post
Share on other sites
  • 2 weeks later...
Posted

How would you go about setting your hard drives from interrupt to polling in linux? 

Link to comment
Share on other sites
Link to post
Share on other sites
  • 1 month later...
Posted

I am going to buying a setup like this, has anyone setup something like this successfully? I would love some help, thanks so much!

Link to comment
Share on other sites
Link to post
Share on other sites
  • 6 months later...
Posted

Linus,

 

Has you or Wendel figured out how to get around the interrupt issues?

 

Have you looked into the 6.4tb or 7.68tb "used" server drives on ebay?

I am currently using 2ea 7.68tb SAS 12gb drives in my Unraid server as cache. All information is stored on those drives and I setup a weekly backup of the full cache to a 57tb array. I am really hoping that Unraid will support SSD arrays with TRIM.

 

Thanks and I would love to see more videos like this.

Link to comment
Share on other sites
Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing LTT Releases

×