Jump to content

water-cooled, 1U SSD mining server!

This build is now officially caled the Plot device! 😄

 

Welp, here i am again, starting another build while only last week i finished the previous one. This may be getting out of hand.

 

Anyway, here's the situation: I wanna mine Chia coin. Chia is a crypto you don't mine in your regular sense, but you 'mine' it using storage, on a proof of time and proof of space basis.

So that's where this server comes in. It's a 1U Supermicro box rocking a Xeon E5 2620V3 And 64GB of RAM.

1618989411291.thumb.jpeg.562d3bd58a81650bbc9650acab0cf059.jpeg

1618989411294.thumb.jpeg.a23c86b4c2c6c5a5cc67b3211b28b16d.jpeg

 

This ofcourse, won't do. So here's the specs i want to put into this box:

 

Xeon E5 2680 V4 14-core

128GB ECC DDR4

20TB (10x 2TB drives) SATA SSD's

watercooling!

 

Alphacool 1U DDC pump mount

Alphacool 1Ux 6 radiator

Alphacool 1U CPU block

Alphacool soft tubing/fittings.

 

i'm still waiting on parts, so this is where she now stands. But i've got a little sneak-peek of things to come. 😉

1618989411277.thumb.jpeg.efb9f288f05edc98ba69e18bc2a7dfa8.jpeg

 

1618989411284.jpeg

Link to comment
Share on other sites

Link to post
Share on other sites

whats the coin value of 1 chia ? I cant seem to find any info regarding that

Link to comment
Share on other sites

Link to post
Share on other sites

Cant wait for the doomer post to this thread, Nice build!

Press quote to get a response from someone! | Check people's edited posts! | Be specific! | Trans Rights

I am human. I'm scared of the dark, and I get toothaches. My name is Frill. Don't pretend not to see me. I was born from the two of you.

Link to comment
Share on other sites

Link to post
Share on other sites

3 minutes ago, Haraikomono said:

whats the coin value of 1 chia ? I cant seem to find any info regarding that

I don't think it has a value yet. Transactions with chia are planned to be enabled may 3rd.

Link to comment
Share on other sites

Link to post
Share on other sites

2 hours ago, Lobstar said:

Nice rig!  I take it this is just for bulk plotting then offloading the plots to some other box?

yep, i'm still debating what box i want that to be, but i'm leaning towards getting another 4U box and just crammin it full with HDD's

Link to comment
Share on other sites

Link to post
Share on other sites

welp, i've got the loop together... almost. i'll explain in more detail below.

 

first things first, i've got the CPU block and the pump/res in!

alphacool calls it a pump/res anyway, imo it;s more of a pump mount. not much res area to speak of here.

1619203699174.thumb.jpg.d6c9731203f70427ecc22ecf511c1a67.jpg

 

i first had it mounted straight with a fitting into the rad, but that wouldn;t work. This would mean i had everything mounted on the outlets of the pump, nothing going in. welp.

i instead settled for mounting it a bit further back and using another piece of tube with some fittings. now the loop could actually work! 😛

 

1619203472818.thumb.jpg.63217a302c1210095668931e3be48a54.jpg

I also had a bit of an clearance issue with the CPU block sadly. This means i cannot use one of the RAM channels because that's where the fittings live. i'm still debating if it would be worth it to swap out some 16GB sticks for 32Gb sticks just to get the 128GB's, but i think 96GB's would get me far enough as well.

 

Other things i added include a PCIe to M.2 crad with space for 2 M.2's. right now it's populated by one 512Gb drive, but i plan on upgrading this to 2 1TB drives in RAID 0 for ultra-fast plotting.

 

and one final issue: the pump i got secondhand came with an aftermarket pumphousing with cooling ribs. Those sadly mean that the pump won;t fit. i already ordered a new housing that would solve this issue, but it still. The loop could be filled if it wasn't for that pump housing. 😞

 

anyway, more pics as the build comes together.

Link to comment
Share on other sites

Link to post
Share on other sites

My wallet can't handle the fomo here... Nice build though

[Out-of-date] Want to learn how to make your own custom Windows 10 image?

 

Desktop: AMD R9 3900X | ASUS ROG Strix X570-F | Radeon RX 5700 XT | EVGA GTX 1080 SC | 32GB Trident Z Neo 3600MHz | 1TB 970 EVO | 256GB 840 EVO | 960GB Corsair Force LE | EVGA G2 850W | Phanteks P400S

Laptop: Intel M-5Y10c | Intel HD Graphics | 8GB RAM | 250GB Micron SSD | Asus UX305FA

Server 01: Intel Xeon D 1541 | ASRock Rack D1541D4I-2L2T | 32GB Hynix ECC DDR4 | 4x8TB Western Digital HDDs | 32TB Raw 16TB Usable

Server 02: Intel i7 7700K | Gigabye Z170N Gaming5 | 16GB Trident Z 3200MHz

Link to comment
Share on other sites

Link to post
Share on other sites

Welp, this reply is well overdue.

 

Currently, the server is running and plotting away. Its definitely not completed yet though! I still need to get the new pump housing and fix some other things like a minor leak in a set of fittings.

Anyway, the fans arrived!

nocs.thumb.jpg.60ee685fe7d3b575cd1201896ae86adc.jpg

 

Gotta love the way-too-bulky packaging Noctua provides with their teeny-tiny 40mm fans.

In my previous config i managed to fit 5 fans on the radiator. Mostly because there was no way for me re arrange the fittings without interfering even more with things like RAM clearance.

686548241_oldconfig.thumb.jpg.aaaeb43ec7676a9c2ba3de4727df9394.jpg

 

But with some puzzling, and some more fittings in there i managed to squeeze a 6th fan in there! 😄

361838131_newconfig.thumb.jpg.db9847527de3c87390db1667ceb6449d.jpg

1408001413_6fansin.thumb.jpg.398e1e0966cbd4d9bf89ae99bd272602.jpg

 

The cables are definitely a problem. I'll try to manage them a bit better somehow, but i'm afraid i might have to cut, splice and solder them together for a cleaner look.

Also, this set of new fittings leaks. Its probably the tiniest leak i've ever had in a waterloop, but a leak nontheless. it loses about a drop of water every few hours.

 

Anyway, this is how she now stands. It's plotting 14 plots simultaneously on all drives, and it runs quite literally circles around the old Dell R510 i was previously using for CHIA plotting.

 

Things to do in the next update:

- fix the leak

- mount new pump housing, so i can actually fit the cover on the server

- manage fan cables

- swap PSU fans for silent models

- attach long-term CHIA storage in the form of a JBOD!

 

Speaking of JBOD, i got a nice deal on this lovely specimen:

JBOD.thumb.jpg.fe31e3c4586eb0ad71b77da41d9ebf0d.jpg

 

15 drives ought to do it for now, but these babies can be daisy chained!

Too bad it sounds like a jet fighter taking off. This thing is definitely going to need silencing aswell.

 

 

Link to comment
Share on other sites

Link to post
Share on other sites

Love the project.  Ya those server systems are noisy. I am about to water cool my nas. All the parts are here except the gpu waterblock. It’s got about 40tb and it’s plotting now. About 4tb plotted as right now. Its taking a while but I am down to 1 month estimated return with only 4tb plotted so good as far as I can tell. 

Link to comment
Share on other sites

Link to post
Share on other sites

26 minutes ago, Hill160881 said:

Love the project.  Ya those server systems are noisy. I am about to water cool my nas. All the parts are here except the gpu waterblock. It’s got about 40tb and it’s plotting now. About 4tb plotted as right now. Its taking a while but I am down to 1 month estimated return with only 4tb plotted so good as far as I can tell. 

what are you plotting on? SSDs, HDDs? i get about 18 simultaneous plots on this machine, got about 5TB plotted now. it definitely takes a while but so far the future trades available for CHIA are looking quite promising. it might just become valuable!

Link to comment
Share on other sites

Link to post
Share on other sites

1 hour ago, RollinLower said:

what are you plotting on? SSDs, HDDs? i get about 18 simultaneous plots on this machine, got about 5TB plotted now. it definitely takes a while but so far the future trades available for CHIA are looking quite promising. it might just become valuable!

I am plotting on 8 wd red 4tb platter drives striped, about 30tb. I also have a 10tb in a hot swap bay. So really slow but moving along nice at only 1/2 system memory allocation.  It has 64gb ram so I am allowing 32 for the plotting. The system will still game at 4K 120 with it plotting. 

Link to comment
Share on other sites

Link to post
Share on other sites

Welp, over tot some good news and some bad news. 

 

Let's start with the good news first. I finally got the new pump housing in!

This means the pump now sits a lot lower, and I can finally close the lid on this box.

IMG_20210430_171845.thumb.jpg.8a025e33f7f112d0a91fea4f31a04b2a.jpg

 

It looks a lot worse and it's just plastic instead of aluminum like the other one, bit this photo should really drive home the point why this one's better fit for this build:

IMG_20210430_171854.thumb.jpg.e21d50f69c3787815715b4a89e4a2a6a.jpg

 

Now the bad news. I tried silencing one of the PWS-706P-1R powersupplies. 

I got new 40mm fans that spin at a max of about 4k rpm. The fans in the psu don't use a normal header, but the signal is actually normal PWM. So all I had to do was cut the wires and splice them together.

IMG_20210430_174953.thumb.jpg.5888def4b909d73aa2397c0faeccf37e.jpg

 

Old fan on the left, new fan on the right.

IMG_20210430_172603.thumb.jpg.1a3cbb0f55509d337ade95ebbc8ada5c.jpg

 

Sadly, it seems the server doesn't accept this. I guess the PWM threshold is set for a value higher than the RPM this fan will provide, and it shuts the PSU down as faulty. 

Sigh.. guess I'll have to figure something out. Maybe a arduino or something to spoof the PWM signal?

 

Anyway, she's back in the rack again happily plotting away for now. Even though a bit noisy for my tastes.

IMG_20210430_211402.thumb.jpg.193bea9986431850bf49b5b6c8eed3ca.jpg

Link to comment
Share on other sites

Link to post
Share on other sites

update time!

 

after a few hours of carefull consideration i got to the conclusion that modding the existing PSU's just wasn;t gonna be worth it. too much hassle, too little reward.

instead, i opted to just replace the power delivery entirely!

 

the stock SuperMicro PSU's could deliver up to 1400 Watts when running in tandem. all the while this system only draws about 200 watts from the wall with every SSD populated and the CPU running at 100%. absolute overkill. meaning i could get away with just a little 300 to 400 watt flex ATX PSU!

 

the model i chose is a Silverstone SST-FX350-G

900017794_psuout.thumb.jpg.26756db9cce66ab6bb8f57747d85efa7.jpg

 

mostly because it was the only model above 300 wats readily available, and also because it had same-day shipping.

this thing is just as high as a normal 1U PSU, but it's a bit shorter and wider. meaning the old PSU cage and power breakout board had to go. 

677585485_allin.thumb.jpg.1332ff33a2277438f2ecd999c062f55d.jpg

 

You can see here that the old PSU cage is riveted into the main chassis, bit it actually isn't part of the structure. so removing it really wont impct the structure of the case.

underneath the little plastic cover above the PSU cage sits the power breakout board, which converts the finger-style connector of the hotswap PSU's into regular old ATX, SATA and Molex connections. this also has to go, and i'll start here.

 

powerboard.thumb.jpg.daf2ff0156ac8d8e6f1056445c009ed6.jpg

 

lucky for me this little board is only held in with 4 screws, and pops out easily enough.

that still leaves the PSU cage.

 

1930403937_psuframe.thumb.jpg.d6ea25cab2edd9b175e939a3dd5d40d2.jpg

 

it took some drilling, but it also came out easily enough! a lot easier than i expected actually.

the only hurdle i got a little stuck on was a screw hidden behind the rack rails, keeping the cage in even after drilling out all rivets. once i figured that out it popped out and i got a whole lot of nothing where the old power delivery used to sit.

 

1058688123_allout.thumb.jpg.b23f6b6e0b142c975c33b85859268b32.jpg

 

one nice thing i found out is that the little plastic cover for the old breakout board still mounts into the chassis just fine, it's only held in with 3 clips which didn't come out with the PSU cage. free cable management space!

 

anyways, in goes the new PSU.1172977076_psuin.thumb.jpg.4265bbeb74b099fe0acefdfae3e97382.jpg

 

like a glove!.. somewhat like a glove anyway.

i just stuck some double sided tape under it and it sits firmly in place. maybe someday i want to 3D print something to fully close off the chassis again, but i guess leaving it open around the PSU won't hurt airflow either.

 

just a little time for cable management, and there you go! a whisper quiet server system! 😄 

837761971_cablemanagement.thumb.jpg.d36ef1ce1322a20fa5e0f85a78997f7e.jpg

 

the last hurdle for this project turned out to be the molex power for the front SSD backplane.

SuperMicro used right angle molex connectors, while this PSU came with the normal straight type. so with these molex connectors, my radiator wouldn't fit.

 

i ended up just cutting the new PSU's cable, and splicing it together with the old molex cable from the power breakout board. i had to solder the wires together again, and in the absence of proper heatshrink i instead just used some elctrical tape to isolate each wire. i still would like to use some heatshrink to atleast cover the tape, but its fine for now. 

1579681630_solderedmolex.thumb.jpg.bd4f7a061708be5ab96e51e9b94f45b6.jpg

 

welp, that's about it! it's happily plotting away, and all the while it's nearly silent. i'd call that mission accomplished.

 

things maybe to change in the future:

- get a manual fan controller for pump speed. the motherboard keeps ramping/slowing the pump, which doesn't seem to get fixed with on board fan control. not a huge deal tough, the pump is pretty quiet.

-  3D print a mount for the PSU so it sits a bit nicer. (like, atleast not mounted with tape)

 

here's some final shots with a better camera, and i'll also inlcude a shot of the setup so you can understand why i want it to be quiet!

IMG_1480.thumb.JPG.54611e9efe1ce542a5afb0897f9fcd31.JPG

IMG_1482.thumb.JPG.fc5766c459e042451e82bfe0cc0f3c46.JPG

Link to comment
Share on other sites

Link to post
Share on other sites

Very nice. I want to build a server rack at some point but I just don’t have the space, or I would rather use the space for other things lol. 

Link to comment
Share on other sites

Link to post
Share on other sites

Welp, since my last post my server rack and this build changed a bit again.

 

i got rid of the dell R510, and got a 4U supermicro JBOD enclosure with 24 bays, which i hooked up with external SAS and a LSI HBA to the 1U server.

IMG_20210505_192040.thumb.jpg.48ddbe4ef509c7308e9aee33b2c32561.jpg

 

In total i got 7 14TB drives, 10 2TB SSD's and a lot of free space for growth! 

Link to comment
Share on other sites

Link to post
Share on other sites

I discussed a server rack build with my family and they want to stick to smaller systems. I was hoping to convince them to let me build something like this but no. I did convince them to build a thread ripper system so compromise. 

Link to comment
Share on other sites

Link to post
Share on other sites

  • 4 weeks later...

Hey A fellow Chia Farmer! I've gone heavy on this as well!

 

Net space is insane though but a fun project, hopefully you got some coin early on!

AMD Motherboard Tier List  GPU Cooling Tier List  PSU Tier List  A Dive Into Custom Keyboards & Mechanical Switches

NEWCOMERS Remember to ' Reply ' to comments in order for people to see them, this is done by clicking the arrow icon at the bottom of a comment (Quote).

My Builds:

MEGA Desk Build

 

Blueberry Pi  R9 3950X  Asus X470 ROG Crosshair VII Hero Wi-Fi ATX  Corsair Vengeance RGB Pro 4x16GB 3200MHz CL16  EVGA GTX 1080Ti SC Black Edition 11GB  EVGA P2 850W w/ Blue Sleeved Cables  Cryorig R1 Universal (Blue)  2x Corsair Force MP510 4TB w/ Asus Hyper m.2 V2  Corsair ML Pro Blue LED Fans  Fractal Design Meshify C TG ATX Mid Tower  

Asus ROG SWIFT PG348Q 100Hz IPS G-Sync UW  Dell UltraSharp U3419W 60Hz IPS UW  Custom TOFU96  Corsair Scimitar Pro RGB 

 

Work Rig  ThreadRipper 3970X  Asus Prime TRX40 Pro ATX  G.Skill RipjawsV 8x32GB 3200Mhz CL16  Nvidia Quadro RTX 6000 24GB  Corsair HXi 1000W  EVGA CLC 360 AIO  8x Sabrent Rocket 2TB w/ 2x Asus Hyper m.2 V2   Arctic P12 Fans  Phanteks P400A ATX Mid Tower 

 

Plotting Machine 1  ThreadRipper 2990WX  AsRock X399 Taichi ATX  Kingston HyperX Fury 8x16GB 2666Mhz CL18   Nvidia Quadro K600 1GB  Corsair RMx 850W  EVGA CLC 360 AIO ‖ 2x Sabrent Rocket 2TB & 2x Sabrent Rocket 4TB w/ Asus Hyper m.2 V2  Arctic P12 Fans  Rosewill RSV-L4500 4U  5x Dell DS60 60-bay JBOD w/ 1.2PB of HDD Storage  HP 22U Half Rack

 

Plotting Machine 2  R9 3950X  Asus TUF X570-Plus Wi-Fi ATX  G.Skill RipjawsV 4x16GB 3200Mhz CL16   Nvidia Quadro K600 1GB  Corsair RM 650W  Noctua NH-D15s Chormax ‖ 4x Corsair MP600 Force 1TB W/ Asus Hyper m.2 Gen4  Arctic P14 & P12 Fans  Silverstone FARA R1 ATX Mid Tower

 

J.A.R.V.I.S.  R9 3900XT  Asus B550-I ROG STRIX Wi-Fi ITX  G.Skill Ripjaws V 2x16GB 3600MHz CL16  EVGA GTX 1080 SC2 iCX 8GB  Corsair SF 750W Platinum  Corsair H100i Pro AIO  Noctua NF-A12x15 Chromax Fans  FormD T1 SFF ITX Case  

LG 75UM8070PUA 4K UHD 120Hz IPS HDR TV  Corsair K63 Cherry MX Red Special Edition Wireless  Corsair Ironclaw RGB Wireless

 

Archive Server  R3 2200G  Asus B450-I ROG STRIX Wi-Fi ITX  Corsair Vengeance RGB Pro 2x8GB 3200MHz CL16 White  Vega Integrated Graphics  EVGA P2 750W  Prism Wraith Cooler  ITX Open Bench  2x HP SAS Expander  LSI-SAS9211  220TB of HDD Storage

 

SFF ITX Home PC  i5-7500  MSI B250I Gaming Pro Wi-Fi AC ITX  G.Skill Ripjaws V 2x8GB 2800MHz  Intel Integrated Graphics  Seasonic SSP Flex ATX 300W PSU  Cryorig C7  Velka 3 rev 1.2 SFF ITX Case (Grey)  

 

Laptop  Dell XPS13 2-in-1 7390 (2020)  i7-1065G7  32GB 3733MHz LPDDR4x  Intel Integrated Graphics  1TB NVME M.2  UHD+ (3840 x 2400) InfinityEdge Touch Display 

 

Keyboard Collection  GMMK Full Size  TOFU96 90%  ‖ KBD8x MKII TKL ‖ Drop CTRL High Profile TKL ‖ KBD Bella 75% ‖ GMMK Pro 75% ‖ XD84 Pro 75%  KBD67 V2 MKII 65%  KBD67Lite 65%  TOFU65 65%  KBD Blade 60%  Drop Carina 60%  Southpaw75 60% w/ Left Numpad  OLKB Preonic V3 Ortholinear ‖ CosPad XD24  ‖ KBDPad MKII

 

Key Cap Collection  GMK Boba Fett  GMK Red Samurai  GMK Laser CyberDeck +Novalties  GMK Arch  MaxKey B&W  Drop MT3 Camillo ‖ Matt3o MT3 /dev/tty  KBDfans Biip Torii Ext-2048  ePBT Less But Better +Novalties  EnjoyPBT Dolch  WinMix Mustard  Drop Skylight Horizon & Slate ‖ Glorious Black Aura   

 

Mechanical Key Switch Collection  Zealios V2 65g  Zealios V2 78g ‖ Zilents V2 67g  Tealios V2 67g  C³ Kiwi ‖ C³ Tangerine  Invyr Holy Panda  Durock T1 67g  Kailh Box Thick Jades ‖ Kailh Box Royal ‖ Kailh Box Heavy Dark Yellow ‖ Kailh Box Heavy Burnt Orange  Kailh Box White  Kailh Box Red  Kailh Pro Purple  Kailh Pro Burgandy  Gateron Ink Black V2  Gateron Black  Gateron Yellow  Gateron Brown  Gateron Green  Gateron Blue ‖ Cherry MX Black ‖ Cherry MX Brown ‖ Cherry MX Red

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×