Jump to content

Water cooling in a super computer called Trinity

Somebody call Mario

I’m sure your gaming PC is astonishingly powerful and some of you probably have some pretty incredible custom built water cooling solutions, but they don’t stand a chance next to the water cooling system currently being installed at the Los Alamos’ Strategic Computing Center for the new Trinity supercomputer. Previous supercomputers at the SCC have been air-cooled, so this upgrade to the massive building needs to be in place before Trinity can start to be installed. Just be thankful you don’t have to upgrade your house when you get a new PC.
 

In this case however the cost is a little more than what you might have paid for your gaming PC, with U.S. Department of Energy’s National Nuclear Security Administration paying $174 million, to US supercomputer hardware company Cray, to make a multi petaflop supercomputer system. According to the NNSA the supercomputer will be used to simulate “the safety, security, and effectiveness of the U.S. nuclear deterrent without the use of underground testing,” and when you put it like that, the $174 million bill suddenly doesn’t look so bad.
 

The actual Trinity supercomputer, a next generation Cray XC machine, will be placed on top of all of those pipes and running through the pipes will be water from Los Alamos National Laboratory’s Sanitary Effluent Reclamation Facility (SERF) that has been cooled by a cooling plant. No fancy lights on this machine though, so your gaming rig wins that round, for now. Inside the machine itself is going to be a combination of an unknown number of future-generation Haswells (probably 14-18 cores) and future Knights Landing processors (probably 72 cores per chip and 3 teraflops of peak performance!), complemented by an 82 petabyte capacity Cray Sonexion, distributed storage system with a throughput of 1.7Tbps (terabytes per second).
 

“If this system were delivered today, it would be the fastest in the world” according to Barry Bolding, vice president of storage marketing at Cray. But there is at least a year before the supercomputer is delivered and installed, so by then there may be new competitors for the top spot in the world-wide supercomputer ranking, the so-called top500.
 

The internals however, should give it the power it needs to compete with, if not overtake, the world’s fastest supercomputer, since June 2013, the Chinese Tianhe-2 at China’s National University of Defense Technology. This system currently delivers around 33.86 petaflop/s (quadrillions of calculations per second) and is mainly made up of Intel Ivy Bridge Xeon processors and Xeon Phi chips, with a total of 3,120,000 cores. The current number two is only a measly 17.59 petaflops.

gUCvjKD.jpg
Ever wanted to be a computer plumber?

Source : http://www.kitguru.net/channel/science/brendan-morgan/water-cooling-in-a-super-computer-called-trinity/

 

Spoiler
Spoiler

AMD 5000 Series Ryzen 7 5800X| MSI MAG X570 Tomahawk WiFi | G.SKILL Trident Z RGB 32GB (2 * 16GB) DDR4 3200MHz CL16-18-18-38 | Asus GeForce GTX 3080Ti STRIX | SAMSUNG 980 PRO 500GB PCIe NVMe Gen4 SSD M.2 + Samsung 970 EVO Plus 1TB PCIe NVMe M.2 (2280) Gen3 | Cooler Master V850 Gold V2 Modular | Corsair iCUE H115i RGB Pro XT | Cooler Master Box MB511 | ASUS TUF Gaming VG259Q Gaming Monitor 144Hz, 1ms, IPS, G-Sync | Logitech G 304 Lightspeed | Logitech G213 Gaming Keyboard |

PCPartPicker 

Link to comment
Share on other sites

Link to post
Share on other sites

hehe that's cool. But its used all the time in datacenters on even larger scale.

Intel I9-9900k (5Ghz) Asus ROG Maximus XI Formula | Corsair Vengeance 16GB DDR4-4133mhz | ASUS ROG Strix 2080Ti | EVGA Supernova G2 1050w 80+Gold | Samsung 950 Pro M.2 (512GB) + (1TB) | Full EK custom water loop |IN-WIN S-Frame (No. 263/500)

Link to comment
Share on other sites

Link to post
Share on other sites

ugh..

 

Love the technology, hate the purpose. Nuclear detterrent? really? Only america....

 

 

Meanwhile Titan (amongst others) is being used to simulate a combustion chamber amongst other ACTUALLY USEFUL things that may indeed improve our lives. 

 

How will this improve my life?

This is what I think of Pre-Ordering video games: https://www.youtube.com/watch?v=wp98SH3vW2Y

Link to comment
Share on other sites

Link to post
Share on other sites

hehe that's cool. But its used all the time in datacenters on even larger scale.

I thought datacentre watercooling was uncommon since a leak could destroy some very expensive hardware and result in some very expensive downtime. Plus, if Linus's whole room watercooling project is anything to go by, it's probably much easier to just air-cool datacentres with the help of huge air conditioners.

 

"Nuclear deterrent"? I don't really understand what that is or why you need a supercomputer for it. O.o

 

EDIT: Datacentre cooling terminology doesn't seem that consistent, so it's possible that "watercooling" a datacentre doesn't actually mean pumping water through blocks which are directly attached to the heat generating components. O.o

Link to comment
Share on other sites

Link to post
Share on other sites

I reckon you don't really need a supercomputer for that. But whatevs.

I cannot be held responsible for any bad advice given.

I've no idea why the world is afraid of 3D-printed guns when clearly 3D-printed crossbows would be more practical for now.

My rig: The StealthRay. Plans for a newer, better version of its mufflers are already being made.

Link to comment
Share on other sites

Link to post
Share on other sites

Servers are watercooled all of the time. it's a normal thing. I mean this is different, but still logical. 

muh specs 

Gaming and HTPC (reparations)- ASUS 1080, MSI X99A SLI Plus, 5820k- 4.5GHz @ 1.25v, asetek based 360mm AIO, RM 1000x, 16GB memory, 750D with front USB 2.0 replaced with 3.0  ports, 2 250GB 850 EVOs in Raid 0 (why not, only has games on it), some hard drives

Screens- Acer preditor XB241H (1080p, 144Hz Gsync), LG 1080p ultrawide, (all mounted) directly wired to TV in other room

Stuff- k70 with reds, steel series rival, g13, full desk covering mouse mat

All parts black

Workstation(desk)- 3770k, 970 reference, 16GB of some crucial memory, a motherboard of some kind I don't remember, Micomsoft SC-512N1-L/DVI, CM Storm Trooper (It's got a handle, can you handle that?), 240mm Asetek based AIO, Crucial M550 256GB (upgrade soon), some hard drives, disc drives, and hot swap bays

Screens- 3  ASUS VN248H-P IPS 1080p screens mounted on a stand, some old tv on the wall above it. 

Stuff- Epicgear defiant (solderless swappable switches), g600, moutned mic and other stuff. 

Laptop docking area- 2 1440p korean monitors mounted, one AHVA matte, one samsung PLS gloss (very annoying, yes). Trashy Razer blackwidow chroma...I mean like the J key doesn't click anymore. I got a model M i use on it to, but its time for a new keyboard. Some edgy Utechsmart mouse similar to g600. Hooked to laptop dock for both of my dell precision laptops. (not only docking area)

Shelf- i7-2600 non-k (has vt-d), 380t, some ASUS sandy itx board, intel quad nic. Currently hosts shared files, setting up as pfsense box in VM. Also acts as spare gaming PC with a 580 or whatever someone brings. Hooked into laptop dock area via usb switch

Link to comment
Share on other sites

Link to post
Share on other sites

why arent we investing in ocean cooling.

cpu: intel i5 4670k @ 4.5ghz Ram: G skill ares 2x4gb 2166mhz cl10 Gpu: GTX 680 liquid cooled cpu cooler: Raijintek ereboss Mobo: gigabyte z87x ud5h psu: cm gx650 bronze Case: Zalman Z9 plus


Listen if you care.

Cpu: intel i7 4770k @ 4.2ghz Ram: G skill  ripjaws 2x4gb Gpu: nvidia gtx 970 cpu cooler: akasa venom voodoo Mobo: G1.Sniper Z6 Psu: XFX proseries 650w Case: Zalman H1

Link to comment
Share on other sites

Link to post
Share on other sites

why arent we investing in ocean cooling.

Sydney opera house is, see Richard Hammond episode about it, the episode was on Nat Geo and it was brilliant engineering I think.

  ﷲ   Muslim Member  ﷲ

KennyS and ScreaM are my role models in CSGO.

CPU: i3-4130 Motherboard: Gigabyte H81M-S2PH RAM: 8GB Kingston hyperx fury HDD: WD caviar black 1TB GPU: MSI 750TI twin frozr II Case: Aerocool Xpredator X3 PSU: Corsair RM650

Link to comment
Share on other sites

Link to post
Share on other sites

I thought datacentre watercooling was uncommon since a leak could destroy some very expensive hardware and result in some very expensive downtime. Plus, if Linus's whole room watercooling project is anything to go by, it's probably much easier to just air-cool datacentres with the help of huge air conditioners.

 

 

Yup its very common, I don't mean pumping liquid through blocks its more used as a massive heat exchanger for the hot air (A/C Unit). The fans cools the servers and the water takes the heat away. Data centers rely on this method so much that if the pumps that run the liquid fail, the servers would overheat and die before anyone could issue a command to shut them down. Thats why most Data centers have more than one source of power (2 power suppliers, diesel generators) as well as probably N+1 redundancy Meaning everything has a replacement ready to failover if one fails.

Intel I9-9900k (5Ghz) Asus ROG Maximus XI Formula | Corsair Vengeance 16GB DDR4-4133mhz | ASUS ROG Strix 2080Ti | EVGA Supernova G2 1050w 80+Gold | Samsung 950 Pro M.2 (512GB) + (1TB) | Full EK custom water loop |IN-WIN S-Frame (No. 263/500)

Link to comment
Share on other sites

Link to post
Share on other sites

I reckon you don't really need a supercomputer for that. But whatevs.

 

You actually do. A lot of the supercomputing power on the EARTH is used for defence purposes, for a good reason. 

Link to comment
Share on other sites

Link to post
Share on other sites

I thought datacentre watercooling was uncommon since a leak could destroy some very expensive hardware and result in some very expensive downtime. Plus, if Linus's whole room watercooling project is anything to go by, it's probably much easier to just air-cool datacentres with the help of huge air conditioners.

"Nuclear deterrent"? I don't really understand what that is or why you need a supercomputer for it. O.o

EDIT: Datacentre cooling terminology doesn't seem that consistent, so it's possible that "watercooling" a datacentre doesn't actually mean pumping water through blocks which are directly attached to the heat generating components. O.o

Google data centers literally come in shipping containers with the fluid paths integrated. The water runs directly over the heatsink blocks of the components.

Software Engineer for Suncorp (Australia), Computer Tech Enthusiast, Miami University Graduate, Nerd

Link to comment
Share on other sites

Link to post
Share on other sites

Mandatory "But can it run Crysis"

Servers are watercooled all of the time. it's a normal thing. I mean this is different, but still logical. 

Yes they are. I'm fairly sure I saw some video from one of Google's  datacenters where they used watercooling

Link to comment
Share on other sites

Link to post
Share on other sites

Mandatory "But can it run Crysis"

Yes they are. I'm fairly sure I saw some video from one of Google's  datacenters where they used watercooling

I do too. I don't know what they use, and intel actually submerges some of theirs if I remember right, but most use something like the Asetek system for those wondering. 

muh specs 

Gaming and HTPC (reparations)- ASUS 1080, MSI X99A SLI Plus, 5820k- 4.5GHz @ 1.25v, asetek based 360mm AIO, RM 1000x, 16GB memory, 750D with front USB 2.0 replaced with 3.0  ports, 2 250GB 850 EVOs in Raid 0 (why not, only has games on it), some hard drives

Screens- Acer preditor XB241H (1080p, 144Hz Gsync), LG 1080p ultrawide, (all mounted) directly wired to TV in other room

Stuff- k70 with reds, steel series rival, g13, full desk covering mouse mat

All parts black

Workstation(desk)- 3770k, 970 reference, 16GB of some crucial memory, a motherboard of some kind I don't remember, Micomsoft SC-512N1-L/DVI, CM Storm Trooper (It's got a handle, can you handle that?), 240mm Asetek based AIO, Crucial M550 256GB (upgrade soon), some hard drives, disc drives, and hot swap bays

Screens- 3  ASUS VN248H-P IPS 1080p screens mounted on a stand, some old tv on the wall above it. 

Stuff- Epicgear defiant (solderless swappable switches), g600, moutned mic and other stuff. 

Laptop docking area- 2 1440p korean monitors mounted, one AHVA matte, one samsung PLS gloss (very annoying, yes). Trashy Razer blackwidow chroma...I mean like the J key doesn't click anymore. I got a model M i use on it to, but its time for a new keyboard. Some edgy Utechsmart mouse similar to g600. Hooked to laptop dock for both of my dell precision laptops. (not only docking area)

Shelf- i7-2600 non-k (has vt-d), 380t, some ASUS sandy itx board, intel quad nic. Currently hosts shared files, setting up as pfsense box in VM. Also acts as spare gaming PC with a 580 or whatever someone brings. Hooked into laptop dock area via usb switch

Link to comment
Share on other sites

Link to post
Share on other sites

You actually do. A lot of the supercomputing power on the EARTH is used for defence purposes, for a good reason. 

 

I'm not convinced it's possible to write an algorithm to determine the effectiveness of a deterrent (inherently a psychological thing, I think we can agree) that's so accurate that it would warrant the use of such an expensive piece of equipment.

 

It doesn't take a supercomputer or even a particularly intelligent human to determine that yes, a nuclear arsenal has been and for some time will continue to be a very effective deterrent.

I cannot be held responsible for any bad advice given.

I've no idea why the world is afraid of 3D-printed guns when clearly 3D-printed crossbows would be more practical for now.

My rig: The StealthRay. Plans for a newer, better version of its mufflers are already being made.

Link to comment
Share on other sites

Link to post
Share on other sites

I'm not convinced it's possible to write an algorithm to determine the effectiveness of a deterrent (inherently a psychological thing, I think we can agree) that's so accurate that it would warrant the use of such an expensive piece of equipment.

 

It doesn't take a supercomputer or even a particularly intelligent human to determine that yes, a nuclear arsenal has been and for some time will continue to be a very effective deterrent.

 

Its not just that. Logistics, planning, counter attack and counter counter attack scenarios; these supercomputers run EVERYTHING. The effects on Wall Street. The Treasury. The fallout. How long it would take for the EARTH to recover, much less the US. What areas would be hit, what areas it makes sense to hit. 

These supercomputers literally spend their time thinking of every possible doomsday scenario and then filing them from "yea right" to "100% likely" 

Link to comment
Share on other sites

Link to post
Share on other sites

Its not just that. Logistics, planning, counter attack and counter counter attack scenarios; these supercomputers run EVERYTHING. The effects on Wall Street. The Treasury. The fallout. How long it would take for the EARTH to recover, much less the US. What areas would be hit, what areas it makes sense to hit. 

These supercomputers literally spend their time thinking of every possible doomsday scenario and then filing them from "yea right" to "100% likely" 

Ah, now I see what you're getting at. Thanks, mate.

 

Still, it kind of annoys me these awesome things are used as instruments of war. That said, if used in that way they can save lives when the day comes that someone is indeed insane enough to start a nuclear war. But then again that's what the idea of M.A.D. is supposed to prevent/deter. I do understand that in the end it's only a matter of time until someone decides to break the relative peace (yes there is fighting going on in some parts of the world but it could be a lot worse), and when they do we'll be ready for it, but part of me still feels that there must be more immediately useful things these computers (or that money) can be used for.

I cannot be held responsible for any bad advice given.

I've no idea why the world is afraid of 3D-printed guns when clearly 3D-printed crossbows would be more practical for now.

My rig: The StealthRay. Plans for a newer, better version of its mufflers are already being made.

Link to comment
Share on other sites

Link to post
Share on other sites

Looks like @LinusTech got some competition with the whole room liquid cooling project he had going. :D

 

But seriously this is pretty cool.

This pretty much destroys anything Linus was doing and on a much larger scale.

I'm Batman!

Steam: Rukiri89 | uPlay: Rukiri89 | Origin: XxRukiriXx | Xbox LIVE: XxRUKIRIxX89 | PSN: Ericks1989 | Nintendo Network ID: Rukiri

Project Xenos: Motherboard: MSI Z170a M9 ACK | CPU: i7 6700k | Ram: G.Skil TridentZ 16GB 3000mhz | PSU: EVGA SuperNova 850w G2 | Case: Caselabs SMA8 | Cooling: Custom Loop | Still in progress 

Link to comment
Share on other sites

Link to post
Share on other sites

But can it run Minecraft?

GPU: GIGABYTE GTX 780 (x2, SLI) CPU: i7 5820k Motherboard: Alienware Aurora R4 Mobo RAM: Corsair Dominator Platinum 32 GB SSD: Samsung EVO 840

HDD: WD Green 3TB Cooler: Corsair H100i

Link to comment
Share on other sites

Link to post
Share on other sites

But can it run Minecraft?

Yep at 20 fps on low graphics... No TNT or it will Lagg!

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×