Watercooled 7x 980Ti Octane Render Workstation

[Xiauj]

@smicha, Hi!

What software do you use to render Octane stuff with?

Kind of curious, lol because I'm planning to do some Octane renders as well as Gaming/Other workstation stuff when I get my new PC setup _{(eventually..)} !

 

~Xiauj

[Tech_Dreamer]

On 7/22/2016 at 6:23 AM, Teddy07 said:

What the hell are you rendering with 8 gtx 980 tis?

 

/jk /s

[dragoon20005]

 

ZOMG you cut the DVI ports with a disc cutter?!

 

that is a lot of cutting involved here

[8uhbbhu8]

Holy Fuck...   Followed!!!

[smicha]

AC waterblocks applied  - I wish they provide thermal pads like EK, or even attach thermal compound. If possible I use EK next time. Sorry AC but you should not save on it. 

 

 

 

 

 

 

 

[p0Pe]

That looks so insanely cool! Remember to test it with presurized air before filling. AC just released a tool for that that makes it very easy.

[SonoDanshi]

Loving this so far - definitely following the progress on this one. Why Nvidia insists on keeping the DVI on the high end GPUs is a complete mystery to me.

[BuckGup]

On 7/21/2016 at 11:03 AM, Pankaic said:

I was going to say "Why no 1080s"...
And then I remembered Nvidia killed SLI.

Also the 980ti has a 384bit bus and the 1080s have a 256bit bus. Also the 980ti has more then 300 more cuda cores so it performs much better in none gaming applications

[smicha]

Let's mount the pumps

 

[Jumper118]

my gtx titan blocks came with thermal pads  

[SnowCore]

This is mental. subbed.

[smicha]

9 hours ago, Jumper118 said:

my gtx titan blocks came with thermal pads  

Not theses ones on memory chips - thermal compound musts be used. Moreover AC does not include thermal compound. 

 

PS. Guys, I am building another 7x on water, this time with xeons v4. Stay tuned for another build log

[Simon771]

When you are done, put all GPUs to 100% load and let me know what temps you get

Boiling water I bet!

[smicha]

2 minutes ago, Simon771 said:

When you are done, put all GPUs to 100% load and let me know what temps you get

Boiling water I bet!

Here you are - sit firmy not to fell on floor:

Hottest gpu - 47C! - under full load after 24h of rendering. Coldest gpu 36C! 

 Any questions? 

 

[Simon771]

Just now, smicha said:

Here you are - seat firmy not to fell on floor:

Hottest gpu - 47C! - under full load after 24h of rendering. Coldest gpu 36C! 

 Any questions? 

 

Woow mate those are great temps lol.

I was expecting much higher temps with 7x those GPUs

Only GPUs in that loop or also CPU?

[smicha]

CPU too  But water goes first to CPU. Stay tuned for details. 

[smicha]

 

[multifrag]

8 hours ago, smicha said:

 

I'm not familiar with blender, but what are the limitations of octane renderer?  Gpu rendering has been available for quite a while, but major renderers are still resisting from implementing this feature. Wonder why?

[smicha]

22 minutes ago, multifrag said:

I'm not familiar with blender, but what are the limitations of octane renderer?  Gpu rendering has been available for quite a while, but major renderers are still resisting from implementing this feature. Wonder why?

I am not sure what you are asking for?

[multifrag]

5 hours ago, smicha said:

I am not sure what you are asking for?

Does Octane renderer have any limitations in terms of writing your own shaders, texture management, physically based lighting and so on. Arnold for maya had to get gpu support back in 2014 and nothing came out of it... so I'm trying to understand the reasoning behind not implementing gpu rendering as renderers in the industry rely mainly on cpu power

[smicha]

https://docs.otoy.com/#28New Features in v3

[Snooli]

22 hours ago, multifrag said:

Does Octane renderer have any limitations in terms of writing your own shaders, texture management, physically based lighting and so on. Arnold for maya had to get gpu support back in 2014 and nothing came out of it... so I'm trying to understand the reasoning behind not implementing gpu rendering as renderers in the industry rely mainly on cpu power

The main reason is VRAM. That's also why you see 24GB VRAM on Quadro cards. And once you start memory paging, the performance advantage of GPUs is lost completely. That's also the reason why AMD started to experiment with high density flash on graphic cards (Radeon Pro SSG), they only had it done in a very useless way on the prototype.

[smicha]

8 hours ago, Snooli said:

The main reason is VRAM. That's also why you see 24GB VRAM on Quadro cards. And once you start memory paging, the performance advantage of GPUs is lost completely. That's also the reason why AMD started to experiment with high density flash on graphic cards (Radeon Pro SSG), they only had it done in a very useless way on the prototype.

Not exactly. Octane has so called OOC - out of core rendering mode - and we can use a regular DDR to load textures on. I know users who render over 100GB scenes. And with instancing limits are even less. Surely 24GB is great for geometry but 6GB is fine. The greatest advantage of octane is speed and beautiful unbiased kernels. A month ago I rendered a short animation on this machine within 2 days - on 2 xeons it took 7 weeks. BTW There are some news on future Octane 4 that will be few times faster than v3. I am absolutely not saying Octane is the best in every aspect, but it surely shines. 

[Snooli]

2 hours ago, smicha said:

Not exactly. Octane has so called OOC - out of core rendering mode - and we can use a regular DDR to load textures on. I know users who render over 100GB scenes. And with instancing limits are even less. Surely 24GB is great for geometry but 6GB is fine. The greatest advantage of octane is speed and beautiful unbiased kernels. A month ago I rendered a short animation on this machine within 2 days - on 2 xeons it took 7 weeks. BTW There are some news on future Octane 4 that will be few times faster than v3. I am absolutely not saying Octane is the best in every aspect, but it surely shines. 

Good work on the Otoy guys part. I have some experience with Blender's Cycles, and Cycles just crash when it can't fit the scene into VRAM. There is also a developer branch that supports memory paging, but people say it is very taxing on performance. 

[smicha]

Yes - OOC reduces speed by around 20%.