The sickest build EVER. You thought Linus was crazy? Think again.

[qwertiuyop]

20 minutes ago, Xreldo said:

Did you rob a bank? ;-;

I did the math, four processors, four SSDs, 256 gigs RAM and 1500 budget for GPUs is around 5000 bucks, maybe a bit more. With chassis and motherboard, maybe another thousand. That is very reasonable for such a powerful system if you ask me. How much does the highest config mac pro cost? 10K dollars. 

[Bajantechnician]

43 minutes ago, qwertiuyop said:

I saw that one coming... The thing is I want to have a computer that I could keep for ideally 7 to 10 years. Today, I edit multistream 4k video. In 7 years, that will easily be something beyond 8k + much more fps. For instance, RED cameras already do 8K 75fps. In few years it will be normal just like 4k is today. 

ill just say, not trying to be a dick, but this is not possible unless you somehow custom build the motherboard, and such, thus spending a massive fortune, If it is possible at all

[qwertiuyop]

Regarding the cards, I could use six 980Tis. Would that be more realistic? Once I saw a 980Ti for 200 euro on Amazon. Unfortunately, I have never come across such a great deal since then, but I keep searching. SLI supports maximum of 4 cards. What do you do if you want to go above that? What are the limitations of linking more cards via a non-SLI method? Linus once made a computer with I believe 8 different cards using a supermicro chassis. 

[SLAYR]

3 minutes ago, qwertiuyop said:

I did the math, four processors, four SSDs, 256 gigs RAM and 1500 budget for GPUs is around 5000 bucks, maybe a bit more. With chassis and motherboard, maybe another thousand. That is very reasonable for such a powerful system if you ask me. How much does the highest config mac pro cost? 10K dollars. 

If you want to be realistic, ES cpus aren't worth it for professional use, and you can't use any intel xeon you. need a 4xxx cpu, the pcie ssds are completely unecessary, there is no point to having them, and 16 gpus just won't be supported by anything, some programs can use up to 8-9 gpus like octane, but most video editing programs won't use the threads in the xeons, and the extra gpus, and $1000 for a chasis, and board is laughable, you for both it would be probabbly a few grand minimum.

[Bajantechnician]

1 minute ago, qwertiuyop said:

Regarding the cards, I could use six 980Tis. Would that be more realistic? Once I saw a 980Ti for 200 euro on Amazon. Unfortunately, I have never come across such a great deal since then, but I keep searching. SLI supports maximum of 4 cards. What do you do if you want to go above that? What are the limitations of linking more cards via a non-SLI method? Linus once made a computer with I believe 8 different cards using a supermicro chassis. 

They were 4 in cx, and 4 in sli

10 minutes ago, theninja35 said:

You can use multiple PSUs to power a computer.

very bad idea

6 minutes ago, qwertiuyop said:

I did the math, four processors, four SSDs, 256 gigs RAM and 1500 budget for GPUs is around 5000 bucks, maybe a bit more. With chassis and motherboard, maybe another thousand. That is very reasonable for such a powerful system if you ask me. How much does the highest config mac pro cost? 10K dollars. 

NO

totally illogical

[Bajantechnician]

3 minutes ago, SLAYR said:

If you want to be realistic, ES cpus aren't worth it for professional use, and you can't use any intel xeon you. need a 4xxx cpu, the pcie ssds are completely unecessary, there is no point to having them, and 16 gpus just won't be supported by anything, some programs can use up to 8-9 gpus like octane, but most video editing programs won't use the threads in the xeons, and the extra gpus, and $1000 for a chasis, and board is laughable, you for both it would be probabbly a few grand minimum.

few THOUSAND grand

[qwertiuyop]

7 minutes ago, Bajantechnician said:

few THOUSAND grand

Like few millions? Well, I don't think so...

[Clanscorpia]

16 GPUs is impossible, 4 CPUs especially ES ones is a massive waste of money, and iirc Intel hasent done 4 CPUs for a long time

[Clanscorpia]

4 minutes ago, qwertiuyop said:

Like few millions? Well, I don't think so...

He means like 3+ thousand

[NumLock21]

After reading your needs. Intel Itanium is your best option.

[qwertiuyop]

7 minutes ago, NumLock21 said:

After reading your needs. Intel Itanium is your best option.

Why would Itanium be better than a 12 core ES xeon v4 for 300 dollars? Also, what do so many folks here have against the ES CPUs? The reviews from people who have actually bought and used them were generally positive. 

 

[Swiftfeather]

Only usage for that many grahpic cards and CPU cores would be for intense virtualization. Would need Custom PCB and likely several power supplies, which isn't unheard of in server builds. 

[bob345]

what you want is not possible unless you want to higher an engineering team to design you a custom motherboard.

[Bsmith]

so basicly OP is thinking of a render farm?

 

nothing new, keep thinking.

[8uhbbhu8]

All I can say is

 

 

[Sauron]

No. To all the questions.

[theninja35]

1 hour ago, Bajantechnician said:

They were 4 in cx, and 4 in sli

very bad idea

NO

totally illogical

Why would it be a bad idea to use multiple PSUs? Don't use cable management as a reason.

[Bananasplit_00]

52 minutes ago, qwertiuyop said:

Why would Itanium be better than a 12 core ES xeon v4 for 300 dollars? Also, what do so many folks here have against the ES CPUs? The reviews from people who have actually bought and used them were generally positive. 

 

because they are not complete, not made for retail and dont always supprt all features of proper CPUs. they can require verry specific boards to even work sometimes

[aberdie]

Would it be able to run crisis tho

[Mr.Meerkat]

2 hours ago, Electronics Wizardy said:

And you need 30A circuits

Well 240x13A=3120 so...a typical socket is 'enough' no?  (and I'm joking ofc as it's actually anything between 220-240volts)

[BuckGup]

You would need to go custom through IBM, Cray, and so on. That will probably be well over $300,000 at that point. What you want makes zero logical sense and you won't be using all that power.

[Bajantechnician]

17 minutes ago, SamStrecker said:

You would need to go custom through IBM, Cray, and so on. That will probably be well over $300,000 at that point. What you want makes zero logical sense and you won't be using all that power.

 

topic has died.

Thank god

[straight_stewie]

3 hours ago, qwertiuyop said:

For instance, a nVidia GTX680 is around 4 times less powerfull than a Pascal Titan X. So I could use 16 GTX 680s to accomplish my goal.

What exactly are you trying to do? There are only a few instances in which that many graphics cards would be very beneficial, and they are all in academia or the professional world (and usually with custom software).

[qwertiuyop]

I would like to know what exactly are the ''rules'' of scaling multiple GPUs. Why can some apps use 2 or 4 cards, but not 16? Why can the app simply not divide the entire load between all the cards, no matter how many there are. I mean, if one GTX680 is one quarter as powerful as the TitanXp, why would four 680s not be as powerful as one titan Xp? 

[mariushm]

You wouldn't be able to have 16 pci-e slots at least in a very simple and cheap way.

 

I don't know off the top of my head the maximum trace distance for the frequencies pci-e runs at, but my guess would be the maximum trace length would be something like 20-30 cm - 16 pci-e slots one below the other would exceed that length. 

I suppose you could make some kind of custom motherboard where you would get an Intel cpu with more than 32 pci-e v3.0 lanes, and you can arrange them in 4 x x8 pci-e v3.0 lanes and then you could use four of those pci-e switcher chips which take in a x8 or x16 pci-e bus and create 4 separate x4 or x8 slots... each of those chips would probably cost you around 60-100$ 

You'd also have to build a custom case with 2 or more of those pci-e connectors  in a single line or to have the cards arranged back to back, basically to reduce the vertical height of the stack of cards.

 

Linus has a server where they had 10 pci-e slots and that system used those kind of switcher chips which took a number of pci-e lanes and created several slots and pushed the data packets from all those slots into the smaller number of pci-e lanes coming into the switch IC.

 

You have cards like GTX1070 which use only around 150 watts. You could tweak the voltage and power limits to make sure they don't go over 140-150 watts. 16 such cards would use up to 2400 watts which is just about 10 amps at 230v. In Europe, there's 16A circuits on 230v, so it shouldn't be a problem to power those cards from one or two of those industrial Delta power supplies for example, which only output 12v... or any server power supplies that output only 12v.

The rest of the system (cpu, motherboard, pci-e switches etc) could use less than 4-500 watts and could run on a second power circuit easily (or you could have some electrical engineers build a more powerful 230v circuit for your room, with thicker cables and bigger fuses etc)  

 

It's doable but waste of money. Few applications would actually be able to split their workloads on 16 cards at a time and have them all do work concurrently and then collect the job results as their completed and merge everything and finish jobs..  you wouldn't use all those 16 cards efficiently. 

 

What would make sense for example would be a system with 16 gtx1050 or rx 460, each using about 50-70 watts and each would be satisfied with a x4 slot ...   and have 16 real time h264 / hevc encoders receive raw HD or 4K streams from capture cards and load them in video cards and then do hardware h264 / hevc encoding in each video card... at least the RX cards support HEVC hardware encoding of 4K content, not sure about GTX1050 cards.