Help Building an 8x Intel Xeon E7-8870 SuperServer

[Guest3123]

Here's a Server that ran Cinebench 11.5, and can score a 40+ Third highest score in the world records of Cinebench R11.5

http://hwbot.org/benchmark/cinebench_r11.5/rankings?start=0#cores=#start=0#interval=50#mediaType=#rankBy=teams#displayMode=complete#region=apac#locationScope=

 

Region : World Wide, Number of Cores : Any, Processor Cooling : Any, Records Per Page : 50, Display Mode : Complete, Media : Any.

 

Watch this :

 

Chassis -             Supermicro 748TQ
Motherboard -     Supermicro X9QRi-F+
Processors -       (4x) Intel Xeon E5-4650L, 20M Cache, 2.60-3.10 Ghz, 8.00GT/s Intel QPI
Memory -            Kingston Dual Channel 1600 MHz ECC DDR3 128GB RAM
Graphics Card -  NVidia Quadro 5000
Monitor -             Gateway XHD-3000 30 Inch LCD
HDD -                 1.2TB SSD HDD RAID 0
Storage -           (4x) 1TB HDD's
Controller -        Adaptec SAS/SATA RAID

xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

 

I want to improve my understanding how to build something like this.

I can build a desktop computer, & what he's running. But I can't figure out how to do 8 Server CPU's.

 

Here's what I got so far, that I can understand.

 

The Intel Xeon E7-88xx is based on Chipset 7500.

The Intel Xeon E7-88xx is socket LGA1567.

 

What I think I'll need, if I were to build an (8x) Intel Xeon E7-88xx Super Computer. Here's the Build.

Octa Xeon SuperServer.

 

I'm new here, I understand that I might not be able to post links, so I'll try to just list the URL is raw form.

 

http://www.supermicro.com/products/system/5U/5086/SYS-5086B-TRF.cfm

0a. Chasis & System - CSE-758TS-R2800BP (5U Rackmount) 5086B-TRF

 

I'd probably have to put the (8x) Intel Xeon E7-8870 CPU's in it, the hdd's, and the RAM. Unless SuperMicro can do it for me. I'd like to try, for the experience, and pleasure of putting together at least some of the parts for this ULTIMATE Super Computer.

 

"7500 (Boxboro-EX) SuperServer / LGA 1567 / MP Xeon
5U 8-Way Xeon® 7500 Series".

1. Up to 8 Intel® Xeon® processor 7500^
    series (8-Core) and next gen. Xeon
    processors E7 family (10-Core)
    via CPU boards (X8OBN-CPU)

 

2. Dual Intel® 7500 (Boxboro-EX)
    chipsets with QPI up to 6.4GT/s

 

3. 1 PLX PCI-E bridge

 

4. Intel® 82576 dual-port GbE Controller

 

5. 6 SATA2 (3 Gbps) ports

 

6. 4 (x16) PCI-E 2.0 + 2 (x8) PCI-E 2.0 or
    10x (x8) PCI-E 2.0 slots

 

7. Integrated IPMI 2.0 w/ Dedicated LAN

 

Comes with (1x X8OBN-F, 4x X8OBN-CPU, & 2x X8OBN-BR1)

 

1. Motherboard (XEON Board) - Supermicro X8OBN-F (http://www.supermicro.com/products/motherboard/xeon7000/7500/x8obn-f.cfm)

Ok.. So what the hell is a CPU Board? (X8OBN-CPU) ?

 

What is the X8OBN-F ?

 

and what is 2x X8OBN-BR1 ?

 

I love computers, and this is what I like doing in my free time. I like teaching myself about computers. So far, I can build or buy any computer under the sun and know exactly what I'm buying. But this is a new ballpark for me. I'd like to better understand what the hell this is that I've built. Most of the system is already built on Supermicro.com, it's the CSE-758TS-R2800BP (5U Rackmount) 5086B-TRF System.

 

Producats > Systems > 5U Rackmount > 5086B-TRF @ Supermicro.com

 

So that was alot easier than what I thought it was going to be. I was trying to be anal about it, and try to build it from scratch like the system I listed at the top.

 

That's a baby compared to this bad boy. he he he.

 

I just don't understand what the three parts are.. Can someone teach me a little bit about them?   That's the part that I don't understand.

 

There's three parts. Can you please teach me or explain a little bit about them? I'd really apreciate it.

 

 

 

Oh yeah, btw, supposidly on my journey or studying to build this bad boy, I stumbled upon a web page leaking Intel's Release of Intel Xeon E7 v2 Processors.

 

Supposidly Intel is gonna come out with 15 core / 30 thread Intel Xeon E7 v2 server processors.

 

Here's the URL.

 

http://www.anandtech.com/show/7753/intel-readying-15core-xeon-e7-v2

 

I don't know if anyone knows that already, but I figured I'd share it, since the date says it was posted on Febuary 11th 2014.

 

I think the 3 pieces go together some how, to make it possible to put the 8 CPU's in it. Probably the 2 boards will support 4x Intel E7-8870's each.

 

But I'm still pretty lost, and need some help explaining how this get's put togher.

 

 

 

Here's my build... Let me know if I got anything wrong.

 

Chassis & System -    SuperServer 5086B-TRF (Black)
Integrated Boards -    1x X8OBN-F, 4x X8OBN-CPU, 2x X8OBN-BR1
Processors -               (8x) Intel Xeon E7-8870, 30MB Cache, 2.60-2.80Ghz, 8GT/s, LGA1567
Memory -                    Kingston 1066Mhz Gold Plated, 240 pin, DDR3, 128GB, 16GB x8
Graphics Card -          (1x) NVIDIA QUADRO K5000 Supports PCI Express 2.0 x16, 256 bit
Monitor -                     Insignia 32" LED FHD TV.
HDD -                         (1x) Samsung 840 pro 256GB SSD
Storage -                   (4x) Samsung 840 Pro 512GB SSD
Controller -                 Intel® 82576 dual-port GbE Controller


The NVIDIA Quadro K5000 will allow me to hook up my monitor(s), or TVs. via (DVI-I (1), DVI-D (1) DP 1.2 (2))

[jscho]

Are you actually planning on buying this system? Or are you just 'piecing it together' as if you were planning the build?

[harrynowl]

Are you actually planning on buying this system? Or are you just 'piecing it together' as if you were planning the build?

I hope that latter is the case as this is crazy.

 

What's this "super server" doing exactly? 

[Priller]

That would also require a server specific OS as well.

[Guest3123]

Are you actually planning on buying this system? Or are you just 'piecing it together' as if you were planning the build?

Piecing it together, as if I were planning the build latter down the road in the distant future.

 

I'm basically trying to learn a little bit more about building computers, and what the next best thing is.

 

I've passed the Sager Np9570 configuration build's, the Eurocom Panther 4.0 Builds, and the Titanus Workstation Computers.

 

Did you see the video, and his computer I listed above, IT'S A BEAST. So this is my build.

[Guest3123]

I hope that latter is the case as this is crazy.

 

What's this "super server" doing exactly? 

It's going to Render After Effects workd in seconds not hours.

It's going to Play all the latest PC Games on ULTRA SETTINGS.

It's going to convert AVCHD (MTS) videos to whatever I want em to be.

It's going to Run Cinebench R11.5 & Cinebench R15 and get First place in World Records and elliminate AMD's Score.

It's going to crack 100++ digit password protected RAR FIles, ZIP Files, PDF Files, etc. in seconds or minutes.

 

Do you know how long it takes an i7 to do this, it takes it FOREVER !

It's going to be able to create DVD's in fractions of a second, minus the burn time. Using Convert X to DVD.

 

It's going to render hours of camtasia studio 8.0 Projects  in fractions of a second.

 

It's going to run simulations without any problems.

It's got 8x Intel Xeon E7-88xx Server CPU's so.. I beleive this should do well against whatever I want it to do.

If I want it to run my website, it'll do that too, if I want it to.

[Guest3123]

That would also require a server specific OS as well.

 I see that the only OS that will accept or see the 8x Intel Xeon E7-88xx Server CPU's will be Windows Server 2008. So I've included that, in my build just didn't list it in the above post. That and I guess Linux will do the same. I'm very surprised that Windows Server 2012 R2 Standard doesn't see the 8 CPU's, and only Windows Server 2008 will. That's really stupid considering that Windows Server 2012 R2 is more expensive and more recent. I also see alot of people going with Windows Server 2008. I can see why now.. It really is better than Windows Server 2012 R2.

I've found a site that can build this exact system for me.. but I don't see an option for them to put in a graphics card for me. I really don't care if they can, I'm sure I can figure out how to put the NVIDIA QUADRO K5000 GPU's in this, It goes into the PCI-E 2.0 x15 slot. How hard can that be..?

I've installed games, and ran Windows Server 2012 R2 on a virtual machine. I've did videos for it for YouTube.

 

I did a video in the not so distant past of me installing The Sims 2, I had to install some features like the .NET Framework by punching in some code into the Command Shell. It was pretty easy, because we live in a time now, that all I need to do is watch a YouTube video, or search Google for some answers. I had alot of fun doing that. I'm sure it wouldn't be any different for Windows 2008, which I actually have in a Virutual Enviorment as well. I even gave Windows Server 2012 R2 the start menu back like they did for Windows 8.1 x64. It's basically the same damn thing, except its not.

[Guest3123]

Does anyone actaully know what these three pieces I've listed in my post are? They're Integrated Boards right?

 

Well what's that anyways? How much different are they from just a regualr Motherboard?

[jonasa97]

I didn't know that servers sound like a jet taking off.

[Guest3123]

I didn't know that servers sound like a jet taking off.

The Max tempature that the Intel Xeon E7-88xx can operate at is 69°C, where your i7 Computer or whatever computer you have usually has a max T Case of 100° C.

 

But other than that.. what are you talking about? I actually like the sound that it makes. This specific one, not the one with the 4x Xeons, but the build I'm doing will have more Fans than what he's got. I think this Build comes with 8 fans. But yeah.. I can see how it would be very annoying and would eventually, even if I liked the sound, would become annoying. So I'd probably have to buy a long DVI Cable to go from a concealed room, to my screen(s) in another room.

[Guest3123]

The Max tempature that the Intel Xeon E7-88xx can operate at is 69°C, where your i7 Computer or whatever computer you have usually has a max T Case of 100° C.

 

But other than that.. what are you talking about? I actually like the sound that it makes. This specific one, not the one with the 4x Xeons, but the build I'm doing will have more Fans than what he's got. I think this Build comes with 8 fans. But yeah.. I can see how it would be very annoying and would eventually, even if I liked the sound, would become annoying. So I'd probably have to buy a long DVI Cable to go from a concealed room, to my screen(s) in another room.

So yeah.. your right. He was running near his Max Tempatures. It turns out with the fans he was using was as follows.

CPU 1 = 56 Deg Celsius

CPU 2 = 54 Deg Celsius

CPU 3 = 57 Deg Celsius

CPU 4 = 58 Deg Celsius

 

Which Intel does't specify the max tempatures for his Intel Xeon E5-4650L Server Processors. I'm gonna take a guess and say that it's close to the Intel Xeon E7 Processors of 69 Deg Celsius. which if that's the case, he's running pretty hot, while doing those Benchmarks on Cinebench R11.5

So in his updated video, he shows his new rig with the new Corsair H80i liquid water cooling systems.

CPU 1 = 28 Deg Celsius

CPU 2 = 29 Deg Celsius

CPU 3 = 30 Deg Celsius

CPU 4 = 30 Deg Celsius

which is a hell of lot cooler than what the fans were doing.

[jscho]

Aren't these CPUs generally geared towards virtualization? Actual 'server' use cases? Not so much number crunching and rendering?

[Guest3123]

Aren't these CPUs generally geared towards virtualization? Actual 'server' use cases? Not so much number crunching and rendering?

Idk, I'm learning about how to build systems like this. If you know the answer, please let me know. It would help me learn more about these types of systems.

[Skylark]

The X8OBN is the chassis.  -F is the baseboard that everything attaches to. -CPU is the CPU board where the Xeons and ram sit, which are connected to said baseboard at the bottom and to other CPU boards by BR1.

 

Think of it as a modular Motherboard.  That chassis you listed retails for over $100k lol

[d33g33]

Aren't these CPUs generally geared towards virtualization? Actual 'server' use cases? Not so much number crunching and rendering?

Spot on!

 

Its enterprise hardware with VM in mind to reduce a companies physical and power footprint. 

To be honest I cant think of a company that would have this apart from a VERY large media company doing lots of very large CPU bound renders. What throws me is the quaddro. This is not a workstation, its a server full stop. Most likely (if they're smart) paired with another identical unit for redundancy load balancing. Storage would be through a SAN.

 

Its powerful yes but only for CPU tasks. The quaddro is ok but you can get a K6000 now which is mental. Neither this 8 CPU'S or the K5000 quaddro will be good in games though, my 3770k with a 780ti would destroy it in a game benchmark...

[Guest3123]

Spot on!

 

Its enterprise hardware with VM in mind to reduce a companies physical and power footprint. 

To be honest I cant think of a company that would have this apart from a VERY large media company doing lots of very large CPU bound renders. What throws me is the quaddro. This is not a workstation, its a server full stop. Most likely (if they're smart) paired with another identical unit for redundancy load balancing. Storage would be through a SAN.

 

Its powerful yes but only for CPU tasks. The quaddro is ok but you can get a K6000 now which is mental. Neither this 8 CPU'S or the K5000 quaddro will be good in games though, my 3770k with a 780ti would destroy it in a game benchmark...

Yeah.. I really like it. If I bought something like this, I'd more than likley would use it mainly for the CPU. I don't play video games on PC, I used to when I first got this laptop to test it, and it plays everything pretty well.  I have an XBOX360 for playing games, I'm strictly for CPU only, that's my aim, and why I started looking into computers like the $100k Super Server I posted about.

[Guest3123]

The X8OBN is the chassis.  -F is the baseboard that everything attaches to. -CPU is the CPU board where the Xeons and ram sit, which are connected to said baseboard at the bottom and to other CPU boards by BR1.

 

Think of it as a modular Motherboard.  That chassis you listed retails for over $100k lol

Awesome, you sound like you really know your stuff about computers like this. I don't care if it costs $100k, I'd drive team with my friend, and I'd save my money for something like this. I'm strictly a CPU type person, and if I want to play video games, I'd play them on my XBOX360 or Playstation 3.

I kinda figured that the CPU board was where you put the CPU's, seeing that the (4x) X8OBN-CPU.

[d33g33]

No offense but if you didnt know it cost 100k I doubt highly you will ever have a need or actually get this machine. Its just time passing.

[Guest3123]

No offense but if you didnt know it cost 100k I doubt highly you will ever have a need or actually get this machine. Its just time passing.

No offense, but this is my post. I'm well aware of how much it costs, and what this machine can do. I'm almost all for CPU, that's why I looked into machines with more CPU performance, than your premium i7 Extreme, or Xeon E5 w/4x processors.

 

I can go to ThinkMate.com and build whatever my heart desires, and get an exact price or exactly what I want.

 

And in years to come, let it be if, or one of my 8 family members that live in this 3 story house ever hits the lottery, you bet your ass I'm gonna get whatever I want.  If I drive team "tractor trailer" in 10 years, when I'm 41, when I've bought real estate "multiple properties", or when I get $30,000 I'll open an account at TD Ameritrade, or Scott Trade, and start Day Trading, or if I ever get my lazy ass willing enough to go to Parx Casino to play NL Hold Em.. which I'm very good at, I'm sure within these things, I'm pretty sure I'll be getting my super server.

 

I really like computers, and I can go to Alienware, HP, Dell, Lenovo and pick, configure, and buy a computer and know exactly what I'm getting unlike these kids or people on YouTube that know absolutely nothing about the $3000 Alienware or $4000 Apple computer Computer that there mommy & or daddy got them. I'm clearly not one of these types of people that know nothing about the technology that they own. I'm the complete opposite. I love technology, and I love using it every single day.

 

Or how about the fact that people go out and spend $3000 on a underperforming Apple computer that you could go out and buy a PC for a fraction of the price, and get a way better system. I'm simply not one of those noobs that are oblivious to such facts. But people still do it.

[Guest3123]

I WANT THIS MACHINE ! I WILL HAVE THIS MACHINE ONE DAY.

 

Gonna Try At Least

 

You only live one time, and in this lifetime, I'd like to own something like this, to fully appreciate the technology & how far we've come in computers & technology today.

 

I'd like to see how fast it really is. Which I'm sure it compleats most tasks, VERY QUICKLY, if not instantaneously. Which I'd like to see first hand.

[d33g33]

It's going to Render After Effects workd in seconds not hours.

It's going to Play all the latest PC Games on ULTRA SETTINGS.

It's going to convert AVCHD (MTS) videos to whatever I want em to be.

It's going to Run Cinebench R11.5 & Cinebench R15 and get First place in World Records and elliminate AMD's Score.

It's going to crack 100++ digit password protected RAR FIles, ZIP Files, PDF Files, etc. in seconds or minutes.

 

Do you know how long it takes an i7 to do this, it takes it FOREVER !

It's going to be able to create DVD's in fractions of a second, minus the burn time. Using Convert X to DVD.

 

It's going to render hours of camtasia studio 8.0 Projects  in fractions of a second.

 

It's going to run simulations without any problems.

It's got 8x Intel Xeon E7-88xx Server CPU's so.. I beleive this should do well against whatever I want it to do.

If I want it to run my website, it'll do that too, if I want it to.

 

Cool story bro,

 

The issue is right here you said you want it to play the latest games on Ultra. I doubt it would do that today with a quaddro.

 

If you come into vast amounts of money and this is what you want to do no one has the right to tell you not to, but I feel your idea of this PC being so CPU strong it can do all these tasks almost instantaneously is unrealistic.

 

I work in a company of around 7000 staff. We have some decent HP blade stuff all running through 3PAR storage for SAP that set us back about $3-$4mil. The only interest I would have in testing this stuff is to utilize its idle time for some CPU coin mining or something (though I know nothing about mining) but running it as a single system doesn't even enter the picture. It will be fast yes but I doubt it would blow anyone's mind except for maybe a CINEBENCH score.

 

Real life experiences would be vastly different.

[Guest3123]

Cool story bro,

 

The issue is right here you said you want it to play the latest games on Ultra. I doubt it would do that today with a quaddro.

 

If you come into vast amounts of money and this is what you want to do no one has the right to tell you not to, but I feel your idea of this PC being so CPU strong it can do all these tasks almost instantaneously is unrealistic.

 

I work in a company of around 7000 staff. We have some decent HP blade stuff all running through 3PAR storage for SAP that set us back about $3-$4mil. The only interest I would have in testing this stuff is to utilize its idle time for some CPU coin mining or something (though I know nothing about mining) but running it as a single system doesn't even enter the picture. It will be fast yes but I doubt it would blow anyone's mind except for maybe a CINEBENCH score.

 

Real life experiences would be vastly different.

Ok, so what are my Latptop options then? Intel Core i7-4940MX w/ maybe dual NVidia GeForce GTX 780 Ti ? That's lame. Isn't it? I'm just not satisfied with Intel Core i7 Processors.

 

I want more power.. The slowest I'll go if I had the money is maybe a 4-way Intel Xeon E7-48xx type computer. maybe plug 2 Intel Xeon Phi Coprocessors in there too. But if not, I'll just settle with the 4-way Intel Xeon E7-48xx, or 4-way Intel Xeon E5-xxxx.

 

Something tells me that applications like Convert X To DVD isn't going to be able to take advantage of all 4 CPU's. Am I right, or will it ?

 

As far as games, I don't think I could care any less about playing games on a computer. That's why I have an XBOX360 & Playstation 3. I believe a computer is ment to do work, not play video games. It's to process stuff.

[Guest3123]

Ok, so what are my Latptop options then? Intel Core i7-4940MX w/ maybe dual NVidia GeForce GTX 780 Ti ? That's lame. Isn't it? I'm just not satisfied with Intel Core i7 Processors.

 

I want more power.. The slowest I'll go if I had the money is maybe a 4-way Intel Xeon E7-48xx type computer. maybe plug 2 Intel Xeon Phi Coprocessors in there too. But if not, I'll just settle with the 4-way Intel Xeon E7-48xx, or 4-way Intel Xeon E5-xxxx.

 

Something tells me that applications like Convert X To DVD isn't going to be able to take advantage of all 4 CPU's. Am I right, or will it ?

I could even buy a Sager NP9570 Laptop with a Desktop processor in it.. that's nice, but..