LTT Storage Rankings

[raid0yolo]

1 hour ago, Chaosratt said:

Wait, I've got that same case. I ended up removing the fan wall and laying some 140MMs across the spot where it was, do you mean that I can just buy the Norco 120mm fanwall and it'll mount up where the supermicro fanwall went, or will I have to drill?

Same for the rear panel, that can be replaced as well?

To use the Norco parts you definitely need to drill some holes. I drilled four holes to secure the rear panel. You can see three of the four screws if you look carefully at the pictures above. I only drilled one hole to secure the fanwall + a zip tie because it's so light weight. If you decide to installed the Norco back window I would recommend having a motherboard and a graphics card installed to help in aligning the case with the back window before drilling any holes.

IMG_0477.jpg - Shows the ~1/4 inch gap on the left side of the backwindow. I used a few bolts and spacers to fill the gap.
IMG_0479.jpg - Shows the one screw I used for the fan wall. Zip ties were also used, but not shown.
IMG_0482.jpg - Shows how the power supply does not line up with the with back window mounting holes. I ended drilling the PSU holes larger so they would meet up with the power supply screw holes.

[MariusJS]

So I've completely swapped out my system

 

Got a R510 for free 

Also bought some new disks

 

Hardware: 

Case: Dell R510

Xeon E5620 8 Thread  CPU

32GB of ECC RAM

OS Disk: 250GB Samsung 840 Evo

 

STORAGE:

Raid card: Dell Perc h700

4x HGST 4TB Raid 5

2x WD Red 4TB Raid 5 (With the HGST's)

3x WD Surveillance 3TB Raid 5 (With the WD red's)

1x Seagate 8TB

 

Storage not in use ATM

6x Seagate 2TB

9x Dell/Seagate Constallation 1TB

2x Samsung 845 800GB SSD's

 

Info:

Running in Raid 5's and using Windows Server 2012 R2 (sadly) to manage and share the disks + for other purposes

About 31TB of usable space, and 41TB Raw space

Don't know what more there is to write really, ask me if there is something left out

 

Pics: 

Theese are the new ones

Got them installed!

Old/not in use drives:

[Str_Mape]

Oh man, Just completed a computation / storage server that no longer can fit in this thread, would've been fine when it was just 10TB+

I have 3x 8TB Drives, at some point I will fit in this thread  

[brwainer]

13 hours ago, Str_Mape said:

Oh man, Just completed a computation / storage server that no longer can fit in this thread, would've been fine when it was just 10TB+

I have 3x 8TB Drives, at some point I will fit in this thread  

Submit it anyway, you'll get put in the section for interesting builds, and then later one when you update it, most of the work will be done already.

[Stakacs]

On 3/23/2015 at 10:20 PM, Stakacs said:

 

@alpenwasser Update #2

 

Hardware
CASE: Fractal Design Define R5

PSU: EVGA SuperNova 750 G2 750W
MB: ASrock Z87 Extream6/ac
CPU: Intel i7 4790
HS: Corsair H90
RAM: Corsair Vengeance Pro 32GB DDR3 1600
SSD: Transcend 512 GB SATA III
HDD 1: 3x 3TB Seagate NAS HDD ST3000VN000
HDD 2: 3x 3TB Seagate Barracuda ST3000DM001

HDD 3: 2x 3TB  HGST HDN724030ALE640

 

Software and Configuration:
 Server is running Unraid 
Array consists of 7x3TB for Raw Storage + Parity Drive & SSD for Cache

 

Usage:

Plex & Storage

Additional info:
300/30 internet Mbps connection

Modem, Router and Server  - Collectively Idle @ 50 ish watts

Back up power - APC BE750G

Drive Bay was converted to Evercool Dual 5.25 to Three 3.5 HDD with a 80MM fan

Photo's:

 

 

[Mikensan]

Are you sure about that power consumption @Stakacs? The computer alone should idle close to 40watts without a dedicated graphics card and 1 drive. 

[Stakacs]

On 5/19/2016 at 0:16 PM, Mikensan said:

Are you sure about that power consumption @Stakacs? The computer alone should idle close to 40watts without a dedicated graphics card and 1 drive. 

This system is headless, and all drives while idle are spun down within Unraid. CPU is at 1% usage. 

 

Saying that I am sure that it is exactly 30 Watts, No. I have not taken my Unit to work to Calibrate it. Maybe I will do that soon and get back to you with a tolerance. 

 

Also for Clarification this watt reading is measured by the APC.

 

Take care,

 

ST

 

 

 

[alpenwasser]

Terribly sorry for the long delay; this semester's been kinda crazy, and I had the great idea to fall ill twice, which didn't help with having spare time to hang around on the forums at all. Anyway:

On 3/19/2016 at 7:09 PM, Eric The Tech Guru said:

So I've posted before but I've kinda made a bunch of revisions to my server.

 

On 3/21/2016 at 3:30 PM, Jonny said:

WinterFell (Centos 7)

 

On 3/27/2016 at 5:43 PM, scottyseng said:

@alpenwasser:

I've added two more 4TB Re SAS drives to my NAS. Now have four 4TB Re SAS drives in RAID10 instead of the existing two 4TB RAID0.

 

On 3/29/2016 at 1:01 AM, Kiades said:

 

 

On 3/29/2016 at 9:31 AM, mGrytbak said:

Update! *yay*

 

 

 

Added/updated.

 

On 4/10/2016 at 3:22 AM, Pancake said:

How do I update my ranking? I am currently sitting at 29TB. My setup has changed a lot lately

 

Specs of my main ESXi Server:

E3-1265L V2, 32GB ECC, Supermicro Server board with IMPI and Dual lan etc, Samsung 850 Pro 512GB, iStarUSA 213 2u Case, ICY DOCK 6 x 2.5" Hotswap bay, 430w Antec Earthwatts PSU

Specs of my second ESXi Server:

i3-3220, 32GB ECC, Supermicro Server board with IMPI and Dual lan etc, Crucial MX100 256GB, iStarUSA 213 2u Case, ICY DOCK 6 x 2.5" Hotswap bay, 430w Antec Earthwatts PSU, And a Dual Port Intel Pro1000 NIC for pfSense (Used as my main router)

 

 

 

You pretty much got it. Just make a new post with the updated info. I'm not yet 100% sure what your drive config is though. You now have two machines, each with six 2.6" drives? You wouldn't happen to have the vendor for those drives by any chance? I'll update you ASAP once I'm clear on what's what. Thanks!

 

On 4/10/2016 at 3:52 AM, thekeemo said:

I know this is off topic I am sorry

but how do you make tables and graphs in this? also headers.

I think we can tolerate some off-topic chit-chat. Besides, it's sorta on topic.

 

Anyway, the way you do that is by getting HTML editing privileges. Sadly, can't really enable that for regular users for security reasons.

 

On 4/27/2016 at 10:57 PM, dalekphalm said:

 

 

On 4/29/2016 at 7:17 AM, AidanJMessenger said:

 

 

 

 

On 5/4/2016 at 7:41 PM, raid0yolo said:

Here is my new all-in-one whitebox server. It acts as my router, server, NAS and gaming computer.

 

 

 

On 5/6/2016 at 7:56 PM, raid0yolo said:

 

 

On 5/13/2016 at 9:43 PM, MariusJS said:

So I've completely swapped out my system

 

 

On 5/17/2016 at 10:08 PM, Str_Mape said:

Oh man, Just completed a computation / storage server that no longer can fit in this thread, would've been fine when it was just 10TB+

I have 3x 8TB Drives, at some point I will fit in this thread  

 

On 5/18/2016 at 11:30 AM, brwainer said:

Submit it anyway, you'll get put in the section for interesting builds, and then later one when you update it, most of the work will be done already.

^This.

 

On 5/19/2016 at 4:44 AM, Stakacs said:

 

Updated/added.

 

Thanks for participating, everyone!

[MyNameIsNicola]

On 10/01/2016 at 10:27 PM, MyNameIsNicola said:

Hardware
CASE: Supermicro SuperChassis 847A-R1400LPB
PSU: 2x 1400W high-efficiency (1+1) redundant power supply with PMBus

MB: Supermicro X9DRH-IF

CPU: 2x Intel® Xeon® CPU E5-2603 v2 @ 1.80GHz

HS: 2x Active Supermicro SNK-P0048AP
RAM: 80GB ECC DDR3 1333
RAID CARD 1: LSI 9211-8i 6GB/s SAS HBA w/"IT" firmware
RAID CARD 2: LSI 9211-8i 6GB/s SAS HBA w/"IT" firmware
RAID CARD 3: LSI 9211-8i 6GB/s SAS HBA w/"IT" firmware
RAID CARD 4: LSI 9211-8i 6GB/s SAS HBA w/"IT" firmware
RAID CARD 5: LSI 9211-8i 6GB/s SAS HBA w/"IT" firmware
SSD 1: 2x 120GB Kingston SV300S37A120G SSD (FreeNAS boot volume)

SSD 2: 2x 500GB Samsung 850 EVO SSD (jails and virtual machines)

...

...

...

 

Mini Update

 

I needed to expand my archive pool to be able to properly backup my primary data pool1, so I swapped out the single 4TB pool2 disk for an additional 8TB disk to extend archive (which nicely tips me over 150TB of raw storage - woot). ;-) -- 

 

I've also now got a better solution for UPS, with a 2U rack mount APC Smart-UPS 1000 watt / 1500 VA, which is currently sitting at 55% load. Feels much better now. Phew.

 

(120 GB) + (120 GB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (4.00 TB) + (4.00 TB) + (4.00 TB) + (4.00 TB) + (500 GB) + (500 GB) + (8.00 TB) + (8.00 TB) + (8.00 TB) + (8.00 TB) + (8.00 TB) + (8.00 TB) + (8.00 TB) + (8.00 TB) =

TOTAL RAW STORAGE: 153.24 terabytes
 

(57 TB) + (111 GB) + (460 GB) + (76 TB) =

TOTAL USABLE STORAGE: 133.57100 terabytes

[scottyseng]

@alpenwasser

I added five more 4TB WD Re Drives. Now in total:

Six 4TB WD Reds

Nine 4TB WD Re SAS drives

 

Now to wait for the RAID6 array of the nine 4TB drives to build...

 

Also sad to hear you got sick through the semester...I remember getting sick myself a year back and I didn't do well in my classes as a result..

[maxtch]

After my partshift I am having two entries.

 

naster.maxcrib.info:

Hardware

CASE: Unknown brand (old case reused)

PSU: AcBel API6PC05 (250W nom.)

MB: Asus P5BV-C

CPU: Intel Core 2 Quad Q9300

HS: Lenovo OEM heatsink

RAM: 4x 2GB DDR2-800 ECC SDRAM = 8GB

RAID CARD: Adaptec 6805

HDD 1: 4x 3TB WD Red WD30EFRX-68EUZN0 = 12TB

HDD 2: 1x 3TB Hitachi Ultrastar HUA5C3030ALA640

Software and Configuration:

Stock Ubuntu Server 16.04 LTS amd64.

RAID card configured as a 5-drive RAID-6. (currently rebuilding the original 3-drive RAID-5 with a hot spare before expansion can be made.) Effective capacity 9TB.

Usage:

This machine hosts my backups, multimedia and a lot more. It is a router/NAS multipurpose device.

Backup:

This device have a cron job copying the bulk of its data over to an Apple Time Capsule at the other end of my apartment hacked with 6TB HDD each week.

Additional info:

Mostly used parts and upgrade rejects.

Photo's:

maxView of the current setup:

Old pictures of the internals that still stand. Disks added to the first and fourth slot. 

 

battleship.maxcrib.info

Hardware

CASE: Unbranded case.

PSU: HuntKey Panshi 800 (600W nom.)

MB: Asus Z9PE-D16C/2L

CPU: 2x Intel Xeon E5-2680

HS: PCCOOLER Butterfly PWM (CPU 0), PCCOOLER Yellow Sea Deluxe (CPU 1)

RAM: 8x 16GB DDR3-1600 Registered ECC SDRAM = 128GB

GPU: Zotac nVidia GTX 650 Ti 2GB

RAID CARD: LSI 3ware 9750-8i + hacked BBU

HDD: 6x 2TB WD Green (mixed generations, hacked to perform like Reds) = 12TB

Software and Configuration:

This array is configured as a RAID-6 volume providing 8TB effective storage. Runs Ubuntu 16.04 and have a few virtual machines on it.

Usage:

This is my main non-macOS workstation so it have lots of CPU, RAM, GPU and storage.

Backup:

Nowhere to backup now though. It is too large to fit anywhere.

Additional info:

The power hungry CPU and GPU puts a lot of strain on the PSU. Maybe I need to swap it out down the road, and rebuild the above machine with a dual Xeon X5400 rig.

Photo's:

Old photos from my previous entry still stand, as no storage modification is made, only usage.

 

Update:

The 3TB Ultrastar is added to the array in naster.maxcrib.info, bringing its capacity up to 15TB total. I was a fool and the array have to be rebuilt before expanding into a 5-drive RAID 6. 

[Gronnie]

Wow, I just looked on employee store and I can grab 8TB WD Red NAS drives for $140 a piece! So tempting to order like 8 of them....

[maxtch]

5 hours ago, Gronnie said:

Wow, I just looked on employee store and I can grab 8TB WD Red NAS drives for $140 a piece! So tempting to order like 8 of them....

Grab them, throw them into a RAID-50 array and enjoy.

[b3nno]

Hardware

CASE: Norco RPC4308

PSU: Corsair VX550

MB: SuperMicro X8DTH-iF

CPU: 2x Intel Xeon X5560

HS: 

RAM: 192GB DDR3 ECC REG 1066MHz (12x 16GB sticks)

RAID CARD 1: IBM M1015, Flashed with "IT" firmware

RAID CARD 2: IBM ServeRaid MR10i

HDD 1: 2x 500GB Samsung 850 EVO 

HDD 2: 8x 4TB WD Red WD40EFRX

 

Raw storage = 32TB, 8 disks.

 

Software and Configuration:

My server is running ESXi 5.5.0. A FreeNAS VM is controlling storage disks. The FreeNAS VM has the M1015 controller, two port GigE Intel network card, and a 10GigE Intel network card passed through.

 

The storage array is 8x4TB disks in a pool consisting of one RaidZ2 vdev. This amounts to ~20 TB actual usable storage space. The pool is encrypted with AES128, and keys are backed up somewhere safe.

 

The two Samsung SSDs are configured with Raid1 within the MR10i controller, used for VM storage on the hypervisor. 

 

Usage:

The server is also used for other production servers like Windows domain controller, linux database servers (for Kodi and such), splunk, mgmt-server with Veeam, monitoring services. FreeNAS acts as a backup repository for TimeMachine and personal files.

 

There are also two other windows domains used for labbing, with domain controllers, exchange, SCCM, VDI, HyperV (nested), WAP, DirectAccess and different client VMs.

 

Backup:

VMs backed up to my computer, important personal stuff backed up to remote FreeNAS server by rsync.

 

Additional info:

Currently running X5560 processors, which does not support AES-NI. I have ordered E5640's processors which does support this feature, and they come with lower TDP.

Recently upgraded from 5 to 8 storage disks.

 

Photo's:

[Jonny]

Updated my post with new information and future upgrade ideas.

 

[Ziggidy]

Not sure if this is correct, used natural log of 6 (according to Google)...  1.79175946923

 

Score: 25.44

Capacity: 14.2 TB

Drives: 6

 

 

Hardware

CASE: Supermicro SC826TQ-R800LPB

PSU: Dual Supermicro PWS-801-1R 800W Hot swap PSU's

MB: Supermicro X8DTN+

CPU: Dual Xeon E5620

HS: Dual Supermicro  SNK-P0036 or SNK-P0037P, Not sure which they are, came with chassis already installed

RAM: 4x Nanya NT4GC72B4NA1NL-CG (24GB Reg ECC DDR3), 12x MICRON MT36JSZF51272PZ-1G4G1FG (48GB Reg ECC DDR3), (72GB total memory)

RAID CARD 1: IBM M1015, Flashed with "IT" firmware

SSD: 2x OCZ Agility (60GB) (OS & Backup), 2x Q Series HDTS225XZSTA (256GB) ZIL & L2ARC mirrored - (120 gig Samsung SSD's ready to be installed and swapped out for the OS and backup drive

HDD 1: 6x WD40EFRX (4TB) in RaidZ2 (14.3 TB usable)

 

Software and Configuration:

OS: Ubuntu Server 14.04.1 LTS

Drives in Raid Z2 Array with mirrored ZIL & L2ARC SSD's

 

Usage:

Only thing main OS does is act as host OS, and has the NAS portion of things.

   Virtual host running Plex Media Server

   Virtual host running 2 Minecraft servers 24x7 (I haven't played in a REALLY long time though)

   Virtual host as a test platform

   Suggestions welcome for other things I can throw at it!!!

 

Backup:

   Personal files like photos and home videos are backed up on desktop drive and an external drive. The MAJORITY of rest of the data on there is MKV files from DVD & Blu Ray rips, (I only rip discs we own). These are backed up on two external Seagate 5TB drives

 

Photo's:

Building custom SSD drive cage for inside the chassis so they don't waste hot swap space on the front....

Each drive screws into a piece of Styrene, with round styrene rods and nylon spacers around the rods to give each drive space for airflow.

Here is a shot of the guts all ready to go. You can see the custom drive cage at the top.

Here it is in a photo I took earlier today, It is near the top of the rack, looking at the back end here, UPS is at the bottom.

Drive pool and storage space:

[username6465]

This is my update server a very much work in progress. the fan need to run 24/7 if it stop the server shutdown from heat.

Hardware:
CASE: what this lol

PSU: Corsair HX850i 850W 80PLUS Platinum

MB: gigabyte x79-up4

CPU: Intel® Core™ i7-3820 CPU @ 3.60GHz

HS: Some heatsink I had lying around

RAM: 32GB Kingston ValueR. DDR3

RAID CARD: IBM M1115 converted to LSI9211-IT mode

HBA:  Intel RES2SV240

SSD 1: 1 x 128GB ocz vertex 4

SSD 2: 1 x 60GB ocz apex

HDD 1: 11 x 2TB drive

aLL the drives blow are are just place holders.try to get same more 8tb drives.

HDD 2: 2 x 1TB drive

HDD 3: 1 x 160 GB

HDD 5: 1 x 750 GB WDC WD20EZRX-00D

HDD 6: 1 x 250 GB GB WDC WD20EZRX-00D

HDD 7: 1 x 320 GB WDC WD20EZRX-00D

HDD 8: 1 x 82.3 GB GB WDC WD20EZRX-00D

 

Software and Configuration:
OS: unraid 6.2.0.21

RAID config:  RAID6

RAID hot spare: 2 x 2TB

File system: XFS for the RAID
File system capacity: Advertised:25.5TB, RAID6 Advertised 21.5TB.

 

Usage:
Storing stuff, you know, it is a storage server.

Backup:
Working on get the main server ruining

[Stakacs]

@Mikensan

On 5/19/2016 at 0:16 PM, Mikensan said:

Are you sure about that power consumption @Stakacs? The computer alone should idle close to 40watts without a dedicated graphics card and 1 drive. 

 

You are Right, 

 

I purchased a standalone Watt-meter and even Verified its accuracy @ work (I am a Metrologist) 

 

Servers in the low to mid 50's idle with the Networking gear also. 

 

Thanks!

[leadeater]

@alpenwasser @looney

Any rules on distributed file systems like Ceph, Lustre and Gluster?

 

Quote

• It has to be a single system (everything running off of a single motherboard).

 

Kinda puts a downer on my plans, not that I actually care . I guess each individual storage node would count but not the system as a whole?

[brwainer]

6 hours ago, leadeater said:

@alpenwasser @looney

Any rules on distributed file systems like Ceph, Lustre and Gluster?

 

 

Kinda puts a downer on my plans, not that I actually care . I guess each individual storage node would count but not the system as a whole?

No matter what the rules say, I sure as hell want to hear about this! Maybe the individual nodes can make it on the list, and the system as a whole can be an honorable mention? I personally think that the whole system should be counted together though. But where does the line get drawn? Does SOFS or Storage Spaces Direct count as a cluster/distributed file system?

[leadeater]

On 9/5/2016 at 3:24 AM, brwainer said:

No matter what the rules say, I sure as hell want to hear about this! Maybe the individual nodes can make it on the list, and the system as a whole can be an honorable mention? I personally think that the whole system should be counted together though. But where does the line get drawn? Does SOFS or Storage Spaces Direct count as a cluster/distributed file system?

The original plan was to use Storage Spaces Direct, was going to edit post and add it but the forum went crazy .

 

I may end up doing both or one on top of the other, I really want to try both. Main problem with Storage Spaces Direct is I use ESXi and NFS services on Windows isn't that good, iSCSI does work well but there are reasons why that annoys me for my current setup (too few physical servers, loopback within itself iSCSI target server blah).

 

I would say though that SOFS shouldn't count, not really a proper distributed file system that acts as one system.

[FattyDave]

Been meaning to post this for far too long!

 

Hardware

CASE: MS-Tech CA-0210 rev. b

PSU: Corsair VS450

MB: Foxconn H55M-S

CPU: Core i7 870

HS: Stock intel heatsink

RAM: 16GB DDR3 1333

SSD: Sandisk Ultra 120GB

HDD 1: 6x 4TB WD Red

HDD 2: 2x 1TB Toshiba (something something)

As the MB only has 6 SATA ports I have a Syba 4 Port PCIe SATA Card. There are also some Gb NICs in there as at some point I will running a PFsence VM.

Following a CPU upgrade I also now have to run a graphics card as the 870 doesn't have video. This is annoying as there is no monitor connected to it but it won't post without. Any tips on getting round that would be great!

Software and Configuration:

Server runs WD2012 R2. the 4TB reds are in a parity configuration controlled by storage spaces. This is used for the main storage. The 2 1TB drives are in a RAID 1 setup and is used as a scratch disk  as well as the home for the Hyper-V vdisks.

I run 3 VMs. 2 for plex servers 1 for various news-groups utilities and 1 PFsense router.

Usage:

Server is used for plex TV shows/Films as well as family music and picture libraries and as a NAS.

Backup:

I've gone through various options with this. At the moment I use a cloud service data deposit box

Photo's:

[LIGISTX]

I have deployed a new server! I guess the old one should be taken off the list (the wood case, still in my sig), but I assume the post won't be removed correct? I still have links to it cuz that thing was pretty sweeeeeet!

 

Anyways, new build is finally deployed!

 

Hardware

CASE:  SUPERMICRO 4U 846E16

PSU:  R1200B

MB:  SUPERMICRO X8DTE-F

CPU:  Dual Intel XEON L5520

HS: Stock Supremicro

RAM: 32GB DDR3 1333 ECC

RAID CARD 1:  6GBPS SAS HBA (WITH LSI 9211-8I FIRMWARE)

SSD1 Boot: Crucial SSDNOW 200V+

SSD2: Crucial SSDNOW 200V+

HDD 1: 8x 4TB Western Digital Red RAID Z2

HDD 2: 8x 3TB Seagate ST3000DM001 (I know, these are total garbage) RAID Z2

 

Software and Configuration:

This server is running Freenas, and obviously then ZFS. My old NAS was on Open Media Vault and it served me well, but without ECC RAM I couldn't make the jump to Freenas. Suffice it to say, this was a good move

 

Additional info:

Currently still learning Freenas, but should drive-download-20160925T060805Z.zip

Sorry I didn't get any great pix of it, probably shoulda busted out the D810, but I was lazy......... Really should get some sick shots of my Rig at least huh?

 

Also, don't worry, its not actually running windows. That was just the obligatory NEED TO SEE LOTS OF CPU's IN TASK MANAGER pic haha. And I wanted to test thermals, so I figure some AIDA64 and Prime95 would be a good way that I am accustomed to using. 

 

[LIGISTX]

Hey, I see lots of supermicro mods goin on. I am trying to get this server ^ to be quieter! Any advice? I guess I should start trolling this thread a bit.

[scottyseng]

22 hours ago, {EAC} Shoot em UP said:

Hey, I see lots of supermicro mods goin on. I am trying to get this server ^ to be quieter! Any advice? I guess I should start trolling this thread a bit.

I actually had to take out the stock fans and stick a bunch of BeQuiet PureWings into mine. I have to be careful though because the fans are just lying around (No way to screw or hold them down). Also, the other issue is that in some SuperMicro Boards, the min fan speed is 50% or higher (I don't know why they did that). So the fans are running faster than they really need to be.