Jump to content

Why are ssds slower righting lots of smaller files compared to 1 large file

Smackaroy
Go to solution Solved by Electronics Wizardy,
1 minute ago, Smackaroy said:

I'm the image I have an 850 evolution plugged in via USB thats why the speeds are slow but the rule still applies. The consistent green line is when it was writing lager files about 80mbs again its slow because of the usb but you can see when it writes files which are about 500kb it drops to 1-2mbs

20200709_005427.jpg

that seems expected. Small files will do that. What does usage in task manager look like?

 

Id try robocopy with multithreading.

I have a couple 850 evos 840 pro and a mx500 all of them have relatively consistent speeds when writing one large file but if it is writing tons of smaller files in the 5 or less mb range performance goes down to like 30mbs what gives. 

All of them do it so it can't be a faulty drive

 

 

Link to comment
Share on other sites

Link to post
Share on other sites

2 minutes ago, Smackaroy said:

I have a couple 850 evos 840 pro and a mx500 all of them have relatively consistent speeds when writing one large file but if it is writing tons of smaller files in the 5 or less mb range performance goes down to like 30mbs what gives. 

All of them do it so it can't be a faulty drive

 

 

Think of it like this, if you had to put 100 lbs of things away in your kitchen. Would it be easier (assuming your strong enough) to put 1 thing in 1 place, or 100 little 1 lbs things away? Its basically that. 

Rig: i7 13700k - - Asus Z790-P Wifi - - RTX 4080 - - 4x16GB 6000MHz - - Samsung 990 Pro 2TB NVMe Boot + Main Programs - - Assorted SATA SSD's for Photo Work - - Corsair RM850x - - Sound BlasterX EA-5 - - Corsair XC8 JTC Edition - - Corsair GPU Full Cover GPU Block - - XT45 X-Flow 420 + UT60 280 rads - - EK XRES RGB PWM - - Fractal Define S2 - - Acer Predator X34 -- Logitech G502 - - Logitech G710+ - - Logitech Z5500 - - LTT Deskpad

 

Headphones/amp/dac: Schiit Lyr 3 - - Fostex TR-X00 - - Sennheiser HD 6xx

 

Homelab/ Media Server: Proxmox VE host - - 512 NVMe Samsung 980 RAID Z1 for VM's/Proxmox boot - - Xeon e5 2660 V4- - Supermicro X10SRF-i - - 128 GB ECC 2133 - - 10x4 TB WD Red RAID Z2 - - Corsair 750D - - Corsair RM650i - - Dell H310 6Gbps SAS HBA - - Intel RES2SC240 SAS Expander - - TreuNAS + many other VM’s

 

iPhone 14 Pro - 2018 MacBook Air

Link to comment
Share on other sites

Link to post
Share on other sites

5 minutes ago, Electronics Wizardy said:

What program are you using to write the smll files?

 

Normlly there is lots of overheaad with lots of small files.

Just the smaller the files in a game for example copying them to another place on the drive

Link to comment
Share on other sites

Link to post
Share on other sites

13 minutes ago, Smackaroy said:

Just the smaller the files in a game for example copying them to another place on the drive

then use a multithreaded copying program like robocopy with the /mt switch.

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, Electronics Wizardy said:

then use a multithreaded copying program like robocopy with the /mt switch.

I'm the image I have an 850 evolution plugged in via USB thats why the speeds are slow but the rule still applies. The consistent green line is when it was writing lager files about 80mbs again its slow because of the usb but you can see when it writes files which are about 500kb it drops to 1-2mbs

20200709_005427.jpg

Link to comment
Share on other sites

Link to post
Share on other sites

1 minute ago, Smackaroy said:

I'm the image I have an 850 evolution plugged in via USB thats why the speeds are slow but the rule still applies. The consistent green line is when it was writing lager files about 80mbs again its slow because of the usb but you can see when it writes files which are about 500kb it drops to 1-2mbs

20200709_005427.jpg

that seems expected. Small files will do that. What does usage in task manager look like?

 

Id try robocopy with multithreading.

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, Electronics Wizardy said:

that seems expected. Small files will do that. What does usage in task manager look like?

 

Id try robocopy with multithreading.

OK thanks for the help I'll have a look at robocopy tomorrow its quite late where I am. 

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×