Jump to content

FreeNAS: Why are my files taking up so much space???

Go to solution Solved by TechyBen,

https://forums.freenas.org/index.php?threads/size-on-disk-zfs-4k-data-is-65-larger-than-data-size.28790/

 

Might be if the drives were formatted to 4k allocation block size on the disk but ending up using zfs 512k per "block"... but allocating the full 4k (so 512 into 4k is over 7 times the space per block size!) each time.

 

No idea if that is what happened here though.

This is another way to get at that info.

diskinfo -v da1

"Only proprietary software vendors want proprietary software." - Dexter's Law

Link to comment
Share on other sites

Link to post
Share on other sites

So what to do about it....

 

I don't know what this is on but the devices show up as da's so that is kind of odd.. the slack problem would occur when the drive is writing 512b file and it takes up 4k space. meaning the disk must lie to the OS?

 

You can force this to write 4k with ashift 12 or 512b with ashift 9 - This is pretty advanced though and can impact the performance of the pool.

 

I would do 12 (4k) regardless of what the drive is telling you. If they are actually 512b physical this won't break anything.

 

The only way to do this is at pool creation time. It's basically the drives format so pretty much all filesystems are like this. the only way to do it is to reformat.

"Only proprietary software vendors want proprietary software." - Dexter's Law

Link to comment
Share on other sites

Link to post
Share on other sites

again zpool get all | grep ashift will tell you what it was set to when the pool was created so we can get to the bottom of this mystery.

12 = 4k

9 = 512b (I think, it's rarely used)

 

If that command returns nothing it means it's unset and prob 512b

 

(this is rare btw.. I've used zfs for 10 years and never seen it.. but again I always force ashift 12 also so.. hmm)

"Only proprietary software vendors want proprietary software." - Dexter's Law

Link to comment
Share on other sites

Link to post
Share on other sites

17 hours ago, grimreeper132 said:

just tried 512K finally a nice image

image.png.1e4bdff2ce0fc16ddeb200785951f7d5.png

 

I beg to differ. There is nothing nice there. I mean, having 1 copy of Die Hard 4.0 is bad, but having 4 copies is unforgivable! ;)

 

(Glad you got it sorted!)

Link to comment
Share on other sites

Link to post
Share on other sites

5 hours ago, TechyBen said:

I beg to differ. There is nothing nice there. I mean, having 1 copy of Die Hard 4.0 is bad, but having 4 copies is unforgivable! ;)

 

(Glad you got it sorted!)

hey, it's not bad if you get it for free :P 

 

and yea so am I

The owner of "too many" computers, called

The Lord of all Toasters (1920X 1080ti 32GB)

The Toasted Controller (i5 4670, R9 380, 24GB)

The Semi Portable Toastie machine (i7 3612QM (was an i3) intel HD 4000 16GB)'

Bread and Butter Pudding (i7 7700HQ, 1050ti, 16GB)

Pinoutbutter Sandwhich (raspberry pi 3 B)

The Portable Slice of Bread (N270, HAHAHA, 2GB)

Muffinator (C2D E6600, Geforce 8400, 6GB, 8X2TB HDD)

Toastbuster (WIP, should be cool)

loaf and let dough (A printer that doesn't print black ink)

The Cheese Toastie (C2D (of some sort), GTX 760, 3GB, win XP gaming machine)

The Toaster (C2D, intel HD, 4GB, 2X1TB NAS)

Matter of Loaf and death (some old shitty AMD laptop)

windybread (4X E5470, intel HD, 32GB ECC) (use coming soon, maybe)

And more, several more

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×