Jump to content

Linux File Limitations?

Go to solution Solved by vanished,
On 7/1/2016 at 5:40 PM, IAmLamp said:

Just wondering if there would be something out there that could help bypass or get around the Windows file limitations, I need to get my data over to a different drive. I was thinking something like temporary use of Linux, but I'm not sure if that would work. 

Well some of the limitations are on Windows, and some are NTFS itself.  For example, NTFS supports having things like a colon in the file name, but try opening a file like that on Windows and it'll throw a fit.  The lack of case-sensitivity, however, is actually a limitation of NTFS itself from what I've been able to tell.  I'm not sure about all of the things we identified (path length limitations, support for other, even stranger characters, etc.) but the easiest way to get around the limitations would be to use Linux to move all your files onto a filesystem that supports everything you need, and then continue to use it just with Linux.

Just wondering what kind of limitations Linux has compared to Windows. I keep getting an annoying error like this in Windows and I was just wondering if Linux has limitations like this or not. It's kind of an essential question. 

 

file-name-too-long.jpg

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/
Share on other sites

Link to post
Share on other sites

It doesn't.

[Out-of-date] Want to learn how to make your own custom Windows 10 image?

 

Desktop: AMD R9 3900X | ASUS ROG Strix X570-F | Radeon RX 5700 XT | EVGA GTX 1080 SC | 32GB Trident Z Neo 3600MHz | 1TB 970 EVO | 256GB 840 EVO | 960GB Corsair Force LE | EVGA G2 850W | Phanteks P400S

Laptop: Intel M-5Y10c | Intel HD Graphics | 8GB RAM | 250GB Micron SSD | Asus UX305FA

Server 01: Intel Xeon D 1541 | ASRock Rack D1541D4I-2L2T | 32GB Hynix ECC DDR4 | 4x8TB Western Digital HDDs | 32TB Raw 16TB Usable

Server 02: Intel i7 7700K | Gigabye Z170N Gaming5 | 16GB Trident Z 3200MHz

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944861
Share on other sites

Link to post
Share on other sites

On Windows (NTFS file system), filename itself is limited to 255 characters, and the total path length is 32,767 characters. Linux, assuming you use ext4, filename is limited to 255 bytes, but total path length limit is not defined.

HAL9000: AMD Ryzen 9 3900x | Noctua NH-D15 chromax.black | 32 GB Corsair Vengeance LPX DDR4 3200 MHz | Asus X570 Prime Pro | ASUS TUF 3080 Ti | 1 TB Samsung 970 Evo Plus + 1 TB Crucial MX500 + 6 TB WD RED | Corsair HX1000 | be quiet Pure Base 500DX | LG 34UM95 34" 3440x1440

Hydrogen server: Intel i3-10100 | Cryorig M9i | 64 GB Crucial Ballistix 3200MHz DDR4 | Gigabyte B560M-DS3H | 33 TB of storage | Fractal Design Define R5 | unRAID 6.9.2

Carbon server: Fujitsu PRIMERGY RX100 S7p | Xeon E3-1230 v2 | 16 GB DDR3 ECC | 60 GB Corsair SSD & 250 GB Samsung 850 Pro | Intel i340-T4 | ESXi 6.5.1

Big Mac cluster: 2x Raspberry Pi 2 Model B | 1x Raspberry Pi 3 Model B | 2x Raspberry Pi 3 Model B+

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944877
Share on other sites

Link to post
Share on other sites

6 minutes ago, DeadEyePsycho said:

It doesn't.

it does

http://serverfault.com/questions/9546/filename-length-limits-on-linux

NEW PC build: Blank Heaven   minimalist white and black PC     Old S340 build log "White Heaven"        The "LIGHTCANON" flashlight build log        Project AntiRoll (prototype)        Custom speaker project

Spoiler

Ryzen 3950X | AMD Vega Frontier Edition | ASUS X570 Pro WS | Corsair Vengeance LPX 64GB | NZXT H500 | Seasonic Prime Fanless TX-700 | Custom loop | Coolermaster SK630 White | Logitech MX Master 2S | Samsung 980 Pro 1TB + 970 Pro 512GB | Samsung 58" 4k TV | Scarlett 2i4 | 2x AT2020

 

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944883
Share on other sites

Link to post
Share on other sites

3 hours ago, jj9987 said:

On Windows (NTFS file system), filename itself is limited to 255 characters, and the total path length is 32,767 characters. Linux, assuming you use ext4, filename is still limited to 255 characters, but total path length limit is not defined.

what is ext4, I plan on trying out ubuntu, not sure if that has it

 

I wonder if it would be possible to hit the same error in linux then, it doesn't sound like it though 

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944887
Share on other sites

Link to post
Share on other sites

I think what you mean to ask is what limitations do typical Linux filesystems have, not the OS itself.  I can tell you that they're generally better in every way.  They are case sensitive, unlike NTFS, they can (usually, not always) have longer file names, and they support more and different characters in filenames that Windows/NTFS would not.

Solve your own audio issues  |  First Steps with RPi 3  |  Humidity & Condensation  |  Sleep & Hibernation  |  Overclocking RAM  |  Making Backups  |  Displays  |  4K / 8K / 16K / etc.  |  Do I need 80+ Platinum?

If you can read this you're using the wrong theme.  You can change it at the bottom.

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944890
Share on other sites

Link to post
Share on other sites

3 minutes ago, IAmLamp said:

what is ext4, I plan on trying out ubuntu, not sure if that has it

 

I wonder if it would be possible to hit the same error in linux then, it doesn't sound like it though 

EXT4 is the file system, that is most often used on desktop Linux environments.

 

On OS X (HFS+ file system), the limit is also 255 chars per filename and no limit for path.

HAL9000: AMD Ryzen 9 3900x | Noctua NH-D15 chromax.black | 32 GB Corsair Vengeance LPX DDR4 3200 MHz | Asus X570 Prime Pro | ASUS TUF 3080 Ti | 1 TB Samsung 970 Evo Plus + 1 TB Crucial MX500 + 6 TB WD RED | Corsair HX1000 | be quiet Pure Base 500DX | LG 34UM95 34" 3440x1440

Hydrogen server: Intel i3-10100 | Cryorig M9i | 64 GB Crucial Ballistix 3200MHz DDR4 | Gigabyte B560M-DS3H | 33 TB of storage | Fractal Design Define R5 | unRAID 6.9.2

Carbon server: Fujitsu PRIMERGY RX100 S7p | Xeon E3-1230 v2 | 16 GB DDR3 ECC | 60 GB Corsair SSD & 250 GB Samsung 850 Pro | Intel i340-T4 | ESXi 6.5.1

Big Mac cluster: 2x Raspberry Pi 2 Model B | 1x Raspberry Pi 3 Model B | 2x Raspberry Pi 3 Model B+

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944893
Share on other sites

Link to post
Share on other sites

3 hours ago, Ryan_Vickers said:

I think what you mean to ask is what limitations do typical Linux filesystems have, not the OS itself.  I can tell you that they're generally better in every way.  They are case sensitive, unlike NTFS, they can (usually, not always) have longer file names, and they support more and different characters in filenames that Windows/NTFS would not.

That actually sounds very attractive, is that for all linux distros or just some? I'm thinking about ubuntu 

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944898
Share on other sites

Link to post
Share on other sites

1 minute ago, IAmLamp said:

That actually sounds very attractive, is that for all linux distros or just some? I'm thinking about ubuntu 

Anything that supports one of the good filesystems, like Reiser4, which should be any of them, but you'd have to check if it's included by default.

Solve your own audio issues  |  First Steps with RPi 3  |  Humidity & Condensation  |  Sleep & Hibernation  |  Overclocking RAM  |  Making Backups  |  Displays  |  4K / 8K / 16K / etc.  |  Do I need 80+ Platinum?

If you can read this you're using the wrong theme.  You can change it at the bottom.

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944902
Share on other sites

Link to post
Share on other sites

I think, at least my version of Windows 10 (and 7 before it) is limited to 255 chars for the entire length. :(  I get that complaint even when a single folder or file might only be 100 chars.  I could understand limits like that when drives were only like 10-20 MB and several thousand bucks each (back in the early 1980s or so), but now when you can get double-digit terabytes for only triple-digit bucks?  I just don't understand having such limits.

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944906
Share on other sites

Link to post
Share on other sites

I should mention too, that there is a lot that goes into making a filesystem good or bad.  Support for odd filenames is only one small aspect, and probably shouldn't be your highest priority.  I would look also for performance, reliability, and support for advanced features, but you can't really go wrong in those areas with something like EXT4

Solve your own audio issues  |  First Steps with RPi 3  |  Humidity & Condensation  |  Sleep & Hibernation  |  Overclocking RAM  |  Making Backups  |  Displays  |  4K / 8K / 16K / etc.  |  Do I need 80+ Platinum?

If you can read this you're using the wrong theme.  You can change it at the bottom.

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944911
Share on other sites

Link to post
Share on other sites

3 hours ago, PianoPlayer88Key said:

I think, at least my version of Windows 10 (and 7 before it) is limited to 255 chars for the entire length. :(  I get that complaint even when a single folder or file might only be 100 chars.  I could understand limits like that when drives were only like 10-20 MB and several thousand bucks each (back in the early 1980s or so), but now when you can get double-digit terabytes for only triple-digit bucks?  I just don't understand having such limits.

Yeah hopefully they'll make the switch to something better, but in the mean time that's actually a pretty large bottleneck for the work I do and plan on doing, that and I want to get extremely well organized 

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944914
Share on other sites

Link to post
Share on other sites

10 minutes ago, jj9987 said:

On Windows (NTFS file system), filename itself is limited to 255 characters, and the total path length is 32,767 characters. Linux, assuming you use ext4, filename is limited to 255 bytes, but total path length limit is not defined.

Really?  I thought that the whole path was actually limited to 255 as well... (on windows)

Solve your own audio issues  |  First Steps with RPi 3  |  Humidity & Condensation  |  Sleep & Hibernation  |  Overclocking RAM  |  Making Backups  |  Displays  |  4K / 8K / 16K / etc.  |  Do I need 80+ Platinum?

If you can read this you're using the wrong theme.  You can change it at the bottom.

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944920
Share on other sites

Link to post
Share on other sites

3 hours ago, Ryan_Vickers said:

I should mention too, that there is a lot that goes into making a filesystem good or bad.  Support for odd filenames is only one small aspect, and probably shouldn't be your highest priority.  I would look also for performance, reliability, and support for advanced features, but you can't really go wrong in those areas with something like EXT4

Does OS X has limitations like the ones shown here specifically for Windows? 

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944921
Share on other sites

Link to post
Share on other sites

6 minutes ago, PianoPlayer88Key said:

I think, at least my version of Windows 10 (and 7 before it) is limited to 255 chars for the entire length. :(  I get that complaint even when a single folder or file might only be 100 chars.  I could understand limits like that when drives were only like 10-20 MB and several thousand bucks each (back in the early 1980s or so), but now when you can get double-digit terabytes for only triple-digit bucks?  I just don't understand having such limits.

255 characters for the FILE NAME

its 32000 characters for the path

 

10 minutes ago, IAmLamp said:

what is ext4, I plan on trying out ubuntu, not sure if that has it

 

I wonder if it would be possible to hit the same error in linux then, it doesn't sound like it though 

linux is 255 bytes

which using UTF 8 will be 255 characters

unless you use some characters outside the standard 256 bit table, in which case it will be less, down to 127 characters

so if you use just regular english letters and characters, thats the exact same as windows

NEW PC build: Blank Heaven   minimalist white and black PC     Old S340 build log "White Heaven"        The "LIGHTCANON" flashlight build log        Project AntiRoll (prototype)        Custom speaker project

Spoiler

Ryzen 3950X | AMD Vega Frontier Edition | ASUS X570 Pro WS | Corsair Vengeance LPX 64GB | NZXT H500 | Seasonic Prime Fanless TX-700 | Custom loop | Coolermaster SK630 White | Logitech MX Master 2S | Samsung 980 Pro 1TB + 970 Pro 512GB | Samsung 58" 4k TV | Scarlett 2i4 | 2x AT2020

 

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944925
Share on other sites

Link to post
Share on other sites

2 minutes ago, Enderman said:

255 characters for the FILE NAME

its 32000 characters for the path

 

13 minutes ago, jj9987 said:

On Windows (NTFS file system), filename itself is limited to 255 characters, and the total path length is 32,767 characters. Linux, assuming you use ext4, filename is limited to 255 bytes, but total path length limit is not defined.

Really?  That's odd, since I just made a folder called "1234567890" and nested it 32 levels deep and hit a path length limit before reaching the end ;)

Solve your own audio issues  |  First Steps with RPi 3  |  Humidity & Condensation  |  Sleep & Hibernation  |  Overclocking RAM  |  Making Backups  |  Displays  |  4K / 8K / 16K / etc.  |  Do I need 80+ Platinum?

If you can read this you're using the wrong theme.  You can change it at the bottom.

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944932
Share on other sites

Link to post
Share on other sites

2 minutes ago, Ryan_Vickers said:

 

Really?  That's odd, since I just made a folder called "1234567890" and nested it 16 levels deep and hit a path length limit before reaching the end ;)

http://stackoverflow.com/questions/265769/maximum-filename-length-in-ntfs-windows-xp-and-windows-vista

ntfs is

windows is shorter though

NEW PC build: Blank Heaven   minimalist white and black PC     Old S340 build log "White Heaven"        The "LIGHTCANON" flashlight build log        Project AntiRoll (prototype)        Custom speaker project

Spoiler

Ryzen 3950X | AMD Vega Frontier Edition | ASUS X570 Pro WS | Corsair Vengeance LPX 64GB | NZXT H500 | Seasonic Prime Fanless TX-700 | Custom loop | Coolermaster SK630 White | Logitech MX Master 2S | Samsung 980 Pro 1TB + 970 Pro 512GB | Samsung 58" 4k TV | Scarlett 2i4 | 2x AT2020

 

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944935
Share on other sites

Link to post
Share on other sites

4 minutes ago, IAmLamp said:

Does OS X has limitations like the ones shown here specifically for Windows? 

You'd have to look up the limitations on HFS+.  I believe it is generally pretty good, but it may limit paths as well

Solve your own audio issues  |  First Steps with RPi 3  |  Humidity & Condensation  |  Sleep & Hibernation  |  Overclocking RAM  |  Making Backups  |  Displays  |  4K / 8K / 16K / etc.  |  Do I need 80+ Platinum?

If you can read this you're using the wrong theme.  You can change it at the bottom.

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944939
Share on other sites

Link to post
Share on other sites

2 minutes ago, Enderman said:

Sorry, what are you saying?  I'm trying to claim that the path length in Windows/NTFS is also limited to something around 255 characters, and I seem to have just proven it too.  Are we actually agreeing on this or not... I can't tell :P

Solve your own audio issues  |  First Steps with RPi 3  |  Humidity & Condensation  |  Sleep & Hibernation  |  Overclocking RAM  |  Making Backups  |  Displays  |  4K / 8K / 16K / etc.  |  Do I need 80+ Platinum?

If you can read this you're using the wrong theme.  You can change it at the bottom.

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944948
Share on other sites

Link to post
Share on other sites

4 minutes ago, Ryan_Vickers said:

 

Really?  That's odd, since I just made a folder called "1234567890" and nested it 16 levels deep and hit a path length limit before reaching the end ;)

oh and also with windows 10 you can remove the 260 byte path limit

http://mspoweruser.com/ntfs-260-character-windows-10/

NEW PC build: Blank Heaven   minimalist white and black PC     Old S340 build log "White Heaven"        The "LIGHTCANON" flashlight build log        Project AntiRoll (prototype)        Custom speaker project

Spoiler

Ryzen 3950X | AMD Vega Frontier Edition | ASUS X570 Pro WS | Corsair Vengeance LPX 64GB | NZXT H500 | Seasonic Prime Fanless TX-700 | Custom loop | Coolermaster SK630 White | Logitech MX Master 2S | Samsung 980 Pro 1TB + 970 Pro 512GB | Samsung 58" 4k TV | Scarlett 2i4 | 2x AT2020

 

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944950
Share on other sites

Link to post
Share on other sites

2 minutes ago, Enderman said:

oh and also with windows 10 you can remove the 260 byte path limit

http://mspoweruser.com/ntfs-260-character-windows-10/

Interesting.  I'll check that out actually, thanks :)

But by default, it does seem to have a 255 character path length limit.  Whether this is Windows or NTFS I'm not sure actually but it does happen on Windows 10 for me right now.

Solve your own audio issues  |  First Steps with RPi 3  |  Humidity & Condensation  |  Sleep & Hibernation  |  Overclocking RAM  |  Making Backups  |  Displays  |  4K / 8K / 16K / etc.  |  Do I need 80+ Platinum?

If you can read this you're using the wrong theme.  You can change it at the bottom.

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944956
Share on other sites

Link to post
Share on other sites

4 minutes ago, Enderman said:

oh and also with windows 10 you can remove the 260 byte path limit

http://mspoweruser.com/ntfs-260-character-windows-10/

So I just checked Group Policy and I don't seem to have the key they mention... xD 

Solve your own audio issues  |  First Steps with RPi 3  |  Humidity & Condensation  |  Sleep & Hibernation  |  Overclocking RAM  |  Making Backups  |  Displays  |  4K / 8K / 16K / etc.  |  Do I need 80+ Platinum?

If you can read this you're using the wrong theme.  You can change it at the bottom.

Link to comment
https://linustechtips.com/topic/615054-linux-file-limitations/#findComment-7944965
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×