Raspberry Pi Server - Tiered Storage

[ThisIsLiz]

Hey everybody,
 

I have a bit of a noob question that I cannot solve using Google or bothering Reddit (I'm probably missing something obvious here). I use a Pi as a Cloud Server - now I would like to replace the Cloud HDD with a larger HDD and a SSD. So far, so simple, there's good guides for all that, but: I would like to use the SSD and HDD as tiered storage, so my question is about the file system, not the cloud software. LVM does not offer that functionality, bcache offers caching (I'm not looking for that, I care more about a larger storage pool than any redundancy). It looks like "autotier" by 45Drives would be perfect for me, but as far as I see, they only have an amd64 version. So, simple enough: Is there a way to get this AMD version running on my pi (I tried and get a lot of unmet dependencies, libfuse3 for amd among others) or does anyone know of a tool that does the same thing? Thanks for any input!
PS: If there's no solution, I'll just use bcache, it's not that important to have 500GB more, I'm just being stubborn

[LIGISTX]

5 hours ago, ThisIsLiz said:

Hey everybody,
 

I have a bit of a noob question that I cannot solve using Google or bothering Reddit (I'm probably missing something obvious here). I use a Pi as a Cloud Server - now I would like to replace the Cloud HDD with a larger HDD and a SSD. So far, so simple, there's good guides for all that, but: I would like to use the SSD and HDD as tiered storage, so my question is about the file system, not the cloud software. LVM does not offer that functionality, bcache offers caching (I'm not looking for that, I care more about a larger storage pool than any redundancy). It looks like "autotier" by 45Drives would be perfect for me, but as far as I see, they only have an amd64 version. So, simple enough: Is there a way to get this AMD version running on my pi (I tried and get a lot of unmet dependencies, libfuse3 for amd among others) or does anyone know of a tool that does the same thing? Thanks for any input!
PS: If there's no solution, I'll just use bcache, it's not that important to have 500GB more, I'm just being stubborn

…why do you want to have a tiered storage solution running on a pi? What do you mean it’s a cloud server? What do you use this for exactly?

[Domrockt]

You could install zfs on a Pie afaik.

[ThisIsLiz]

@LIGISTX: It's running ownCloud currently - I use it to collab/share files with multiple people and in a separate user account to sync files between my PCs (cloud instead of NAS since I work offline/on the train oftentimes). I want tiered storage since we have a lot of smaller files we access oftentimes and a huge archive that is rarely accessed, so mostly for convenience - but truly: because I like tinkering.

@Domrockt: Thanks, will go check it out now!

[LIGISTX]

26 minutes ago, ThisIsLiz said:

@LIGISTX: It's running ownCloud currently - I use it to collab/share files with multiple people and in a separate user account to sync files between my PCs (cloud instead of NAS since I work offline/on the train oftentimes). I want tiered storage since we have a lot of smaller files we access oftentimes and a huge archive that is rarely accessed, so mostly for convenience - but truly: because I like tinkering.

@Domrockt: Thanks, will go check it out now!

Do you access it over the internet? If so, adding a SSD likely won’t make much difference since the latency is going to be from the internet connection and not the harddrive. Even over local gigabit LAN, a harddrive is probably fine. 
 

I am sure there is a way to do what you are after, but I am not sure how. 
 

36 minutes ago, Domrockt said:

You could install zfs on a Pie afaik.

Even if you could, it doesn’t have nearly enough RAM to run ZFS, and if you wanted to run a L2arc cache, you need even more RAM….. 

[Jarsky]

If there's no redundancy, is there a point in tiering ?  Just have 2 logical volumes... 

 

If you want to move files that are older, you could just setup a basic cron job and a bash script