Docker volume on centralized storage server

[jpyg]

Hello there!

I recently update my homelab by build a server as a network storage device.
Actually, I run 3 nodes with Docker Swarm running on it, but as you might know, when you run a container with a persistant volume, it will be stored on the server where the container run for the first time. 
Also, some software require config file, that can be only store on the master node (For exemple, I configure my traefik using toml config file). 

I would like to host all those file on a network drive and allow docker to mount volume or mount config file from a network share, but I can't find any solution about it.

Did some person here already experienced an issue like this and found a solution ?

Thanks

[igormp]

I don't think that's doable with docker swarm. Instead, I'd looking into migrating your stuff over to k8s.

[jpyg]

10 minutes ago, igormp said:

I don't think that's doable with docker swarm. Instead, I'd looking into migrating your stuff over to k8s.

I never used k8s, but doesn't it have the same issue with data stored on local persistant volume ?

[igormp]

14 minutes ago, jpyg said:

I never used k8s, but doesn't it have the same issue with data stored on local persistant volume ?

No, you can attach a nfs volume easily, see: https://kubernetes.io/docs/concepts/storage/volumes/#nfs

 

However, now that I gave a look at it, it also seems possible with docker-swarm: https://gist.github.com/ruanbekker/4a9c0d250bce9f84482f2a788ce92131

 

Another option would be to have something like minio action and an object storage abstraction.

[jpyg]

2 minutes ago, igormp said:

No, you can attach a nfs volume easily, see: https://kubernetes.io/docs/concepts/storage/volumes/#nfs

 

However, now that I gave a look at it, it also seems possible with docker-swarm: https://gist.github.com/ruanbekker/4a9c0d250bce9f84482f2a788ce92131

 

Another option would be to have something like minio action and an object storage abstraction.

AFAIK but maybe I'm wrong, but isn't there some issue while trying to host database on an NFS volume ?

I'll take a look, maybe Minio could resolve my issue

[igormp]

2 hours ago, jpyg said:

AFAIK but maybe I'm wrong, but isn't there some issue while trying to host database on an NFS volume ?

I'll take a look, maybe Minio could resolve my issue

The issues are mostly related to performance and latency, but since you're running that stuff locally it shouldn't be a problem.

 

You'd still face similar issues with minio since that's an object storage, not block storage, and also over the network.

 

Also, if you're running a database on your cluster, why not have it set to run in a specific node? This way your persistent storage in a single node wouldn't be a problem.

[jpyg]

21 minutes ago, igormp said:

The issues are mostly related to performance and latency, but since you're running that stuff locally it shouldn't be a problem.

 

You'd still face similar issues with minio since that's an object storage, not block storage, and also over the network.

 

Also, if you're running a database on your cluster, why not have it set to run in a specific node? This way your persistent storage in a single node wouldn't be a problem.

I'm actually using my lab to test possible case on an infrastructure, but actually, the only thing i'm blocked with is that if the node where the database is hosted down for some reason, I have no solution to reup the database with data on another node

[igormp]

4 minutes ago, jpyg said:

I'm actually using my lab to test possible case on an infrastructure, but actually, the only thing i'm blocked with is that if the node where the database is hosted down for some reason, I have no solution to reup the database with data on another node

Well, what would happen if your note containing the actual data went down? Even if you were to spin up another instance of your database, it wouldn't be able to access the data in any way.

 

Still, if you're going for an actual production environment, I'd go with k8s instead, it has way better community support when compared to docker swarm.