FREENAS Amazon Drive Backup

[desertcomputer]

Hi

 

I was hoping to setup my freenas to backup to amazon drive, i have found many different way to backup. I want to do process on freenas itself. I want to backup some of data sets to amazon cloud as back such as my plex media/NVR backup/work items. Does the following guide below work on freenas? Because I upgrading my freenas soon i able to look at other OS options such as linux servers, would the setup on that be easier to configure linux server or about the same on freenas. I know freenas offers s3 services which require more money and pain. Would Rclone be easier options?  

 

 

https://amc.ovh/2015/08/14/mounting-uploading-amazon-cloud-drive-encrypted.html

https://github.com/dcplaya/acd_cli-BackupScripts

[1823alex]

15 minutes ago, MrUnknownEMC said:

Hi

 

I was hoping to setup my freenas to backup to amazon drive, i have found many different way to backup. I want to do process on freenas itself. I want to backup some of data sets to amazon cloud as back such as my plex media/NVR backup/work items. Does the following guide below work on freenas? Because I upgrading my freenas soon i able to look at other OS options such as linux servers, would the setup on that be easier to configure linux server or about the same on freenas. I know freenas offers s3 services which require more money and pain. Would Rclone be easier options?  

 

 

https://amc.ovh/2015/08/14/mounting-uploading-amazon-cloud-drive-encrypted.html

https://github.com/dcplaya/acd_cli-BackupScripts

I currently use rclone.org since it's the easiest option out there if you just want to upload data without worrying about encrypting it. I have it run as a Cron job every other day in the morning, but it seems to end prematurely for some reason but if you run it as a regular command whenever it will peg your CPU and Disk usage heavily.

[desertcomputer]

1 minute ago, 1823alex said:

I currently use rclone.org since it's the easiest option out there if you just want to upload data without worrying about encrypting it. I have it run as a Cron job every other day in the morning, but it seems to end prematurely for some reason but if you run it as a regular command whenever it will peg your CPU and Disk usage heavily.

Do you install rclone into a jail or freenas itself? I couldn't find function where rclone have option to schedules. I don't think i need encryption on plex media or my NVR most likely on my work project but there are already ziped and encrypted.  Is there like guide on settig up cron job or like examplar

[1823alex]

12 minutes ago, MrUnknownEMC said:

Do you install rclone into a jail or freenas itself? I couldn't find function where rclone have option to schedules. I don't think i need encryption on plex media or my NVR most likely on my work project but there are already ziped and encrypted.  Is there like guide on settig up cron job or like examplar

Follow the Linux install from precompiled library process detailed here: http://rclone.org/install/

 

Follow this to connect ACD to Rclone on FreeNAS you'll need to follow this until it says see remote setup docs and use the remote setup docs from there on

 

Assuming you name your ACD to be amazon-drive you can use this command but this command also assumes you used Vol1 for your volume name and Dataset1 for your dataset name. This is the command I have set to run under the tasks > Cron tab in FreeNAS web ui

 

rclone copy /mnt/Vol1/Dataset1 amazon-drive:Backups

This simply copies everything from my dataset to ACD but if I delete something on FreeNAS it's still there on ACD so I haven't really found a better way of doing this yet. Actually I think using this would work but I'd use the --dry-run flag in order to make sure you don't make unwanted changes. This should make your source and destination identical but only changing the destination files.

rclone sync /mnt/Vol1/Dataset1 amazon-drive:Backups

Hope I could help you out, It was a daunting process at first but I got the hang of it fairly quickly.

 

EDIT: When you create the cron job select "Each selected minute" and select "00" and then select "Each selected hour" and select "06" for 6AM and then select "Each selected day of the month" and select all of them or every other day like I did.

[desertcomputer]

15 minutes ago, 1823alex said:

Follow the Linux install from precompiled library process detailed here: http://rclone.org/install/

 

Follow this to connect ACD to Rclone on FreeNAS you'll need to follow this until it says see remote setup docs and use the remote setup docs from there on

 

Assuming you name your ACD to be amazon-drive you can use this command but this command also assumes you used Vol1 for your volume name and Dataset1 for your dataset name. This is the command I have set to run under the tasks > Cron tab in FreeNAS web ui

 

rclone copy /mnt/Vol1/Dataset1 amazon-drive:Backups

This simply copies everything from my dataset to ACD but if I delete something on FreeNAS it's still there on ACD so I haven't really found a better way of doing this yet. Actually I think using this would work but I'd use the --dry-run flag in order to make sure you don't make unwanted changes. This should make your source and destination identical but only changing the destination files.

rclone sync /mnt/Vol1/Dataset1 amazon-drive:Backups

Hope I could help you out, It was a daunting process at first but I got the hang of it fairly quickly.

 

EDIT: When you create the cron job select "Each selected minute" and select "00" and then select "Each selected hour" and select "06" for 6AM and then select "Each selected day of the month" and select all of them or every other day like I did.

So i install this onto a jail?

[1823alex]

7 minutes ago, MrUnknownEMC said:

So i install this onto a jail?

Sorry I forgot to address that, I personally installed it direct to FreeNAS, if you did do it on a jail you'd need to allocate your entire dataset to the jail you create and your cron job would need to use this instead:

jexec <jailid> rclone sync /mnt/Vol1/Dataset1 amazon-drive:Backups

EDIT: Also if you'd like to make the bandwidth limit higher and increase the amount of transfers at once use this command that I usually run, it limits the bandwidth to around 8MB/s upload and then transfers 6 files at a time.

rclone sync /mnt/Vol1/Dataset1 amazon-drive:Backups --transfers 6 --bwlimit 8000

Although for some reason I can't seem to get it to upload faster than 1,000 kBytes/s even though my upload speed is 10MB/s

[desertcomputer]

11 minutes ago, 1823alex said:

Sorry I forgot to address that, I personally installed it direct to FreeNAS, if you did do it on a jail you'd need to allocate your entire dataset to the jail you create and your cron job would need to use this instead:

jexec <jailid> rclone sync /mnt/Vol1/Dataset1 amazon-drive:Backups

EDIT: Also if you'd like to make the bandwidth limit higher and increase the amount of transfers at once use this command that I usually run, it limits the bandwidth to around 8MB/s upload and then transfers 6 files at a time.

rclone sync /mnt/Vol1/Dataset1 amazon-drive:Backups --transfers 6 --bwlimit 8000

Although for some reason I can't seem to get it to upload faster than 1,000 kBytes/s even though my upload speed is 10MB/s

Ok i think install direct to freenas would be easier. I got in trouble with chown command when root:root claimed to illegal group name. Should i change this to nobody? 

[desertcomputer]

17 minutes ago, 1823alex said:

Sorry I forgot to address that, I personally installed it direct to FreeNAS, if you did do it on a jail you'd need to allocate your entire dataset to the jail you create and your cron job would need to use this instead:

jexec <jailid> rclone sync /mnt/Vol1/Dataset1 amazon-drive:Backups

EDIT: Also if you'd like to make the bandwidth limit higher and increase the amount of transfers at once use this command that I usually run, it limits the bandwidth to around 8MB/s upload and then transfers 6 files at a time.

rclone sync /mnt/Vol1/Dataset1 amazon-drive:Backups --transfers 6 --bwlimit 8000

Although for some reason I can't seem to get it to upload faster than 1,000 kBytes/s even though my upload speed is 10MB/s

What the command to start the program? such as manpage and rclone. 

[1823alex]

8 minutes ago, MrUnknownEMC said:

Ok i think install direct to freenas would be easier. I got in trouble with chown command when root:root claimed to illegal group name. Should i change this to nobody? 

You should use root:wheel since root is a user not a group.

[1823alex]

3 minutes ago, MrUnknownEMC said:

What the command to start the program? such as manpage and rclone. 

To begin setting up and connecting ACD to rclone use rclone config and follow the remote setup documentation since you don't have an accessible web browser on the FreeNAS machine, look at my first or 2nd post and you can see the documentation I linked.

[desertcomputer]

2 minutes ago, 1823alex said:

To begin setting up and connecting ACD to rclone use rclone config and follow the remote setup documentation since you don't have an accessible web browser on the FreeNAS machine, look at my first or 2nd post and you can see the documentation I linked.

I am SSH into my freenas and when tried to do rclone config i get command not found. 

[1823alex]

5 minutes ago, MrUnknownEMC said:

I am SSH into my freenas and when tried to do rclone config i get command not found. 

Did you run through the installation procedure?

EDIT: You need to do this also I believe one of the commands doesn't work but it seems to work fine if you just keep going through to the next step anyways.

 

Linux installation from precompiled binary

Fetch and unpack

curl -O http://downloads.rclone.org/rclone-current-linux-amd64.zip
unzip rclone-current-linux-amd64.zip
cd rclone-*-linux-amd64

Copy binary file

sudo cp rclone /usr/sbin/
sudo chown root:root /usr/sbin/rclone
sudo chmod 755 /usr/sbin/rclone

Install manpage

sudo mkdir -p /usr/local/share/man/man1
sudo cp rclone.1 /usr/local/share/man/man1/
sudo mandb 

Run rclone config to setup. See rclone config docs for more details.

rclone config

[desertcomputer]

6 minutes ago, 1823alex said:

Did you run through the installation procedure?

EDIT: You need to do this also I believe one of the commands doesn't work but it seems to work fine if you just keep going through to the next step anyways.

 

Linux installation from precompiled binary

Fetch and unpack

curl -O http://downloads.rclone.org/rclone-current-linux-amd64.zip
unzip rclone-current-linux-amd64.zip
cd rclone-*-linux-amd64

Copy binary file

sudo cp rclone /usr/sbin/
sudo chown root:root /usr/sbin/rclone
sudo chmod 755 /usr/sbin/rclone

Install manpage

sudo mkdir -p /usr/local/share/man/man1
sudo cp rclone.1 /usr/local/share/man/man1/
sudo mandb 

Run rclone config to setup. See rclone config docs for more details.

rclone config

Just I able do all commands apart from "mandb" and "rclone config". I presume you remove sudo and it should work for second install part. 

[1823alex]

2 minutes ago, MrUnknownEMC said:

Just I able do all commands apart from "mandb" and "rclone config". I presume you remove sudo and it should work for second install part. 

Did you try running "mandb" and also try running "sudo mandb" otherwise try "sudo rclone config" or "rclone config" or "rclone" it should find the command.

[desertcomputer]

1 minute ago, 1823alex said:

Did you try running "mandb" and also try running "sudo mandb" otherwise try "sudo rclone config" or "rclone config" or "rclone" it should find the command.

I have tired sudo rclone config but user root is not allow to execute and sudo mandb is still not unknown command. 

[1823alex]

1 minute ago, MrUnknownEMC said:

I have tired sudo rclone config but user root is not allow to execute and sudo mandb is still not unknown command. 

Try running this 

sudo chmod 755 /usr/sbin/rclone

sudo chmod 775 /usr/sbin/rclone

and then try

sudo rclone config

 

[desertcomputer]

1 minute ago, 1823alex said:

Try running this 

sudo chmod 755 /usr/sbin/rclone

sudo chmod 775 /usr/sbin/rclone

and then try

sudo rclone config

 

Same error previous when i run sudo chmod. 

[1823alex]

1 minute ago, MrUnknownEMC said:

Same error previous when i run sudo chmod. 

Are you logged in as root@freenas when running these?

[desertcomputer]

1 minute ago, 1823alex said:

Are you logged in as root@freenas when running these?

Yes. 

 

[1823alex]

5 minutes ago, MrUnknownEMC said:

Yes. 

 

Run this and try what I said above to see if it works

sudo chown root:wheel /usr/sbin/rclone

 

[desertcomputer]

3 minutes ago, 1823alex said:

Run this and try what I said above to see if it works

sudo chown root:wheel /usr/sbin/rclone

 

Nope same problem. 

[1823alex]

Just now, MrUnknownEMC said:

Nope same problem. 

That's odd I don't know why that would happen, I'd recommend posting over to reddit.com/r/freenas or reddit.com/r/datahoarder and maybe the FreeNAS forums for better help, sorry I couldn't help you out here it should work fine but I'm not sure why it's denying you.

[desertcomputer]

27 minutes ago, 1823alex said:

That's odd I don't know why that would happen, I'd recommend posting over to reddit.com/r/freenas or reddit.com/r/datahoarder and maybe the FreeNAS forums for better help, sorry I couldn't help you out here it should work fine but I'm not sure why it's denying you.

Ok some how root sudo access was disabled. I enabled and it works but now i get this error below. 

 

Quote

ELF binary type "0" not known.                                                  
/usr/sbin/rclone: 1: Syntax error: "(" unexpected

 

[1823alex]

1 minute ago, MrUnknownEMC said:

Ok some how root sudo access was disabled. I enabled and it works but now i get this error below. 

 

 

You should run through the install procedure again then since sudo was disabled, just redo it all.

[desertcomputer]

Just now, 1823alex said:

You should run through the install procedure again then since sudo was disabled, just redo it all.

Same problem, mandb is also unknown command.