Jump to content

Steam Caching Tutorial

jakkuh_t
13 hours ago, SHAW_WAR10CK said:

First Download will be at default internet speed ?

 

Yea, the cache server doesn’t actively download anything on it’s own.  It records what you download and then just repeats it on a local level at LAN speeds.

Link to comment
Share on other sites

Link to post
Share on other sites

I´m trying to get steamcache running in VirtualBox under Windows 10.

I´ve tried using Ubuntu 18.10 and Lubuntu 18.10, but doesn´t make a difference as expected...

I´m using VirtualBox with networking in bridge mode, gave the VM a static IP and changed the DNS server of my router to the vm...

I´m also using steamcache/monolithic because it is way faster to set up than using a seperate docker container for each service...

steamcache/monolithic and sniproxy are runing fine, but steamcache-dns refuse to run...
Everytime I´m trying to run steamcache-dns I get:

docker: Error response from daemon: driver failed programming external connectivity on endpoint steamcache-dns (3e580a614b2298823e3dd68f0edd3eaa18b9549fcd7b9b75be85407370206a32): Error starting userland proxy: listen udp 0.0.0.0:53: bind: address already in use.

Anyone an idea how to solve this?

 

I`m using this comand to start steamcache-dns:

sudo docker run --restart unless-stopped --name steamcache-dns --detach -p 53:53/udp -e USE_GENERIC_CACHE=true -e LANCACHE_IP=192.168.178.49 steamcache/steamcache-dns:latest

 

EDIT:
Just added my DNS IP to "-p 53:53/udp" now it just keeps restarting...

Link to comment
Share on other sites

Link to post
Share on other sites

Ok, finally got it working under Ubuntu 18.10 with SteamCache/monolithic

I used...

sudo docker run --restart unless-stopped -d --name lancache -v /home/USERNAME/cache/steam/data:/data/cache -v /home/USERNAME/cache/steam/logs:/data/logs -p 192.168.178.50:80:80 steamcache/monolithic:latest

...for steamcache/monolithic.

 

sudo docker run --restart unless-stopped --name sniproxy --detach -p 192.168.178.50:443:443 steamcache/sniproxy:latest

...for sniproxy

 

and

sudo docker run --restart unless-stopped -d --name steamcache-dns -p 192.168.178.50:53:53/udp -e USE_GENERIC_CACHE=true -e LANCACHE_IP=192.168.178.50 steamcache/steamcache-dns:latest

...for steamcache-dns
 

Link to comment
Share on other sites

Link to post
Share on other sites

On 2/26/2019 at 12:10 AM, Coop52 said:

Those of you looking to set this up might find this a bit easier / better, especially if you're looking for more than just Steam (this includes Windows Update);

 

https://hub.docker.com/r/steamcache/monolithic

 

 

Have you successfully configured monolithic? I had some issues so went back to tutorial method until I find a guide.

Link to comment
Share on other sites

Link to post
Share on other sites

On 3/6/2019 at 12:18 PM, Native7i said:

Have you successfully configured monolithic? I had some issues so went back to tutorial method until I find a guide.

Yes i successfully got this running, however I didn't follow the guide on the site but something in between the guide here and what the site says.... I might write something up here later if I have some time this weekend.

Link to comment
Share on other sites

Link to post
Share on other sites

On 3/4/2019 at 5:50 PM, 9Tech said:

Ok, finally got it working under Ubuntu 18.10 with SteamCache/monolithic

I used...


sudo docker run --restart unless-stopped -d --name lancache -v /home/USERNAME/cache/steam/data:/data/cache -v /home/USERNAME/cache/steam/logs:/data/logs -p 192.168.178.50:80:80 steamcache/monolithic:latest

...for steamcache/monolithic.

 


sudo docker run --restart unless-stopped --name sniproxy --detach -p 192.168.178.50:443:443 steamcache/sniproxy:latest

...for sniproxy

 

and


sudo docker run --restart unless-stopped -d --name steamcache-dns -p 192.168.178.50:53:53/udp -e USE_GENERIC_CACHE=true -e LANCACHE_IP=192.168.178.50 steamcache/steamcache-dns:latest

...for steamcache-dns
 

THANK YOU SO MUCH THIS WORLED PERFECTLY

(changed USERNAME to match mine)

(changed ips to match mine)

set dns on clients pc's restarted boom

 

One question, should i still set cache limits? memory limits? how do i give it  a maintenance?

 

I was using linus guide from when it was posted and the 1tb drive got filled and it kept erroring out so i remade it with monolothich, thx!

 

Link to comment
Share on other sites

Link to post
Share on other sites

trying to get this working on my synology. it loads up fine says it should be working, i see my dns is getting hits. but it will not cache anything and my downloads just stuck ... maybe its a permission thing but is chmod 775 -R the folder it should be going too and nothing happeneing still. not caching anything.. help.

Link to comment
Share on other sites

Link to post
Share on other sites

it shows my cpu maxed. but maybe thats misleading and i get some kinda network activity but not enough for caching gamesimage.thumb.png.733781e84c2a65c6757fd3f79d209bba.pngimage.thumb.png.5a9edfac1060d79635d14e8609acac1c.pngimage.thumb.png.6344de8a30df222956bd88f53bc2b143.png

Link to comment
Share on other sites

Link to post
Share on other sites

if i can get the cache to work maybe someone can help me get sniproxy to work later that is giving me a

bind 0.0.0.0:443 failed: Address in use

2019-03-09 03:21:17 Failed to initialize listener 0.0.0.0:443

2019-03-09 03:21:18 bind 0.0.0.0:443 failed: Address in use

2019-03-09 03:21:18 Failed to initialize listener 0.0.0.0:443

2019-03-09 03:21:21 bind 0.0.0.0:443 failed: Address in use

Link to comment
Share on other sites

Link to post
Share on other sites

On 3/8/2019 at 12:24 AM, Coop52 said:

Yes i successfully got this running, however I didn't follow the guide on the site but something in between the guide here and what the site says.... I might write something up here later if I have some time this weekend.

Thanks, I'm looking forward to it

Link to comment
Share on other sites

Link to post
Share on other sites

On 3/11/2019 at 3:51 PM, Native7i said:

Thanks, I'm looking forward to it

so here it is... a bit later than expected..

This assumes you have a fresh installation of Ubuntu... (I specifically have Ubuntu 16.04 Server working with this in a VM under FreeNAS) ..SSH into your Ubuntu installation and enter the below;

sudo apt-get upgrade

sudo apt-get update

sudo apt install curl -y

sudo curl -sSL https://get.docker.com/ | sh

sudo docker run --restart=always -d --name lancache -v /srv/lancache/data:/data/cache -p 80:80 steamcache/monolithic:latest
  
sudo docker run --restart=always --name steamcache-dns --detach -p 53:53/udp -e USE_GENERIC_CACHE=true -e LANCACHE_IP=$HOST_IP steamcache/steamcache-dns:latest

sudo docker run --restart=always --name sniproxy --detach -p 443:443 steamcache/sniproxy:latest

sudo docker exec -it lancache tail -f /data/logs/access.log

The last line of code above gives you the log file which will list the files being downloaded / cached.

Link to comment
Share on other sites

Link to post
Share on other sites

Since Steam released Proton is there a way to get this to work with a Linux gaming machine?

Link to comment
Share on other sites

Link to post
Share on other sites

  • 2 weeks later...
On 3/22/2019 at 8:15 AM, NotDaleGribble said:

Since Steam released Proton is there a way to get this to work with a Linux gaming machine?

It should work with any type of device that is conected to the internet through your dns-caching server. I doubt that Steamcache even notices what OS your client is running...

Link to comment
Share on other sites

Link to post
Share on other sites

  • 3 weeks later...
On 8/24/2018 at 2:31 AM, Unieveth said:

I have it working to the point where I can see the data coming through my cache server.  When I try and download a game I just installed then uninstalled it still pulls the game data from steam servers and not from the cache.  Anything I'm missing that would cause it not to pull from the cache?

 

Did you ever manage to get this fixed? Running into the same issue.

Link to comment
Share on other sites

Link to post
Share on other sites

after i get steamcache/monolithic running

Quote

HOST_IP=`hostname -I | cut -d' ' -f1`
docker run --restart unless-stopped --name steamcache-dns --detach -p 53:53/udp -e USE_GENERIC_CACHE=true -e LANCACHE_IP=$HOST_IP steamcache/steamcache-dns:latest
docker run --restart unless-stopped --name lancache --detach -v /cache/data:/data/cache -v /cache/logs:/data/logs -p 80:80  steamcache/monolithic:latest
docker run --restart unless-stopped --name sniproxy --detach -p 443:443 steamcache/sniproxy:latest

i noticed, steam only uses https which is not cached.

it uses the sniproxy which is very slow

 

any ideas?

 

Quote

netstat -b -n

 

 [Steam.exe]
  TCP    192.168.2.114:53707    192.168.2.124:443      WARTEND
  TCP    192.168.2.114:53708    192.168.2.124:443      WARTEND
  TCP    192.168.2.114:53711    192.168.2.124:443      HERGESTELLT
 [Steam.exe]
  TCP    192.168.2.114:53712    192.168.2.124:443      WARTEND
  TCP    192.168.2.114:53713    192.168.2.124:443      WARTEND
  TCP    192.168.2.114:53715    192.168.2.124:443      WARTEND
  TCP    192.168.2.114:53716    192.168.2.124:443      WARTEND
  TCP    192.168.2.114:53719    192.168.2.124:443      WARTEND
  TCP    192.168.2.114:53720    192.168.2.124:443      WARTEND
  TCP    192.168.2.114:53722    192.168.2.124:443      WARTEND
  TCP    192.168.2.114:53723    192.168.2.124:443      HERGESTELLT
 [Steam.exe]
  TCP    192.168.2.114:53724    192.168.2.124:443      HERGESTELLT


 

Link to comment
Share on other sites

Link to post
Share on other sites

On 4/23/2019 at 12:24 PM, malachian said:

Did you ever manage to get this fixed? Running into the same issue.

Did you try just using the Steamcache as your DNS?
Checked if your download is actually going through the Steamcache? (check network activity)

 

Link to comment
Share on other sites

Link to post
Share on other sites

On 4/25/2019 at 8:29 PM, CD Fighter said:

after i get steamcache/monolithic running

i noticed, steam only uses https which is not cached.

it uses the sniproxy which is very slow

 

any ideas?

 


 

https://github.com/steamcache/monolithic/issues/28

 

Steam has switched their entire CDN over to HTTPS a few days ago breaking all steam caching solution's, I hope they will provide a alternative dedicated HTTP server for LAN organisers....

Respect the Code of Conduct!

>> Feel free to join the unofficial LTT teamspeak 3 server TS3.schnitzel.team <<

>>LTT 10TB+ Topic<< | >>FlexRAID Tutorial<<>>LTT Speed wave<< | >>LTT Communies and Servers<<

Link to comment
Share on other sites

Link to post
Share on other sites

I emailed Valve last night and they've switched it back to HTTP. It will go back to HTTPS at some point in future, but when it happens there will be a way to achieve caching. I'd suggest following the GitHub project for Steam Cache as we'll post any updates over there.

Link to comment
Share on other sites

Link to post
Share on other sites

3 hours ago, Mintopia said:

I emailed Valve last night and they've switched it back to HTTP. It will go back to HTTPS at some point in future, but when it happens there will be a way to achieve caching. I'd suggest following the GitHub project for Steam Cache as we'll post any updates over there.

 

Is setting up a transparent https proxy with squid an option ?

Can Anybody Link A Virtual Machine while I go download some RAM?

 

Link to comment
Share on other sites

Link to post
Share on other sites

  • 1 month later...

I tried setting this up and didn't get any errors, and my container ls reads

CONTAINER ID        IMAGE                              COMMAND                  CREATED             STATUS              PORTS                              NAMES
ba34c6e93909        steamcache/sniproxy:latest         "/scripts/bootstrap.…"   5 seconds ago       Up 3 seconds        0.0.0.0:443->443/tcp               sniproxy
262b9e0fe77b        steamcache/steamcache-dns:latest   "bash /scripts/boots…"   37 seconds ago      Up 35 seconds       192.168.1.50:53->53/udp            steamcache-dns
ef5c8b844bd4        steamcache/generic:latest          "/bin/bash -e /init/…"   2 minutes ago       Up 2 minutes        192.168.1.52:80->80/tcp, 443/tcp   blizzard-cache
d5cca061e187        steamcache/generic:latest          "/bin/bash -e /init/…"   2 minutes ago       Up 2 minutes        192.168.1.51:80->80/tcp, 443/tcp   origin-cache
56641f989a31        steamcache/generic:latest          "/bin/bash -e /init/…"   2 minutes ago       Up 2 minutes        192.168.1.50:80->80/tcp, 443/tcp   steam-cache
 

 

seems okay, and when I download a game from steam I see lots of incoming AND outgoing activity on nload, but if I delete the game in steam and redownload it I see lots of the same activity from both inbound and outbound, plus my data folder is only 99 MB in size with a bunch of random folders like

01  0b  12  1c  20  2a  3c  43  49  4b  50  5b  65  69  6d  72  75  77  80  89  8b  94  a1  a8  ab  ae  b3  b5  bd  c5  c8  d1  d8  e0  e8  ec  f2
07  0c  14  1f  22  35  3f  47  4a  4f  58  62  68  6c  6f  74  76  7e  87  8a  8e  96  a4  a9  ac  b2  b4  b7  c2  c6  c9  d3  dc  e7  eb  ed  fc
 

 

Finally, my errors log is empty, and my access log is here:

https://pastebin.com/uytRNiut

 

Can't understand where the problem, any help?

Link to comment
Share on other sites

Link to post
Share on other sites

On 6/4/2019 at 8:22 PM, wonderbread said:

seems okay, and when I download a game from steam I see lots of incoming AND outgoing activity on nload, but if I delete the game in steam and redownload it I see lots of the same activity from both inbound and outbound, plus my data folder is only 99 MB in size with a bunch of random folders

 

Finally, my errors log is empty, and my access log is here:

 

Can't understand where the problem, any help?

I have the same problem.

Origin, Blizzard works totally fine but Steam wont. 

Have to download a game like 4-5 times until it is fully cashed.

Also SteamCache Monolithic crashes at about 50% of the download.

 

When SteamCache crashes the error log shows something like: 

Spoiler

 

 [error] 14#14: *105 upstream timed out (110: Operation timed out) while connecting to upstream

 

I think that is causing my cache to crash but not that I have to download a game multiple times until its fully cached.

 

Any help is appreciated

Link to comment
Share on other sites

Link to post
Share on other sites

  • 2 weeks later...

I switched to monolithic as well and yeah blizzard is working great, but steam still wont cache games after download despite nload activity.

Link to comment
Share on other sites

Link to post
Share on other sites

I currently have a Windows Home Server 2011 used basically as a file server, streaming media, and running a minecraft server for my kids and cousins. I'm planning on changing it to use just good old Windows 10 Pro because WHS is antiquated and has limitations, and am hoping to do more with it, including using it as a Steam and Origin cache server (any way to make it work with GOG?)

 

My primary question: I have a spare 4TB hard drive I'd like to put in my Windows 10 file "server" to use as a Steam and Origin cache server. Is it advisable to run Linux with Docker in a VM? I'm not too adept at Linux, and this may be a trivial question for you seasoned Linux vets, but how do I only mount the one hard drive to use for Steam and Origin cache? Do I just mount and run the VM from the drive I want to use?

 

It's not going to get a lot of heavy traffic, just trying to cut down on monthly bandwidth. I frequently download to my desktop and laptop, and my kids download to their PC's as well. I've run close to my 1TB monthly bandwidth limit on many occasions and this should help cut down on that. 

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


×