Downloading Games at 10 GIGABIT?

[jakkuh_t]

We finally upgrade our setup in hope to allow all of our writers to download games at the same time, with speeds upwards of 10 gigabit.

 

 

Buy Corsair SSDs:
On Amazon: http://geni.us/l4oz
On Newegg: http://geni.us/kuBr

[Lurick]

Needs moar speed

[AngryBeaver]

This is very similar to my project. I moved some common games to a server with 10gbe and then installed a 10gbe switch and lan cards in some of my machines. I then put the games on the raid 0 ssd's on the server and setup mapped drives on the other machines and pointed steam or w/e to them.

 

In the end I got performance similar to the ssd's they have locally. I mean if the game took 12 seconds to launch on an ssd it took about 15-17 this way, but still way faster than an HDD and I saved a lot of space all around.

 

Now on the internet side, which is what I initially thought this was more about without a caching(proxy) system. I have a gigabit connection and even to places like steam I very seldom can get more than say 60MBps, which is about half what I can do. I run in to that problem in most places, they just do not offer up files at speeds that can saturate my connection.

[mynameisjuan]

Congrats LTT, you have now matched my home connection 

[aezakmi]

> be me

>

> existence-is_pain.jpg

[valiente]

Could this be used to cache other streaming services like Netflix?

 

We often watch the same shows multiple times by different users in the household and it would be pretty amazing to cache these recently watched shows and to even in theory watch some content when the internet goes down momentarily?

[ifconfig]

Where are the links to the docker tutorial and the steamcache setup guide?

[valiente]

1 minute ago, aezakmi said:

> be me

>

> existence-is_pain.jpg

Oh wow - You are also still running XP mate?

[aezakmi]

5 minutes ago, valiente said:

Oh wow - You are also still running XP mate?

Just 7 with the xp theme, it's my NAS screen

[unijab]

Caching vs Cashing...

[Zando_]

13 minutes ago, ifconfig said:

Where are the links to the docker tutorial and the steamcache setup guide?

^^^ I always look for the links but they're never there... (like on the Linux GPI PCIe passthrough to Windows vid..)

[Desertpunk]

 

 

the video they keep referencing

Edited August 20, 2018 by Desertpunk
spelling mistake

[adhisakti]

I'm using lancache on my own game cafe and yes it's a very very complicated setup on freebsd (installing nginx and other packages, adding ip, configuring dns, editing a lot of configuration files) but it works. I'll give a try using steamcache, it looks very much simpler.

[Booleanfeeder]

Is that a custom grafana skin for the stats endpoint?

[johnnydoe9]

Dude I'm paying a significant amount for my internet and boasting about 1 MBPS speeds. 

[jakkuh_t]

5 minutes ago, Booleanfeeder said:

Is that a custom grafana skin for the stats endpoint?

It's Netdata

 

https://my-netdata.io/

[andrii1812]

Also you can try docker-compose. Instead of launching each container from the text file you write yaml config once and then just fire: 

 

docker-compose up

 

https://docs.docker.com/compose/gettingstarted/#step-3-define-services-in-a-compose-file

 

[AliGinBerlin]

50 minutes ago, andrii1812 said:

Also you can try docker-compose. Instead of launching each container from the text file you write yaml config once and then just fire: 

 

docker-compose up

 

https://docs.docker.com/compose/gettingstarted/#step-3-define-services-in-a-compose-file

 

Did exactly that.

Grab the attached file and just run:

docker-compose up -d

and all containers will boot up. The cache dir will be created in the same dir. You can change that by changing the ./data parts to another (absolute) path.

Change the IPs according to your Network.

Note: I just used the example from the video. But the windows-cache is not available anymore in the current versions of the image.
Instead they have added a few other. Here a complete list

• apple
• arenanet
• blizzard
• daybreak
• frontier
• gog
• hirez
• minecraft
• nexusmod
• nintendo
• origin
• riot
• rockstar
• sony
• steam
• twitch
• uplay
• wargaming
• wsus
• xboxlive

Just copy one of the last blocks and rename accordingly. And then add an entry beneith the environment-part of the dns-service.

docker-compose.yml

Edited August 20, 2018 by AliGinBerlin
Added more tips for easy access.

[Runtime]

So I tried this in a Docker on Unraid but the max speed I can seem to download at is 35 MBps. More Commonly around 25 MBps. I installed it a bit differently than the guide. I installed using the Community Applications plugin and following the directions there. I am also running Hard Disks rather than Raid0 SSDs so I understand that I might not be able to saturate the gigabit connection but It seems like it should still be faster. 

 

I am running the following.

 

Unraid 6.5.3

3570k

16 GB 1600MHz DDR3 Memory

3  8TB Ironwolf Drives with 1 acting as parity.

1 128 GB SSD Corsair Force 3 or something I dont remember exactly.

Asus p8z77-v motherboard

[GumblesGrambles]

Just share an entire steam library folder as a network share, the game files are generic, just copy straight over to your own, no cpu core limitations;)

[brandishwar]

Again with the misuse of "bottlenecking". Ugh....

 

Multiple people trying to download games at the same time -- attempting to access the same network resource at the same time -- is called CONTENTION! With all the networking stuff you've done on that channel, I'm surprised you and your writers couldn't keep your terms straight...

[Egg-Roll]

11 hours ago, GumblesGrambles said:

Just share an entire steam library folder as a network share, the game files are generic, just copy straight over to your own, no cpu core limitations;)

This is what I was thinking (and have done,including traveling to a families home), esp if you are like me with almost every steam game downloaded.

[Norrah]

Honestly, I would be more into seeing you taking it a step-down, and making it run on a smaller setup like a qnap nas or similar. Most of those can run a docker image, and is both affordable for the average user or even something they already own. Go big or go home projects can be cool but are hard to relate to, so perhaps a budget challenge instead... or both..

[thedude4bides]

Can someone help me understand this?  Or let me know if I'm understanding it correctly?

 

Basically download something (at normal speed) into your own storage so that you then can put in on a different local machine later on at a higher speed than you can download from source?

 

Cool to do... but really only useful for LAN parties where people do not already have the game that will be played at said LAN party which would be odd to begin with?

 

 

[Larklen]

@thedude4bides You pretty much got the main use for it! That's mentioned on the github as well that its primarily for LAN events and for popular games, yeah most people will have it. One spot where is can shine though is, say there is an unexpected game that any number of people want to play, normally everyone would then need to download it from the Internet, since they didn't expect to play it at the event. With this set up, once one person downloads it from the internet, everyone else immediately pulls from the cache, so anyone who wants it after the one person downloaded it can grab it at the cache speeds.

 

@Norrah By default, this can be scaled down as far as you like  I set it up in my location (mainly just to try it out as an experiment) and the set up its on it an older computer hooked into a router, which then runs to a switch and then to several computers. No need for any fancy equipment as the magic is in the software itself, equipment just lets you reach higher speeds (which makes more of a difference especially if you already have a great internet connection, since you might already be getting ~25MBps for example).