Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
jakkuh_t

Downloading Games at 10 GIGABIT?

Recommended Posts

Posted · Original PosterOP

We finally upgrade our setup in hope to allow all of our writers to download games at the same time, with speeds upwards of 10 gigabit.

 

 

Buy Corsair SSDs:
On Amazon: http://geni.us/l4oz
On Newegg: http://geni.us/kuBr


widget.png?style=banner2   -  7700K, 16GB RAM, ROG 2080 Ti, 2*4TB Black, 1TB Crucial NVMe


 

Link to post
Share on other sites

Needs moar speed :P


Current Network Layout:

Current Build Log:

Prior Build Log:

Link to post
Share on other sites

This is very similar to my project. I moved some common games to a server with 10gbe and then installed a 10gbe switch and lan cards in some of my machines. I then put the games on the raid 0 ssd's on the server and setup mapped drives on the other machines and pointed steam or w/e to them.

 

In the end I got performance similar to the ssd's they have locally. I mean if the game took 12 seconds to launch on an ssd it took about 15-17 this way, but still way faster than an HDD and I saved a lot of space all around.

 

Now on the internet side, which is what I initially thought this was more about without a caching(proxy) system. I have a gigabit connection and even to places like steam I very seldom can get more than say 60MBps, which is about half what I can do. I run in to that problem in most places, they just do not offer up files at speeds that can saturate my connection.

Link to post
Share on other sites

> be me

> HS6Zf1D.jpg

> existence-is_pain.jpg


ASUS X470-PRO • R7 1700 4GHz • Corsair H110i GT P/P • 2x MSI RX 480 8G • Corsair DP 2x8 @3466 • EVGA 750 G2 • Corsair 730T • Crucial MX500 250GB • WD 4TB

Link to post
Share on other sites

Could this be used to cache other streaming services like Netflix?

 

We often watch the same shows multiple times by different users in the household and it would be pretty amazing to cache these recently watched shows and to even in theory watch some content when the internet goes down momentarily?

Link to post
Share on other sites
5 minutes ago, valiente said:

Oh wow - You are also still running XP mate?

Just 7 with the xp theme, it's my NAS screen


ASUS X470-PRO • R7 1700 4GHz • Corsair H110i GT P/P • 2x MSI RX 480 8G • Corsair DP 2x8 @3466 • EVGA 750 G2 • Corsair 730T • Crucial MX500 250GB • WD 4TB

Link to post
Share on other sites
13 minutes ago, ifconfig said:

Where are the links to the docker tutorial and the steamcache setup guide?

^^^ I always look for the links but they're never there... (like on the Linux GPI PCIe passthrough to Windows vid..)


X58 Madlads: General X58 Xeon/i7 discussion     X99 bois: General X99 Xeon/i7 Discussion 

 

Current Rig: 

i7 5820K on a Heatkiller IV Pro Acetal
EVGA X99 Classified
32GB (4x8) 3200Mhz CL16 HyperX Predator DDR4
Radeon VII on an EK Acetal block and black EK backplate 
250GB 960 Evo, 1TB 970 Evo
Corsair RM1000i

Phanteks Enthoo Evolv ATX TG, Grey
EK D5 pump/res combo, EK-ZMT tubing, EK stubby barb fittings, 360 and 120mm GTS stealth rads, 4x Noctua iPPC NF-F12s

 

Old Star Wars Games:  Anyone still playing old Star Wars games? 

 

Long live his RGBness, @Damascus! And Fractal Design/SeaSonic dude, @Ordinarily_Greater is awesome as well! Also the man who introduced me to the glorious XCMR, LGA1366 Xeons, and X chipsets: @WhisperingKnickers.

 

 

 

Link to post
Share on other sites

I'm using lancache on my own game cafe and yes it's a very very complicated setup on freebsd (installing nginx and other packages, adding ip, configuring dns, editing a lot of configuration files) but it works. I'll give a try using steamcache, it looks very much simpler.

Link to post
Share on other sites
50 minutes ago, andrii1812 said:

Also you can try docker-compose. Instead of launching each container from the text file you write yaml config once and then just fire: 

 

docker-compose up

 

https://docs.docker.com/compose/gettingstarted/#step-3-define-services-in-a-compose-file

 

Did exactly that.


Grab the attached file and just run:

docker-compose up -d

and all containers will boot up. The cache dir will be created in the same dir. You can change that by changing the ./data parts to another (absolute) path.

Change the IPs according to your Network.

Note: I just used the example from the video. But the windows-cache is not available anymore in the current versions of the image.
Instead they have added a few other. Here a complete list

  • apple
  • arenanet
  • blizzard
  • daybreak
  • frontier
  • gog
  • hirez
  • minecraft
  • nexusmod
  • nintendo
  • origin
  • riot
  • rockstar
  • sony
  • steam
  • twitch
  • uplay
  • wargaming
  • wsus
  • xboxlive

Just copy one of the last blocks and rename accordingly. And then add an entry beneith the environment-part of the dns-service.

docker-compose.yml

Edited by AliGinBerlin
Added more tips for easy access.
Link to post
Share on other sites

So I tried this in a Docker on Unraid but the max speed I can seem to download at is 35 MBps. More Commonly around 25 MBps. I installed it a bit differently than the guide. I installed using the Community Applications plugin and following the directions there. I am also running Hard Disks rather than Raid0 SSDs so I understand that I might not be able to saturate the gigabit connection but It seems like it should still be faster. 

 

I am running the following.

 

Unraid 6.5.3

3570k

16 GB 1600MHz DDR3 Memory

3  8TB Ironwolf Drives with 1 acting as parity.

1 128 GB SSD Corsair Force 3 or something I dont remember exactly.

Asus p8z77-v motherboard

Link to post
Share on other sites

Again with the misuse of "bottlenecking". Ugh....

 

Multiple people trying to download games at the same time -- attempting to access the same network resource at the same time -- is called CONTENTION! With all the networking stuff you've done on that channel, I'm surprised you and your writers couldn't keep your terms straight...


Wife's build: Amethyst - Intel i7-5820k, 16GB EVGA DDR4, ASUS X99-PRO/USB 3.1, EVGA GTX 1080 SC, Corsair Obsidian 750D, Corsair RM1000

My build: Mira - Intel i7-5820k, 16GB EVGA DDR4, ASUS Sabertooth X99, EVGA GTX 1070 SC Black Edition, NZXT H440, EVGA Supernova 1050 GS

Link to post
Share on other sites
11 hours ago, GumblesGrambles said:

Just share an entire steam library folder as a network share, the game files are generic, just copy straight over to your own, no cpu core limitations;)

This is what I was thinking (and have done,including traveling to a families home), esp if you are like me with almost every steam game downloaded.

Link to post
Share on other sites

Honestly, I would be more into seeing you taking it a step-down, and making it run on a smaller setup like a qnap nas or similar. Most of those can run a docker image, and is both affordable for the average user or even something they already own. Go big or go home projects can be cool but are hard to relate to, so perhaps a budget challenge instead... or both..

Link to post
Share on other sites

Can someone help me understand this?  Or let me know if I'm understanding it correctly?

 

Basically download something (at normal speed) into your own storage so that you then can put in on a different local machine later on at a higher speed than you can download from source?

 

Cool to do... but really only useful for LAN parties where people do not already have the game that will be played at said LAN party which would be odd to begin with?

 

 

Link to post
Share on other sites

@thedude4bides You pretty much got the main use for it! That's mentioned on the github as well that its primarily for LAN events and for popular games, yeah most people will have it. One spot where is can shine though is, say there is an unexpected game that any number of people want to play, normally everyone would then need to download it from the Internet, since they didn't expect to play it at the event. With this set up, once one person downloads it from the internet, everyone else immediately pulls from the cache, so anyone who wants it after the one person downloaded it can grab it at the cache speeds.

 

@Norrah By default, this can be scaled down as far as you like :) I set it up in my location (mainly just to try it out as an experiment) and the set up its on it an older computer hooked into a router, which then runs to a switch and then to several computers. No need for any fancy equipment as the magic is in the software itself, equipment just lets you reach higher speeds (which makes more of a difference especially if you already have a great internet connection, since you might already be getting ~25MBps for example).

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


×