Jump to content

Steam Cache

Riptide0
By Riptide0
in Networking
 Share
Posted

I recently set up a steam cache but am running into a speed issue. I have an all gigabit network connection, 2 striped HDDs, and 4 cores given to the VM as well as 3GB of RAM. Nomatter what I do I cant seem to get more than 25mbps from this server which just seems too low. I am not sure I set up the cache completely correctly as I am fairly new to using VMs and caching in general. Any direction is appreciated.

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/
Share on other sites
Link to post
Share on other sites
Posted
  • Author
13 hours ago, Electronics Wizardy said:

What usage do you see in the vm? Disk? Cpu? Can you run iostat on the vm?

How would I run that program? I see about 20% useage on 2 to 3 of the cores given to it and the overall cpu package stays around 50degrees and never goes above 50% useage even with other VMs running on it and a game being pulled from the cache. I used crystaldiskmark to check the overall raid 0 speeds for the drives on that VM and it says that their reads are 200mb/s and the write are 175mb/s on average.

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14635005
Share on other sites
Link to post
Share on other sites
Posted
4 hours ago, Riptide0 said:

How would I run that program? I see about 20% useage on 2 to 3 of the cores given to it and the overall cpu package stays around 50degrees and never goes above 50% useage even with other VMs running on it and a game being pulled from the cache. I used crystaldiskmark to check the overall raid 0 speeds for the drives on that VM and it says that their reads are 200mb/s and the write are 175mb/s on average.

just run iostat in the terminal. Normally in the sysstat pack in most package managers.

 

What os are you using?

 

 

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14635712
Share on other sites
Link to post
Share on other sites
Posted
  • Author
4 minutes ago, Electronics Wizardy said:

what program is the vm running in?

 

Can you run iostat in ubuntu?

It is running in VMware Workstation Pro and is currently up to date with all recent updates. I ran iostat and got this,

 

Linux 5.8.0-48-generic (ubuntu)     04/11/2021     _x86_64_    (4 CPU)

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           6.45    0.01    2.70    0.41    0.00   90.43

Device             tps    kB_read/s    kB_wrtn/s    kB_dscd/s    kB_read    kB_wrtn    kB_dscd
loop0             0.00         0.05         0.00         0.00       6934          0          0
loop1             0.01         0.07         0.00         0.00      10193          0          0
loop10            0.00         0.00         0.00         0.00        347          0          0
loop11            0.00         0.01         0.00         0.00       1103          0          0
loop12            0.00         0.00         0.00         0.00         18          0          0
loop2             0.00         0.00         0.00         0.00        347          0          0
loop3             0.00         0.01         0.00         0.00       1091          0          0
loop4             0.01         0.03         0.00         0.00       5090          0          0
loop5             0.00         0.00         0.00         0.00        133          0          0
loop6             0.00         0.00         0.00         0.00        226          0          0
loop7             0.01         0.12         0.00         0.00      18412          0          0
loop8             0.00         0.01         0.00         0.00       1090          0          0
loop9             0.01         0.17         0.00         0.00      26367          0          0
sda               3.17        81.57       145.22         0.00   12505334   22263461          0
scd0              0.00         0.00         0.00         0.00          2          0          0

 

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14638925
Share on other sites
Link to post
Share on other sites
Posted
3 minutes ago, Riptide0 said:

It is running in VMware Workstation Pro and is currently up to date with all recent updates. I ran iostat and got this,

 

Linux 5.8.0-48-generic (ubuntu)     04/11/2021     _x86_64_    (4 CPU)

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           6.45    0.01    2.70    0.41    0.00   90.43

Device             tps    kB_read/s    kB_wrtn/s    kB_dscd/s    kB_read    kB_wrtn    kB_dscd
loop0             0.00         0.05         0.00         0.00       6934          0          0
loop1             0.01         0.07         0.00         0.00      10193          0          0
loop10            0.00         0.00         0.00         0.00        347          0          0
loop11            0.00         0.01         0.00         0.00       1103          0          0
loop12            0.00         0.00         0.00         0.00         18          0          0
loop2             0.00         0.00         0.00         0.00        347          0          0
loop3             0.00         0.01         0.00         0.00       1091          0          0
loop4             0.01         0.03         0.00         0.00       5090          0          0
loop5             0.00         0.00         0.00         0.00        133          0          0
loop6             0.00         0.00         0.00         0.00        226          0          0
loop7             0.01         0.12         0.00         0.00      18412          0          0
loop8             0.00         0.01         0.00         0.00       1090          0          0
loop9             0.01         0.17         0.00         0.00      26367          0          0
sda               3.17        81.57       145.22         0.00   12505334   22263461          0
scd0              0.00         0.00         0.00         0.00          2          0          0

 

And is that with a device pulling from the cache now?

 

vmware workstation probably isn't the best for io either, hyper v is probably better as its a type 1 hypervisor.

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14638951
Share on other sites
Link to post
Share on other sites
Posted
  • Author
2 minutes ago, Electronics Wizardy said:

And is that with a device pulling from the cache now?

 

vmware workstation probably isn't the best for io either, hyper v is probably better as its a type 1 hypervisor.

It is not pulling right now. Nothing I know of would be pulling from that VM as there are only 2 machines that can. I do have other VMs running on that same machine, could those cores be overburdened? If so would I be able to choose certain cores to allot to that machine alone?

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14638958
Share on other sites
Link to post
Share on other sites
Posted
2 minutes ago, Riptide0 said:

It is not pulling right now. Nothing I know of would be pulling from that VM as there are only 2 machines that can. I do have other VMs running on that same machine, could those cores be overburdened? If so would I be able to choose certain cores to allot to that machine alone?

What is the cpu usage on the host? If its not super high, then cpu usage isn't probably the issue. Also the cache system doesn't need much cpu.

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14638962
Share on other sites
Link to post
Share on other sites
Posted
  • Author
3 minutes ago, Electronics Wizardy said:

What is the cpu usage on the host? If its not super high, then cpu usage isn't probably the issue. Also the cache system doesn't need much cpu.

With all VMs and my minecraft server running I am floating around 9-15% CPU useage.

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14638972
Share on other sites
Link to post
Share on other sites
Posted
  • Author
2 minutes ago, Electronics Wizardy said:

Whatt cpu does the host have? That seems low so cpu usage shouldn't be a issue.

A Xeon 5630. Would you recommend I move to a better hypervisor like unraid? If so would I be able to copy my VMs to a usb and move them over that way or would I have to rebuild them all?

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14638986
Share on other sites
Link to post
Share on other sites
Posted
37 minutes ago, Riptide0 said:

A Xeon 5630. Would you recommend I move to a better hypervisor like unraid? If so would I be able to copy my VMs to a usb and move them over that way or would I have to rebuild them all?

Id probalby run hyper-v server or proxmox as a hypervisor on that system, instead of windows 10. Should work better, and be easiler to manage. 

 

 

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14639079
Share on other sites
Link to post
Share on other sites
Posted
  • Author
33 minutes ago, Electronics Wizardy said:

Id probalby run hyper-v server or proxmox as a hypervisor on that system, instead of windows 10. Should work better, and be easiler to manage. 

 

 

How would I migrate my VMs if I did so? How does hyperv or proxmox compare to unraid as unraid is the only hardware virtualization program I have used

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14639160
Share on other sites
Link to post
Share on other sites
Posted
1 minute ago, Riptide0 said:

How would I migrate my VMs if I did so? How does hyperv or proxmox compare to unraid as unraid is the only hardware virtualization program I have used

Poxmox uses the same linux + kvm as unraid, but gives you more storage and vm options, and is free. Not not s esy to use.

 

Both of those are free, give it a shot, hyper-v is also included in windows 10.

 

Can you backup the vm to or make a image and then restore the backup?

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14639166
Share on other sites
Link to post
Share on other sites
Posted
  • Author
2 minutes ago, Electronics Wizardy said:

Poxmox uses the same linux + kvm as unraid, but gives you more storage and vm options, and is free. Not not s esy to use.

 

Both of those are free, give it a shot, hyper-v is also included in windows 10.

 

Can you backup the vm to or make a image and then restore the backup?

I am not sure if I can as I have never moved a VM or copied a VM. I am very new to VMs. How would I go about using Hyper-V? If it is default installed on windows then I would rather give that a try first before I start re-imaging things

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14639179
Share on other sites
Link to post
Share on other sites
Posted
Just now, Riptide0 said:

I am not sure if I can as I have never moved a VM or copied a VM. I am very new to VMs. How would I go about using Hyper-V? If it is default installed on windows then I would rather give that a try first before I start re-imaging things

IN order to enable hyper-v in windows 10, enble it under the programs and features menu in windows. This will break vmware workstation though

 

 

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14639184
Share on other sites
Link to post
Share on other sites
Posted
  • Author
49 minutes ago, Electronics Wizardy said:

IN order to enable hyper-v in windows 10, enble it under the programs and features menu in windows. This will break vmware workstation though

 

 

Would I run into any compatibility issues going from VMware to HyperV?

Link to comment
https://linustechtips.com/topic/1324620-steam-cache/#findComment-14639335
Share on other sites
Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing Networking

×