There's good news and bad news.
It looks like your router has the proper support to classify/police your traffic. Good news.
Bad news. It's using DSCP technology to do to. This is not a slam against DSCP. It is excellent technology (especially when it first started appearing in devices about 15years ago). The configuration interface, as you can see is quite overwhelming and assumes a higher level of understanding that I suspect may make it unwieldy in your case.
Do you feel comfortable with the idea of taking a small, perhaps currently unused system and making it into a home router ? I think I saw a recommendation of pfSense a few posts ago which not only has an excellent traffic shaper/bandwidth control interface, but you can plug a 'squid' web cache into it (via software) if this is something you would also like to explore as per your initial query. Since you had asked about setting up a cache, perhaps you have a candidate system already ?
TL/DR . Yes, your router can do what we've discussed, but be prepared for an exciting 'journey' to get it set up
= F