This could possibly mean that your games are using the integrated graphics system in your cpu and ure gpu is doing nothing. Make sure ure hdmi is plugged into the gpu and not the mother board. Also check the drivers.
I have an rx 570 8gb which runs the same as the 4 gb and it does much better than this. Try lowering settings in your games because while the card is a pretty good budget card, it’s nothing crazy.