1.5s-2s audio delay with Elgato HD60 connected to Switch

[Hollytree]

Hello!

So I stream using StreamlabsOBS and recently bought an Avermedia capture card, there was a pretty hefty delay so I ended up sending it back as everything I tried to do to fix it didn't work and I thought it might just be faulty. 
I've now bought an Elgato HD60 instead and this has the same issue. I followed every setup guide out there, asked friends who have Elgato stream gear and all of them have said they've never had this issue. 
I've tried:
Disabling Timestamps
Disconnecting/reconnecting
Updating drivers
Trying a wired headset
Adjusting the ms delay in SLOBS
Trying different HDMI cables in case one in damaged
Starting a fresh multiple times

Non of this has worked and I've done more but at this point there's just too much to remember and list.

If anyone has any reccomendations or fixes I would be beyond grateful at this point.

[NinJake]

If you do a local recording is there a delay still?

[Hollytree]

19 hours ago, NinJake said:

If you do a local recording is there a delay still?

Yep, there's a delay regardless of how I record or stream