I have a similar issue.
I have a Ryzen 5600x system on a x570 MB with a Radeon 6800 XT.
Everything stable since a built the system in Nov and had to run with a GTX 970 for graphics while I struggled to find a GPU.
I bought my MSI Gaming Trio X RX 6800 XT and was so happy, until I started playing my primary game. Elite Dangerous.
It reboots the whole computer when I try to jump to another system. But the reboot isn't successful. It halts with a video error on the diagnostic LEDs. I have to power down, and restart to get it running again. When it does restart it has a warning about how the card doesn't support UEFI and CSM must run. That isn't true because before the fault happens it boots to default just fine.
I have tried 2 more recent drivers, 2 most recent BIOSes for my Stix E-Gaming x570 board, leaving the DOCP settings off the RAM, etc.
I have no overclocking or tweaking. Everything stock.
System was completely stable before the RX6800XT. The common thread here is AMD GPUs. RDNA and RDNA2 based. Same drivers.
I thought I had an answer when the problem seemed to stabilize when using the game in fullscreen mode vs borderless mode. No good. Still crashes. It's not every time, so it's difficult to see without playing for a while. I'll make 6-7 jumps and think I finally got it! Then it will crash 3 times in a row.