Great video! Mad respect Linus, it takes to serious juevos to show that kind of humility with that many people watching.
For a PC equivalent to this though, I think it's a hard shrug for all the reasons you pointed out.
Workstation GPUs have DirectGMA(GPUOpen) and the new version of GPUDirect(coming soon, CUDA 11.0) to talk directly to a PCI-E SSD, but neither address the issue of the stream decompression that could potentially give Sony's SSDs an edge in throughput, but may not be a huge deal since like Linus pointed out originally, PC already has some pretty fast SSDs
If compression is a big deal though, it would fall on GPU manufacturers to implement stream decompression using either block level decompression that can be parallelized on the CUDA cores/Stream processors, or going the Sony route and putting that compression hardware on the board somewhere.
I suspect the stream decompression is out of scope for an M.2 SSD to have this kind of stream processor on it due to power/heat constraints in the form factor though, so it would have to end up on the GPU somewhere or as an entire new PCI-E device, which could be cool but expensive, and another thing eating PCI-E lanes.