I've done some research about KVM switches, and other ways of connecting multiple USB devices on two computers, and this is pretty much what where all ended. To be clear, i do not need to use the devices simultaneously on both computers, and this is just for convenience of not needing to replug all my devices depending on what am i doing. I plan to use my mouse, keyboard, and amp/dac thru the switch. I have separate inputs for the video signal so i don't really need an KVM switch in this case. The other part will be plugged to my main PC, where i do all my gaming, modding and photo editing etc. and the other end to my laptop, which is enough for general browsing and music listening, what i'm doing currently on my main PC, and the power consumption and noise don't really justify themselves for this light usage.
So, i'm mainly worried about the latency. Will there be significant latency on then USB Switch thingy? And then the audio part, would it interfere with my audio in any possible way? You can see my KB+M, audio gear and monitor from my profile, in case you need to know them for something.