Update: No way to get things the way I exactly wanted them. However, using display fusions macros you can keybind a command to send the cursor back to primary monitor's center, if you have a mouse with buttons you can make it the "trigger" for macro.
Alternatives for this software that can do this that is free is AutoHotkey.
another paid version that i thought about was Ultramon but quite expensive for what you get.
TL;DR Display fusion is a must for some with multi-monitor setups.