Fiber cables aren't crimped... They are cut, polished and terminated. People go to school to work with Fiber Optic Cabling. Its not like ethernet where if you mess up the end you just cut it off and try again, its a bit more involving.
If you can just buy pre-made patch cords, I would go with Multimode - LC standard. Easy to work with, SFP's are readily available. Plus for the distances we are talking about you don't need the long distance offered by Single mode. I use Single mode between buildings that are further than 500m from one another. I can push Multi-Mode further but the quality of the connection degrades the farther you go.
Switching is going to be somewhat expensive as you will need switches for each floor that have multi-purpose ports to install the SFP into, or get a line converter that allows you to convert to a copper ethernet cable. Not a fan of these as they are typically unmanaged, require additional power, and if they fail they don't always show as failed. I have tons of these things across multiple locations and I have been replacing them with Cisco fiber switches in my core and using SFPs.
As cool as this idea may be there really isn't a benefit unless you are really pushing data between the floors of your house. Most people get away with GbE, or even 10GbE over copper.
If you are going to go this way my suggestion is to pay someone to do the fiber work...