I'm not sure about the Note 5 but a lot of samsung devices come with a free 50gb upgrade to dropbox so the expandable storage wouldn't be TOO big of a deal if you have pictures/videos taking up space, however I do know how annoying it is having to delete apps and I do not know if it is on the note 5.
USB3 is nice but I get along fine without it. Do you need it?
The bigger battery however IS annoying. Part of the reason I got an LG G3 because the 3,000mAh battery but that doesn't last as long as I thought, it will last even less time on a bigger, brighter display like the Note 5's.
In tests online it apparently survives 10 hours which is not brilliant. It's up to you entirely though.