The rules on filming people vary from state to state. I can't remember which states are which way off the top of my head, but I know some require mutual consent of all parties involved while others just say "hey, it's your fault you didn't close your blinds".
So, yeah, there are still going to be some issues to work out on the privacy side of things.