If you've got a power line adaptor, make sure that is it plugged DIRECTLY into the wall, avoiding plugging it into extension cables with surge protection etc. Within the upstairs "router's" web panel, disable dhcp, set up your SSID name and password for wireless. Off you go.
Quote me if you need a hand with finding the web panel.