Steam will use your default device, go into voice and choose the option to change it, change your default and close the dialog box and it should have a button for "finished changing" or something like that, or just change it in the Windows settings without using Steam and then restart Steam.