Try turning off the background auto scan for music, I was having the same issue, silky smooth for a while, then big stutters, etc.
Lots of googling later and I found the cause of my issue (It seems people have a different cause each time so lots of trialing), I switched that option off, and resolved the stutters!