Hmm... in extreme cases, I've used an old electric razor to cut away the fuzz balls on a coat, but not sure if it would help here, or even fit in the shoe...
Sorry bud, out of ideas. Might just have to go to town with a pair of tweezers / needle nose pliers.