That's right about trademarks. As this source puts it, you should never let it drop. The competition might register it ahead to, as already mentioned, make the term more generalized, use the previous trademark against you, etc. And you might not be able to take it off someone who 'snatches' it from you if they are more prudent not to let the trademark expire.