If you ever used a tool known as "Mastochist" or "Mastodon Super Tools" and connected it to your Mastodon account, you need to remove the affected token.
Preferences > Account > Authorized Apps
It would be a good time to revoke access to other apps there that haven't been used in awhile, too.
