You don’t punish them per se, but you do sanction them.
For example, Bolsonaro can’t leave the country even though he hasn’t been found guilty of anything yet.
Also, someone who’s been accused of murder will probably be arrested preventatively if the judge in charge has reason to believe they will reincide before the proceedings are through.
These things happen all the time and they’re designed to protect society from further damage from criminals who haven’t yet been fully judged and processed.