The problem with removing their right to drive, is in North America thats basically removing their rights to travel even within their own city. I agree this person shouldn’t be driving on the road but as a society we would need to build other options to get around.
Toronto probably has enough transit and alternatives that lisences could reasonably be taken away but many people will still claim it as a direct infringement on their freedom. Since lisences are managed by the provincial government, most of cities in the province would need to have reliable alternatives to driving for police to effectively remove lisences.