He was wearing it all the time before he was assassinated as the senate had allowed him to do so. This was after the 5th triumph when they dumped a lot of other titles on him. The picture has the laurels in it, which is also typically just for ceremonies, so he should also be in a purple toga.